2024-02-18T09:48:17.667 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-18T09:48:17.668 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235 --name vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi --owner scheduled_vshankar@teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --verbose -- /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/orig.config.yaml 2024-02-18T09:48:17.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T09:48:17.798 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235 branch: wip-vshankar-testing-20240217.015652 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: vshankar@redhat.com first_in_suite: false job_id: '7564235' kernel: client: branch: testing flavor: default kdb: true sha1: 8d59ab0bd93c806231018a6729893bf309624262 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240217.015652 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1c920afa8316ea21877f3186850254947531ea22 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1c920afa8316ea21877f3186850254947531ea22 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240217.015652 sha1: 1c920afa8316ea21877f3186850254947531ea22 owner: scheduled_vshankar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 218 sha1: 1c920afa8316ea21877f3186850254947531ea22 sleep_before_teardown: 0 subset: 793/1024 suite: fs suite_branch: wip-vshankar-testing-20240217.015652 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1c920afa8316ea21877f3186850254947531ea22 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZioc6pa4+oz0XCTQljlJUduSe+1jIjC5Fd/aVbJThzKIigAJ8tMAY97unjHomM/Kr+lPwT2ZnhoHDwzJeFf6Y= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYQXOSdNYnapYj4jEuyCXlXEtYTzVQN5PHvDgwA3lbpsizkfA844XZUDsejkHpeA+WlFtFy6kA5uxDBmeYv/yo= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEmMb6FqGoyWzX8eSx4hpHjQmEenwlCRh7eo4G9jaP2v6LNgIXfax8fJXUI5J2v+9KwXG0HYZrjXDpQLedOwY7w= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-17_05:57:56 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-18T09:48:17.798 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa; will attempt to use it 2024-02-18T09:48:17.798 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa/tasks 2024-02-18T09:48:17.799 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-18T09:48:17.800 INFO:teuthology.task.internal:Checking packages... 2024-02-18T09:48:17.824 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1c920afa8316ea21877f3186850254947531ea22' 2024-02-18T09:48:17.824 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-18T09:48:17.825 INFO:teuthology.packaging:ref: None 2024-02-18T09:48:17.825 INFO:teuthology.packaging:tag: None 2024-02-18T09:48:17.825 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240217.015652 2024-02-18T09:48:17.825 INFO:teuthology.packaging:sha1: 1c920afa8316ea21877f3186850254947531ea22 2024-02-18T09:48:17.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240217.015652 2024-02-18T09:48:18.047 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1555.g1c920afa 2024-02-18T09:48:18.048 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-18T09:48:18.056 INFO:teuthology.task.internal:no buildpackages task found 2024-02-18T09:48:18.056 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-18T09:48:18.075 INFO:teuthology.task.internal:Saving configuration 2024-02-18T09:48:18.092 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-18T09:48:18.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-18T09:48:18.127 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 09:42:35.259265', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZioc6pa4+oz0XCTQljlJUduSe+1jIjC5Fd/aVbJThzKIigAJ8tMAY97unjHomM/Kr+lPwT2ZnhoHDwzJeFf6Y='} 2024-02-18T09:48:18.144 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 09:42:35.257767', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYQXOSdNYnapYj4jEuyCXlXEtYTzVQN5PHvDgwA3lbpsizkfA844XZUDsejkHpeA+WlFtFy6kA5uxDBmeYv/yo='} 2024-02-18T09:48:18.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 09:42:35.256535', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEmMb6FqGoyWzX8eSx4hpHjQmEenwlCRh7eo4G9jaP2v6LNgIXfax8fJXUI5J2v+9KwXG0HYZrjXDpQLedOwY7w='} 2024-02-18T09:48:18.166 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-18T09:48:18.172 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-02-18T09:48:18.173 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-02-18T09:48:18.173 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['client.0'] 2024-02-18T09:48:18.173 INFO:teuthology.run_tasks:Running task console_log... 2024-02-18T09:48:18.276 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f878b97df70>, signals=[15]) 2024-02-18T09:48:18.277 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-18T09:48:18.284 INFO:teuthology.task.internal:Opening connections... 2024-02-18T09:48:18.284 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T09:48:18.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:48:18.393 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T09:48:18.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:48:18.483 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-02-18T09:48:18.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:48:18.573 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-18T09:48:18.580 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-02-18T09:48:18.598 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-02-18T09:48:18.598 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T09:48:18.656 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-02-18T09:48:18.657 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T09:48:18.657 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T09:48:18.657 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T09:48:18.657 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-02-18T09:48:18.680 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-02-18T09:48:18.698 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-02-18T09:48:18.698 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-02-18T09:48:18.755 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T09:48:18.756 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-02-18T09:48:18.756 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T09:48:18.756 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T09:48:18.756 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T09:48:18.756 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-02-18T09:48:18.780 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-02-18T09:48:18.798 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-02-18T09:48:18.798 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-18T09:48:18.855 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-18T09:48:18.856 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-18T09:48:18.856 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-02-18T09:48:18.880 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-18T09:48:18.890 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-18T09:48:18.905 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-18T09:48:18.906 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-02-18T09:48:18.908 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-02-18T09:48:18.911 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-02-18T09:48:18.927 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-18T09:48:18.933 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-18T09:48:18.933 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-02-18T09:48:18.965 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-02-18T09:48:18.967 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-02-18T09:48:18.996 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-18T09:48:19.079 INFO:teuthology.run_tasks:Running task kernel... 2024-02-18T09:48:19.094 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'} 2024-02-18T09:48:19.094 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-02-18T09:48:19.094 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-02-18T09:48:19.094 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-18T09:48:19.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T09:48:19.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-02-18T09:48:19.367 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8d59ab0bd93c806231018a6729893bf309624262 2024-02-18T09:48:19.367 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8d59ab0bd93c806231018a6729893bf309624262"... 2024-02-18T09:48:19.367 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-02-18T09:48:19.384 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-361.el9.x86_64 2024-02-18T09:48:19.384 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8d59ab0bd93c806231018a6729893bf309624262 2024-02-18T09:48:19.385 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-18T09:48:19.385 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum upgrade -y linux-firmware 2024-02-18T09:48:21.540 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-02-18T09:48:23.223 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2024-02-18T09:48:24.972 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-02-18T09:48:26.890 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-02-18T09:48:31.785 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.1 MB 00:01 2024-02-18T09:48:33.084 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 15 kB 00:00 2024-02-18T09:48:34.685 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-18T09:48:39.710 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 9.9 kB/s | 1.7 kB 00:00 2024-02-18T09:48:42.105 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-02-18T09:48:42.114 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-02-18T09:48:42.114 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-02-18T09:48:42.114 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-02-18T09:48:42.114 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-02-18T09:48:42.114 INFO:teuthology.orchestra.run.smithi204.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-02-18T09:48:42.114 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:48:42.114 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-02-18T09:48:42.115 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-02-18T09:48:42.115 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 1 Package 2024-02-18T09:48:42.115 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:48:42.115 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 375 M 2024-02-18T09:48:42.115 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-02-18T09:48:46.494 INFO:teuthology.orchestra.run.smithi204.stdout:linux-firmware-20240109-142.el9.noarch.rpm 86 MB/s | 375 MB 00:04 2024-02-18T09:48:46.495 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-02-18T09:48:46.496 INFO:teuthology.orchestra.run.smithi204.stdout:Total 86 MB/s | 375 MB 00:04 2024-02-18T09:48:46.496 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-02-18T09:48:46.579 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-02-18T09:48:46.579 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-02-18T09:48:49.027 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-02-18T09:48:49.028 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-02-18T09:48:55.380 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-02-18T09:48:55.683 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-18T09:48:55.786 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-18T09:48:57.285 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-18T09:48:57.285 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-18T09:48:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-18T09:48:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:48:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-02-18T09:48:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: linux-firmware-20240109-142.el9.noarch 2024-02-18T09:48:57.651 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:48:57.651 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-02-18T09:48:57.956 INFO:teuthology.task.kernel:Downloading kernel 8d59ab0bd93c806231018a6729893bf309624262 on client.0... 2024-02-18T09:48:57.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d59ab0bd93c806231018a6729893bf309624262 2024-02-18T09:48:58.109 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/ 2024-02-18T09:48:58.110 DEBUG:teuthology.orchestra.run.smithi204:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc4_g8d59ab0bd93c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-18T09:48:58.112 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi204.front.sepia.ceph.com to complete... 2024-02-18T09:49:10.588 INFO:teuthology.orchestra.run.smithi204.stderr:2024-02-18 09:49:10 URL:https://1.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/centos/9/flavors/default/x86_64/kernel-6.8.0_rc4_g8d59ab0bd93c-1.x86_64.rpm [333224823/333224823] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-18T09:49:10.588 INFO:teuthology.orchestra.run.smithi204.stderr:FINISHED --2024-02-18 09:49:10-- 2024-02-18T09:49:10.588 INFO:teuthology.orchestra.run.smithi204.stderr:Total wall clock time: 12s 2024-02-18T09:49:10.588 INFO:teuthology.orchestra.run.smithi204.stderr:Downloaded: 1 files, 318M in 12s (26.3 MB/s) 2024-02-18T09:49:10.591 INFO:teuthology.task.kernel:Installing kernel 8d59ab0bd93c806231018a6729893bf309624262 on client.0... 2024-02-18T09:49:10.591 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-18T09:49:12.507 INFO:teuthology.orchestra.run.smithi204.stdout:Verifying... ######################################## 2024-02-18T09:49:12.611 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing... ######################################## 2024-02-18T09:49:12.691 INFO:teuthology.orchestra.run.smithi204.stdout:Updating / installing... 2024-02-18T09:49:20.163 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-6.8.0_rc4_g8d59ab0bd93c-1 ######################################## 2024-02-18T09:49:36.555 INFO:teuthology.orchestra.run.smithi204.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-18T09:49:58.853 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-18T09:49:58.854 DEBUG:teuthology.orchestra.run.smithi204:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-18T09:49:58.938 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:49:58.938 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/System.map 2024-02-18T09:49:58.938 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/config 2024-02-18T09:49:58.938 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel 2024-02-18T09:49:58.938 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch 2024-02-18T09:49:58.938 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-18T09:49:58.939 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-18T09:49:58.940 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ansi_cprng.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/anubis.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/arc4.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_memcpy.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_pq.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_tx.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_xor.ko 2024-02-18T09:49:58.941 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/raid6test.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authenc.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authencesn.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blake2b_generic.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_common.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_generic.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/camellia_generic.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast5_generic.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast6_generic.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast_common.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ccm.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cmac.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crc32_generic.ko 2024-02-18T09:49:58.942 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_engine.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_user.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cts.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/des_generic.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/dh_generic.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/echainiv.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/essiv.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/fcrypt.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/khazad.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4hc.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/md4.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/michael_mic.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcbc.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcrypt.ko 2024-02-18T09:49:58.943 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/rmd160.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/seed.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/serpent_generic.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tcrypt.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tea.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_common.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_generic.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/vmac.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/wp512.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xcbc.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xor.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xxhash_generic.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-18T09:49:58.944 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_pad.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/custom_method.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/ec_sys.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/platform_profile.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbs.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbshc.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/video.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/acard-ahci.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ahci_platform.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ata_generic.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/libahci_platform.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_acpi.ko 2024-02-18T09:49:58.945 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ali.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_amd.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_artop.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atiixp.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atp867x.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd640.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd64x.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cypress.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_efar.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt366.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt37x.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-18T09:49:58.946 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it8213.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it821x.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_jmicron.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_marvell.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_mpiix.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_netcell.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ninja32.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87410.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87415.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_oldpiix.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_opti.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_optidma.ko 2024-02-18T09:49:58.947 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pcmcia.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_piccolo.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_rdc.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sch.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_serverworks.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sil680.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sis.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sl82c105.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_triflex.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_via.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pdc_adma.ko 2024-02-18T09:49:58.948 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_inic162x.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_mv.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_nv.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_promise.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_qstor.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil24.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sis.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_svw.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sx4.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_uli.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_via.ko 2024-02-18T09:49:58.949 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_vsc.ko 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay/ks0108.ko 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma/bcma.ko 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe/aoe.ko 2024-02-18T09:49:58.950 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/brd.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd/drbd.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/floppy.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/loop.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/nbd.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk/null_blk.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/pktcdvd.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/rbd.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/virtio_blk.ko 2024-02-18T09:49:58.951 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkfront.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram/zram.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hangcheck-timer.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/via-rng.ko 2024-02-18T09:49:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/lp.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave/mwave.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ppdev.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tlclk.ko 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm 2024-02-18T09:49:58.953 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/uv_mmtimer.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/virtio_console.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-18T09:49:58.954 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp.ko 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-aes.ko 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-sha.ko 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio 2024-02-18T09:49:58.955 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca/dca.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/devfreq 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/amd64_edac.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/e752x_edac.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/edac_mce_amd.ko 2024-02-18T09:49:58.956 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3000_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3200_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5100_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5400_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7300_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7core_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i82975x_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/ie31200_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/sb_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/x38_edac.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/edd.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-18T09:49:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-ich.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-appleir.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-aureal.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-axff.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-dr.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elecom.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elo.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-emsff.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gaff.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gt683r.ko 2024-02-18T09:49:58.958 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gyration.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtekff.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-hyperv.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-icade.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-keytouch.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-kye.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lcpower.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-led.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lenovo.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-multitouch.ko 2024-02-18T09:49:58.959 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ortek.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-penmount.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-petalynx.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-picolcd.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-pl.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-plantronics.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-primax.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-rmi.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-common.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-18T09:49:58.960 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-saitek.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-samsung.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sjoy.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sony.ko 2024-02-18T09:49:58.961 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-speedlink.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-steelseries.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sunplus.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tivo.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tmff.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-topseed.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-twinhan.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-uclogic.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-waltop.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-wiimote.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-xinmo.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zpff.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zydacron.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/uhid.ko 2024-02-18T09:49:58.962 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/wacom.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_balloon.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_utils.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_vmbus.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru3.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7414.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7418.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adc128d818.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1025.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1026.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1029.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1031.ko 2024-02-18T09:49:58.963 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm9240.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ads7828.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7410.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7411.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7462.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7470.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7475.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7x10.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/amc6821.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/applesmc.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asb100.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asc7621.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-18T09:49:58.964 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/atxp1.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/coretemp.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dme1737.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds1621.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds620.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc1403.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc6w201.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71805f.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71882fg.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f75375s.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fam15h_power.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fschmd.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g760a.ko 2024-02-18T09:49:58.965 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g762.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl518sm.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl520sm.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5500_temp.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5k_amb.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmaem.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmpex.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina209.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina2xx.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/it87.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k10temp.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k8temp.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lineage-pem.ko 2024-02-18T09:49:58.966 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm63.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm73.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm75.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm77.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm78.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm80.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm83.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm85.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm87.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm90.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm92.ko 2024-02-18T09:49:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm93.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95234.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95241.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95245.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc2945.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4151.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4215.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4222.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4245.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4260.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4261.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max16065.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1619.ko 2024-02-18T09:49:58.968 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1668.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max197.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6639.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6650.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6697.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/mcp3021.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6683.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775-core.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct7802.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87360.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87427.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pcf8591.ko 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus 2024-02-18T09:49:58.969 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-18T09:49:58.970 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/powr1220.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5627.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5636.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht15.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht21.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/shtc1.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sis5595.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47b397.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m1.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m192.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/thmc50.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp102.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp103.ko 2024-02-18T09:49:58.971 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp401.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp421.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via-cputemp.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via686a.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt1211.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt8231.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627ehf.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627hf.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83781d.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83791d.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83792d.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83793.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83795.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l785ts.ko 2024-02-18T09:49:58.972 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l786ng.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-18T09:49:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-18T09:49:58.974 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-dev.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-mux.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-smbus.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-stub.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-18T09:49:58.975 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_core.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca 2024-02-18T09:49:58.976 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-18T09:49:58.977 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/gameport.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/joydev.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/appletouch.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/bcm5974.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/cyapatp.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-18T09:49:58.978 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/sermouse.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/altera_ps2.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/arc_ps2.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/serio_raw.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/sparse-keymap.ko 2024-02-18T09:49:58.979 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-blinkm.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3530.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lp3944.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-ss4200.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-18T09:49:58.980 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache/bcache.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-bio-prison.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache-smq.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-crypt.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-delay.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-flakey.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-log-userspace.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-multipath.ko 2024-02-18T09:49:58.981 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-queue-length.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-raid.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-round-robin.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-service-time.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-switch.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-thin-pool.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-verity.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid0.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid1.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid10.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid456.ko 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message 2024-02-18T09:49:58.982 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptbase.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptctl.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptfc.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptlan.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptsas.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptscsih.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptspi.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_ich.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_sch.ko 2024-02-18T09:49:58.983 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/mfd-core.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/sm501.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/viperboard.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/vx855.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/wl1273-core.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds9802als.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds990x.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/bh1770glc.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710/cb710.ko 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom 2024-02-18T09:49:58.984 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/at24.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/max6875.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/enclosure.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/hpilo.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29003.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29020.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-me.ko 2024-02-18T09:49:58.985 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-txe.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-gru 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_7xx1.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_core.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tsl2550.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_balloon.ko 2024-02-18T09:49:58.986 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding/bonding.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dummy.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/eql.ko 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet 2024-02-18T09:49:58.987 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-18T09:49:58.988 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-18T09:49:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-18T09:49:58.990 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-18T09:49:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-18T09:49:58.992 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dnet.ko 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ethoc.ko 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fealnx.ko 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000 2024-02-18T09:49:58.993 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-18T09:49:58.994 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/jme.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel 2024-02-18T09:49:58.995 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines 2024-02-18T09:49:58.996 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-18T09:49:58.997 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rocker 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-18T09:49:58.998 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-18T09:49:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/geneve.ko 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154 2024-02-18T09:49:59.000 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ifb.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvlan.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvtap.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mii.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/net_failover.ko 2024-02-18T09:49:59.001 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/netconsole.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/nlmon.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/amd.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm87xx.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/broadcom.ko 2024-02-18T09:49:59.002 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/cicada.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/davicom.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/dp83640.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/et1011c.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/icplus.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/lxt.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/marvell.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/micrel.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/national.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/phylink.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/qsemi.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/realtek.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/smsc.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/ste10Xp.ko 2024-02-18T09:49:59.003 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/vitesse.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_async.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppoe.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppox.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pptp.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slhc.ko 2024-02-18T09:49:59.004 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slip.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/sungem_phy.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tap.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_random.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tun.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/veth.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/virtio_net.ko 2024-02-18T09:49:59.005 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan/vxlan.ko 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netfront.ko 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb/ntb.ko 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme-core.ko 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme.ko 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport 2024-02-18T09:49:59.006 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_cs.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_pc.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_serial.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pcie 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/xen-pcifront.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/i82092.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pd6729.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-18T09:49:59.007 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acerhdf.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-18T09:49:59.008 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/hdaps.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel_ips.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-18T09:49:59.009 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps_parport.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/pps_core.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp_kvm.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-18T09:49:59.010 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-em3027.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-18T09:49:59.011 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max6900.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-18T09:49:59.012 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-x1205.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-9xxx.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-sas.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-xxxx.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/BusLogic.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/a100u2w.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-18T09:49:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/advansys.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/am53c974.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/atp870u.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa/bfa.ko 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc 2024-02-18T09:49:59.014 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ch.ko 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-18T09:49:59.015 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dc395x.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dmx3191d.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esp_scsi.ko 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe 2024-02-18T09:49:59.016 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic/fnic.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hpsa.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hptiop.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hv_storvsc.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/initio.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ipr.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ips.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci/isci.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-18T09:49:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc/libfc.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas/libsas.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-18T09:49:59.018 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvumi.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pmcraid.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla1280.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/raid_class.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_debug.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-18T09:49:59.019 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ses.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/st.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/stex.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/virtio_scsi.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/wd719x.ko 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb 2024-02-18T09:49:59.020 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb/ssb.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_file.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_iblock.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_mod.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_pscsi.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_user.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal 2024-02-18T09:49:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-18T09:49:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_gsm.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_hdlc.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/nozomi.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/arc_uart.ko 2024-02-18T09:49:59.023 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_aec.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_cif.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_pci_generic.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_sercos3.ko 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb 2024-02-18T09:49:59.024 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-acm.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usblp.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usbtmc.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/mdc800.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/microtek.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/adutux.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/appledisplay.ko 2024-02-18T09:49:59.025 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi26.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi62.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ezusb.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/idmouse.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/iowarrior.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ldusb.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/legousbtower.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usb3503.ko 2024-02-18T09:49:59.026 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usblcd.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/uss720.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/yurex.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-generic.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/aircable.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ark3116.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ch341.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cp210x.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cyberjack.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-18T09:49:59.027 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/empeg.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_ti.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipaq.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipw.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ir-usb.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-18T09:49:59.028 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mct_u232.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7720.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7840.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/navman.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/omninet.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/opticon.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/option.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/oti6858.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/pl2303.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcaux.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcserial.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/quatech2.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/safe_serial.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/sierra.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ssu100.ko 2024-02-18T09:49:59.029 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/symbolserial.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_debug.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/visor.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/whiteheat.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/uas.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-18T09:49:59.030 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-karma.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/usb-storage.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-18T09:49:59.031 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_net.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_scsi.ko 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight 2024-02-18T09:49:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/apple_bl.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lcd.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_balloon.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_mmio.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/virtio/virtio_ring.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2482.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2490.ko 2024-02-18T09:49:59.033 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/wire.ko 2024-02-18T09:49:59.034 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/hpwdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/i6300esb.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ib700wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ibmasr.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it87_wdt.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/machzwd.ko 2024-02-18T09:49:59.035 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/nv_tco.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/softdog.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/via_wdt.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wdt_pci.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/xen_wdt.ko 2024-02-18T09:49:59.036 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-evtchn.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntalloc.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntdev.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-privcmd.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p/9p.ko 2024-02-18T09:49:59.037 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs/affs.ko 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs/befs.ko 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/binfmt_misc.ko 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs/btrfs.ko 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles/cachefiles.ko 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph/ceph.ko 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda/coda.ko 2024-02-18T09:49:59.038 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs/cramfs.ko 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm/dlm.ko 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ecryptfs 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs/f2fs.ko 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/fat.ko 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/msdos.ko 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/vfat.ko 2024-02-18T09:49:59.039 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/cuse.ko 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/fuse.ko 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2/gfs2.ko 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs/hfs.ko 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus/hfsplus.ko 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs/isofs.ko 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs 2024-02-18T09:49:59.040 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs/jfs.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd/lockd.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix/minix.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs/netfs.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfs.ko 2024-02-18T09:49:59.041 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv3.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv4.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/grace.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/nfs_acl.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd/nfsd.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2/nilfs2.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-celtic.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-centeuro.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-croatian.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-cyrillic.ko 2024-02-18T09:49:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-gaelic.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-greek.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-iceland.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-inuit.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-roman.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-romanian.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-turkish.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1250.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1251.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1255.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp737.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp775.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp850.ko 2024-02-18T09:49:59.043 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp852.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp855.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp857.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp860.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp861.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp862.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp863.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp864.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp865.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp866.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp869.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp874.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp932.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp936.ko 2024-02-18T09:49:59.044 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp949.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp950.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_euc-jp.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-1.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-13.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-14.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-15.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-2.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-3.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-4.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-5.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-6.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-7.ko 2024-02-18T09:49:59.045 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-9.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-r.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-ru.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-u.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_utf8.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-18T09:49:59.046 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs/overlay.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore/ramoops.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs/reiserfs.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs/romfs.ko 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb 2024-02-18T09:49:59.047 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client/cifs.ko 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_arc4.ko 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_md4.ko 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs/squashfs.ko 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv/sysv.ko 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf/udf.ko 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs 2024-02-18T09:49:59.048 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs/ufs.ko 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs/xfs.ko 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/rcu 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/rcu/rcutorture.ko 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/torture.ko 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/trace 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/asn1_encoder.ko 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc-itu-t.ko 2024-02-18T09:49:59.049 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc8.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libarc4.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libdes.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/libcrc32c.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lru_cache.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4_compress.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4hc_compress.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math/cordic.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6/raid6_pq.ko 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon 2024-02-18T09:49:59.050 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_bm.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_fsm.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_kmp.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/zstd 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/zstd/zstd_compress.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm/hwpoison-inject.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/6lowpan.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_dest.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_fragment.ko 2024-02-18T09:49:59.051 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_hop.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_mobility.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_routing.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_udp.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/garp.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/mrp.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/p8022.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/psnap.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/stp.ko 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q 2024-02-18T09:49:59.052 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q/8021q.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_fd.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_rdma.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_virtio.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv/batman-adv.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/br_netfilter.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/bridge.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-18T09:49:59.053 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-18T09:49:59.054 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtables.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph/libceph.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/failover.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/pktgen.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp.ko 2024-02-18T09:49:59.055 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_diag.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv4.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv6.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dns_resolver 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dns_resolver/dns_resolver.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/dsa_core.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_brcm.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_dsa.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_none.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_trailer.ko 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154 2024-02-18T09:49:59.056 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ah4.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/esp4.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/fou.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/gre.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/inet_diag.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_gre.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_tunnel.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_vti.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipcomp.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipip.ko 2024-02-18T09:49:59.057 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-18T09:49:59.058 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_bic.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_dctcp.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_diag.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_highspeed.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_htcp.ko 2024-02-18T09:49:59.059 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_hybla.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_illinois.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_lp.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_scalable.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_vegas.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_veno.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_westwood.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_yeah.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tunnel4.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_diag.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_tunnel.ko 2024-02-18T09:49:59.060 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ah6.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/esp6.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/fou6.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_tunnel.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_vti.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ipcomp6.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-18T09:49:59.061 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-18T09:49:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/sit.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/tunnel6.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key/af_key.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_core.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-18T09:49:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_eth.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip6.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_netlink.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ppp.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/llc.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154/mac802154.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls/mpls_gso.ko 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset 2024-02-18T09:49:59.064 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-18T09:49:59.065 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-18T09:49:59.066 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conncount.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-18T09:49:59.067 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_log_syslog.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-18T09:49:59.068 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_irc.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_sip.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_tables.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_log.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_chain_nat.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_compat.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_ct.ko 2024-02-18T09:49:59.069 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fib.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_hash.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_limit.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_log.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_masq.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_nat.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_numgen.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_queue.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_quota.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_redir.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject.ko 2024-02-18T09:49:59.070 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject_inet.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_socket.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_tunnel.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_AUDIT.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CT.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_DSCP.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HL.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HMARK.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LED.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LOG.ko 2024-02-18T09:49:59.071 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NETMAP.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFLOG.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_RATEEST.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_SECMARK.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TEE.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TPROXY.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TRACE.ko 2024-02-18T09:49:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_addrtype.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_bpf.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cgroup.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cluster.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_comment.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connbytes.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlabel.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlimit.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connmark.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_conntrack.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cpu.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dccp.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_devgroup.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dscp.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ecn.ko 2024-02-18T09:49:59.073 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_esp.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hashlimit.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_helper.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hl.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipcomp.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_iprange.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipvs.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_l2tp.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_length.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_limit.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mac.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mark.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_multiport.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nat.ko 2024-02-18T09:49:59.074 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nfacct.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_osf.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_owner.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_physdev.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_pkttype.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_policy.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_quota.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_rateest.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_realm.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_recent.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_sctp.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_set.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_socket.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_state.ko 2024-02-18T09:49:59.075 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_statistic.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_string.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_tcpmss.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_time.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_u32.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink/netlink_diag.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh/nsh.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/openvswitch.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-geneve.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-gre.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-vxlan.ko 2024-02-18T09:49:59.076 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet/af_packet_diag.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_rdma.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_tcp.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_csum.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_gact.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_mirred.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_nat.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_pedit.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_police.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_simple.ko 2024-02-18T09:49:59.077 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_skbedit.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_vlan.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_basic.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_bpf.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_flow.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_fw.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_route.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_u32.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_cmp.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_ipset.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_meta.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_nbyte.ko 2024-02-18T09:49:59.078 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_text.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_u32.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_choke.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_codel.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_drr.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_fq.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_gred.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hfsc.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hhf.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_htb.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_ingress.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio_lib.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_multiq.ko 2024-02-18T09:49:59.079 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_netem.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_pie.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_plug.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_prio.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_qfq.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_red.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfb.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfq.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_tbf.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_teql.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp.ko 2024-02-18T09:49:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp_diag.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/sunrpc.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/diag.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/tipc.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix/unix_diag.ko 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock 2024-02-18T09:49:59.081 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/encrypted-keys 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/trusted-keys 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/security/keys/trusted-keys/trusted.ko 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt 2024-02-18T09:49:59.082 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib/irqbypass.ko 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias.bin 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.alias.bin 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.bin 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.modinfo 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep.bin 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.devname 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.order 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.softdep 2024-02-18T09:49:59.083 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols 2024-02-18T09:49:59.084 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols.bin 2024-02-18T09:49:59.084 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.8.0-rc4-g8d59ab0bd93c/vmlinuz 2024-02-18T09:49:59.088 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:49:59.088 DEBUG:teuthology.orchestra.run.smithi204:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-18T09:49:59.111 INFO:teuthology.orchestra.run.smithi204.stdout:postinstall scriptlet (using /bin/sh): 2024-02-18T09:49:59.111 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-18T09:49:59.111 INFO:teuthology.orchestra.run.smithi204.stdout: /usr/bin/kernel-install add 6.8.0-rc4-g8d59ab0bd93c /lib/modules/6.8.0-rc4-g8d59ab0bd93c/vmlinuz 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:for file in vmlinuz System.map config; do 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc4-g8d59ab0bd93c/${file}" "/boot/${file}-6.8.0-rc4-g8d59ab0bd93c"; then 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout: cp "/lib/modules/6.8.0-rc4-g8d59ab0bd93c/${file}" "/boot/${file}-6.8.0-rc4-g8d59ab0bd93c" 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout: fi 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:done 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:new-kernel-pkg --remove 6.8.0-rc4-g8d59ab0bd93c --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc4-g8d59ab0bd93c.img 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-install remove 6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-02-18T09:49:59.112 INFO:teuthology.orchestra.run.smithi204.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-18T09:49:59.113 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-18T09:49:59.113 INFO:teuthology.orchestra.run.smithi204.stdout:/sbin/update-bootloader --remove 6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:49:59.113 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-02-18T09:49:59.113 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-02-18T09:49:59.189 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-02-18T09:49:59.189 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-02-18T09:49:59.189 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2024-02-18T09:49:59.189 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 68.el9 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8264254 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2024-02-18T09:49:59.190 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:49:59.191 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-02-18T09:49:59.192 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-18T09:49:59.193 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:49:59.193 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-18T09:49:59.802 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-02-18T09:50:01.121 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-18T09:50:01.169 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-02-18T09:50:01.171 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-02-18T09:50:01.185 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.taUoC2XmXp 2024-02-18T09:50:01.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.taUoC2XmXp 2024-02-18T09:50:01.254 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.taUoC2XmXp 2024-02-18T09:50:01.390 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.taUoC2XmXp is 6KB 2024-02-18T09:50:01.439 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.taUoC2XmXp 2024-02-18T09:50:01.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-02-18T09:50:01.519 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-18T09:50:01.519 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-18T09:50:01.519 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-18T09:50:01.519 INFO:teuthology.orchestra.run.smithi204.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc4-g8d59ab0bd93c.conf 2024-02-18T09:50:01.521 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:50:01.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-02-18T09:50:31.674 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-18T09:50:31.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-18T09:50:31.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:50:50.176 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-18T09:50:59.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-18T09:50:59.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:51:02.236 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-18T09:51:14.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-18T09:51:14.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:51:32.668 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-18T09:51:47.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-18T09:51:47.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:51:51.176 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-02-18T09:51:51.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-18T09:51:51.866 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc4-g8d59ab0bd93c"... 2024-02-18T09:51:51.866 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-02-18T09:51:51.904 INFO:teuthology.orchestra.run.smithi204.stdout:6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:51:51.904 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g8d59ab0bd93c vs 6.8.0-rc4-g8d59ab0bd93c 2024-02-18T09:51:51.904 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-18T09:51:51.904 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-18T09:51:52.905 DEBUG:teuthology.parallel:result is None 2024-02-18T09:51:52.906 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-18T09:51:52.913 INFO:teuthology.task.internal:Creating test directory... 2024-02-18T09:51:52.913 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-18T09:51:52.916 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-18T09:51:52.919 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-18T09:51:52.970 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-18T09:51:52.976 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-18T09:51:52.984 INFO:teuthology.task.internal:Creating archive directory... 2024-02-18T09:51:52.984 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-18T09:51:52.987 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-18T09:51:52.989 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-18T09:51:53.081 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-18T09:51:53.088 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-18T09:51:53.088 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-18T09:51:53.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T09:51:53.104 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-18T09:51:53.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T09:51:53.121 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-18T09:51:53.147 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-18T09:51:53.163 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-18T09:51:53.200 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T09:51:53.202 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T09:51:53.220 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T09:51:53.222 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T09:51:53.305 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T09:51:53.366 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-18T09:51:53.370 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-18T09:51:53.379 INFO:teuthology.task.internal:Configuring sudo... 2024-02-18T09:51:53.379 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-18T09:51:53.382 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-18T09:51:53.385 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-18T09:51:53.459 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-18T09:51:53.470 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-18T09:51:53.471 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-18T09:51:53.473 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-18T09:51:53.475 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-18T09:51:53.515 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T09:51:53.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T09:51:53.633 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T09:51:53.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T09:51:53.763 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:51:53.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-18T09:51:53.832 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T09:51:53.879 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T09:51:53.932 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T09:51:54.015 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T09:51:54.061 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:51:54.062 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-18T09:51:54.130 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T09:51:54.209 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-18T09:51:54.303 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T09:51:54.378 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-18T09:51:54.454 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:51:54.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-18T09:51:54.529 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-02-18T09:51:54.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-02-18T09:51:54.535 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-02-18T09:51:54.576 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-18T09:51:54.582 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-18T09:51:54.694 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-18T09:51:55.016 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-18T09:51:55.024 INFO:teuthology.task.internal:Starting timer... 2024-02-18T09:51:55.025 INFO:teuthology.run_tasks:Running task pcp... 2024-02-18T09:51:55.034 INFO:teuthology.run_tasks:Running task selinux... 2024-02-18T09:51:55.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-02-18T09:51:55.118 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-02-18T09:51:55.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-02-18T09:51:55.173 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-02-18T09:51:55.175 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-02-18T09:51:55.281 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-02-18T09:51:55.286 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-18T09:51:55.286 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-02-18T09:51:55.307 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-02-18T09:51:55.307 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-02-18T09:51:55.333 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-02-18T09:51:55.333 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-02-18T09:51:55.392 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-02-18T09:51:55.392 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-02-18T09:51:55.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-18T09:51:55.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T09:51:55.421 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-18T09:51:55.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T09:51:55.450 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-18T09:51:55.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T09:51:55.528 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-18T09:51:55.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-02-18T09:51:55.575 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-02-18T09:51:55.619 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-02-18T09:51:55.690 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-18T09:51:55.700 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-18T09:51:55.716 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-18T09:51:55.717 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi164.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-18T09:57:47.720 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-02-18T09:57:47.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-02-18T09:57:47.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:57:47.814 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-02-18T09:57:47.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-02-18T09:57:47.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-18T09:57:47.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:57:47.980 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-02-18T09:57:48.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-02-18T09:57:48.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-18T09:57:48.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-18T09:57:48.185 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-02-18T09:57:48.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-18T09:57:48.336 INFO:teuthology.run_tasks:Running task clock... 2024-02-18T09:57:48.349 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-18T09:57:48.350 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-18T09:57:48.350 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T09:57:48.352 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-18T09:57:48.353 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T09:57:48.355 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-18T09:57:48.355 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T09:57:48.381 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-18T09:57:48.383 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-18T09:57:48.398 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-18T09:57:48.400 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-18T09:57:48.428 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-02-18T09:57:48.429 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-02-18T09:57:48.441 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-02-18T09:57:48.442 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-02-18T09:57:48.453 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-18T09:57:48.458 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-18T09:57:48.459 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-18T09:57:48.475 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-18T09:57:48.475 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-18T09:57:48.507 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-18T09:57:48.519 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-02-18T09:57:48.519 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-02-18T09:57:48.524 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-18T09:57:48.524 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-02-18T09:57:48.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.524 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.525 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-18T09:57:48.525 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-02-18T09:57:48.525 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.525 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.526 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.526 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.596 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-02-18T09:57:48.639 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-02-18T09:57:48.692 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-18T09:57:48.745 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-18T09:57:48.875 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-02-18T09:57:48.886 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-18T09:57:48.886 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-02-18T09:57:48.886 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.886 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.887 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.887 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T09:57:48.888 INFO:teuthology.run_tasks:Running task install... 2024-02-18T09:57:48.899 DEBUG:teuthology.task.install:project ceph 2024-02-18T09:57:48.899 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1c920afa8316ea21877f3186850254947531ea22'}} 2024-02-18T09:57:48.899 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1c920afa8316ea21877f3186850254947531ea22'} 2024-02-18T09:57:48.899 INFO:teuthology.task.install:Using flavor: default 2024-02-18T09:57:48.905 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-18T09:57:48.905 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-18T09:57:48.906 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1c920afa8316ea21877f3186850254947531ea22', 'tag': None, 'wait_for_package': False} 2024-02-18T09:57:48.906 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1c920afa8316ea21877f3186850254947531ea22 2024-02-18T09:57:48.908 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1c920afa8316ea21877f3186850254947531ea22', 'tag': None, 'wait_for_package': False} 2024-02-18T09:57:48.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1c920afa8316ea21877f3186850254947531ea22 2024-02-18T09:57:48.909 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1c920afa8316ea21877f3186850254947531ea22', 'tag': None, 'wait_for_package': False} 2024-02-18T09:57:48.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1c920afa8316ea21877f3186850254947531ea22 2024-02-18T09:57:49.060 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/ 2024-02-18T09:57:49.061 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1555.g1c920afa 2024-02-18T09:57:49.166 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/ 2024-02-18T09:57:49.167 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1555.g1c920afa 2024-02-18T09:57:49.170 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/ 2024-02-18T09:57:49.170 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1555.g1c920afa 2024-02-18T09:57:49.249 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-18T09:57:49.249 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:57:49.249 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-18T09:57:49.275 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-18T09:57:49.275 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:57:49.275 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-18T09:57:49.278 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-18T09:57:49.279 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1c920afa8316ea21877f3186850254947531ea22/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-18T09:57:49.344 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240217.015652/1c920afa8316ea21877f3186850254947531ea22/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-18T09:57:49.344 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:57:49.344 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-18T09:57:49.349 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-18T09:57:49.372 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-18T09:57:49.372 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1c920afa8316ea21877f3186850254947531ea22/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-18T09:57:49.379 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-18T09:57:49.380 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1c920afa8316ea21877f3186850254947531ea22/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-18T09:57:49.428 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-18T09:57:49.440 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-18T09:57:49.494 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-02-18T09:57:49.496 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-02-18T09:57:49.515 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-18T09:57:49.519 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-18T09:57:49.586 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-02-18T09:57:49.588 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-02-18T09:57:49.645 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-18T09:57:49.729 INFO:teuthology.orchestra.run.smithi118.stdout:74 files removed 2024-02-18T09:57:49.733 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-02-18T09:57:49.738 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-02-18T09:57:49.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-18T09:57:49.824 INFO:teuthology.orchestra.run.smithi164.stdout:74 files removed 2024-02-18T09:57:49.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-18T09:57:50.080 INFO:teuthology.orchestra.run.smithi204.stdout:74 files removed 2024-02-18T09:57:50.119 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-18T09:57:50.528 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 169 kB/s | 82 kB 00:00 2024-02-18T09:57:50.623 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 169 kB/s | 82 kB 00:00 2024-02-18T09:57:50.836 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 37 kB/s | 10 kB 00:00 2024-02-18T09:57:51.136 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 162 kB/s | 82 kB 00:00 2024-02-18T09:57:51.191 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 19 kB/s | 10 kB 00:00 2024-02-18T09:57:51.346 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-02-18T09:57:51.661 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-02-18T09:57:51.706 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - AppStream 20 MB/s | 6.7 MB 00:00 2024-02-18T09:57:51.707 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-02-18T09:57:52.102 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-02-18T09:57:52.270 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-02-18T09:57:52.806 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-02-18T09:57:53.182 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-02-18T09:57:53.460 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2024-02-18T09:57:53.939 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-02-18T09:57:54.483 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2024-02-18T09:57:54.937 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.0 MB 00:01 2024-02-18T09:57:56.165 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-02-18T09:57:56.226 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.0 MB 00:01 2024-02-18T09:57:57.702 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-02-18T09:57:58.163 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-02-18T09:58:00.275 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-02-18T09:58:01.670 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.1 MB 00:00 2024-02-18T09:58:02.101 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2024-02-18T09:58:03.136 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2024-02-18T09:58:03.545 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2024-02-18T09:58:03.897 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.1 MB 00:01 2024-02-18T09:58:04.472 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2024-02-18T09:58:05.657 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2024-02-18T09:58:06.975 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2024-02-18T09:58:07.986 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-18T09:58:09.622 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-18T09:58:10.485 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-18T09:58:10.486 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-18T09:58:10.500 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-18T09:58:10.501 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-18T09:58:10.502 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-18T09:58:10.503 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-18T09:58:10.505 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-18T09:58:10.508 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-18T09:58:10.509 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-18T09:58:10.591 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 6.6 k 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 5.3 M 2024-02-18T09:58:10.617 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 886 k 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 145 k 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 1.5 M 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 138 k 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 1.8 M 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 7.4 M 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 52 k 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 9.8 M 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 47 M 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 264 k 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 748 k 2024-02-18T09:58:10.618 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 220 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 27 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 18 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 31 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 742 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 127 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-18T09:58:10.619 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 161 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 320 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 298 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 99 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 85 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.1 M 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 171 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-18T09:58:10.620 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-18T09:58:10.621 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.4 M 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.1 M 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-18T09:58:10.622 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 20 M 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 31 k 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 2.1 M 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 248 k 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 4.7 M 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 17 M 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 15 k 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 25 k 2024-02-18T09:58:10.623 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 163 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-18T09:58:10.624 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 499 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 5.1 M 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-18T09:58:10.625 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 45 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 131 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-18T09:58:10.626 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-18T09:58:10.627 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-18T09:58:10.628 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-18T09:58:10.629 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-18T09:58:10.630 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout:Installing weak dependencies: 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-02-18T09:58:10.631 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-02-18T09:58:10.632 INFO:teuthology.orchestra.run.smithi118.stdout:Install 150 Packages 2024-02-18T09:58:10.632 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 26 Packages 2024-02-18T09:58:10.632 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:58:10.632 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 223 M 2024-02-18T09:58:10.632 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-02-18T09:58:11.253 INFO:teuthology.orchestra.run.smithi118.stdout:(1/176): ceph-19.0.0-1555.g1c920afa.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-02-18T09:58:11.929 INFO:teuthology.orchestra.run.smithi118.stdout:(2/176): ceph-fuse-19.0.0-1555.g1c920afa.el9.x8 1.3 MB/s | 886 kB 00:00 2024-02-18T09:58:12.095 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-18T09:58:12.096 INFO:teuthology.orchestra.run.smithi118.stdout:(3/176): ceph-immutable-object-cache-19.0.0-155 871 kB/s | 145 kB 00:00 2024-02-18T09:58:12.096 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-18T09:58:12.110 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-18T09:58:12.111 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-18T09:58:12.112 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-18T09:58:12.113 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-18T09:58:12.115 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-18T09:58:12.118 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-18T09:58:12.119 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-18T09:58:12.199 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-02-18T09:58:12.214 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 6.6 k 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 5.3 M 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 886 k 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 145 k 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 1.5 M 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 138 k 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 1.8 M 2024-02-18T09:58:12.215 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 7.4 M 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 52 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 9.8 M 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 47 M 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 264 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 748 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 220 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 27 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 18 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-18T09:58:12.216 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 31 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 742 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 127 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 161 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 320 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 298 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 99 k 2024-02-18T09:58:12.217 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 85 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.1 M 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 171 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-18T09:58:12.218 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.4 M 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.1 M 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-18T09:58:12.219 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 20 M 2024-02-18T09:58:12.220 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 31 k 2024-02-18T09:58:12.221 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 2.1 M 2024-02-18T09:58:12.221 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 248 k 2024-02-18T09:58:12.221 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 4.7 M 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 17 M 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 15 k 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 25 k 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-18T09:58:12.222 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 163 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 499 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 5.1 M 2024-02-18T09:58:12.223 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-18T09:58:12.224 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 45 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 131 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-18T09:58:12.225 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-18T09:58:12.226 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-18T09:58:12.227 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-18T09:58:12.228 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-18T09:58:12.229 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-18T09:58:12.230 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-02-18T09:58:12.231 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-18T09:58:12.231 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:58:12.231 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-02-18T09:58:12.231 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-02-18T09:58:12.231 INFO:teuthology.orchestra.run.smithi164.stdout:Install 150 Packages 2024-02-18T09:58:12.231 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 26 Packages 2024-02-18T09:58:12.231 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:58:12.232 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 223 M 2024-02-18T09:58:12.232 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-02-18T09:58:12.587 INFO:teuthology.orchestra.run.smithi118.stdout:(4/176): ceph-base-19.0.0-1555.g1c920afa.el9.x8 3.2 MB/s | 5.3 MB 00:01 2024-02-18T09:58:12.740 INFO:teuthology.orchestra.run.smithi164.stdout:(1/176): ceph-19.0.0-1555.g1c920afa.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-02-18T09:58:12.758 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-18T09:58:12.896 INFO:teuthology.orchestra.run.smithi118.stdout:(5/176): ceph-mds-19.0.0-1555.g1c920afa.el9.x86 2.7 MB/s | 2.1 MB 00:00 2024-02-18T09:58:13.338 INFO:teuthology.orchestra.run.smithi118.stdout:(6/176): ceph-mgr-19.0.0-1555.g1c920afa.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-02-18T09:58:13.963 INFO:teuthology.orchestra.run.smithi118.stdout:(7/176): ceph-mon-19.0.0-1555.g1c920afa.el9.x86 4.4 MB/s | 4.7 MB 00:01 2024-02-18T09:58:14.289 INFO:teuthology.orchestra.run.smithi164.stdout:(2/176): ceph-fuse-19.0.0-1555.g1c920afa.el9.x8 572 kB/s | 886 kB 00:01 2024-02-18T09:58:14.515 INFO:teuthology.orchestra.run.smithi164.stdout:(3/176): ceph-base-19.0.0-1555.g1c920afa.el9.x8 2.5 MB/s | 5.3 MB 00:02 2024-02-18T09:58:14.607 INFO:teuthology.orchestra.run.smithi164.stdout:(4/176): ceph-immutable-object-cache-19.0.0-155 458 kB/s | 145 kB 00:00 2024-02-18T09:58:15.205 INFO:teuthology.orchestra.run.smithi118.stdout:(8/176): ceph-radosgw-19.0.0-1555.g1c920afa.el9 7.9 MB/s | 9.8 MB 00:01 2024-02-18T09:58:15.207 INFO:teuthology.orchestra.run.smithi164.stdout:(5/176): ceph-mds-19.0.0-1555.g1c920afa.el9.x86 3.1 MB/s | 2.1 MB 00:00 2024-02-18T09:58:15.263 INFO:teuthology.orchestra.run.smithi118.stdout:(9/176): ceph-selinux-19.0.0-1555.g1c920afa.el9 432 kB/s | 25 kB 00:00 2024-02-18T09:58:15.524 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-18T09:58:15.526 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-18T09:58:15.548 INFO:teuthology.orchestra.run.smithi204.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-18T09:58:15.549 INFO:teuthology.orchestra.run.smithi204.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-18T09:58:15.550 INFO:teuthology.orchestra.run.smithi204.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-18T09:58:15.552 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-18T09:58:15.554 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-18T09:58:15.558 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-18T09:58:15.560 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-18T09:58:15.648 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-02-18T09:58:15.673 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 6.6 k 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 5.3 M 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 886 k 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 145 k 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 1.5 M 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 138 k 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 1.8 M 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 7.4 M 2024-02-18T09:58:15.674 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 52 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 9.8 M 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 47 M 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 264 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 748 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 220 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 27 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 18 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 31 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 742 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 127 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-18T09:58:15.675 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 161 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 320 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 298 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 99 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 85 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.1 M 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 171 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-18T09:58:15.676 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-18T09:58:15.677 INFO:teuthology.orchestra.run.smithi204.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.4 M 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 3.1 M 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-18T09:58:15.678 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 20 M 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 31 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 2.1 M 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 248 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 4.7 M 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 17 M 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1555.g1c920afa.el9 ceph-noarch 15 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 25 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-18T09:58:15.679 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 163 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 499 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 5.1 M 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-18T09:58:15.680 INFO:teuthology.orchestra.run.smithi204.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-18T09:58:15.681 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 45 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:19.0.0-1555.g1c920afa.el9 ceph 131 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-18T09:58:15.682 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-18T09:58:15.683 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-18T09:58:15.684 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-18T09:58:15.685 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-18T09:58:15.686 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================================ 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout:Install 150 Packages 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 26 Packages 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 223 M 2024-02-18T09:58:15.687 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-02-18T09:58:16.636 INFO:teuthology.orchestra.run.smithi204.stdout:(1/176): ceph-19.0.0-1555.g1c920afa.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-02-18T09:58:16.640 INFO:teuthology.orchestra.run.smithi164.stdout:(6/176): ceph-mgr-19.0.0-1555.g1c920afa.el9.x86 749 kB/s | 1.5 MB 00:02 2024-02-18T09:58:16.999 INFO:teuthology.orchestra.run.smithi164.stdout:(7/176): ceph-mon-19.0.0-1555.g1c920afa.el9.x86 2.6 MB/s | 4.7 MB 00:01 2024-02-18T09:58:17.460 INFO:teuthology.orchestra.run.smithi204.stdout:(2/176): ceph-fuse-19.0.0-1555.g1c920afa.el9.x8 1.1 MB/s | 886 kB 00:00 2024-02-18T09:58:17.568 INFO:teuthology.orchestra.run.smithi204.stdout:(3/176): ceph-immutable-object-cache-19.0.0-155 1.3 MB/s | 145 kB 00:00 2024-02-18T09:58:18.410 INFO:teuthology.orchestra.run.smithi204.stdout:(4/176): ceph-mds-19.0.0-1555.g1c920afa.el9.x86 2.5 MB/s | 2.1 MB 00:00 2024-02-18T09:58:18.811 INFO:teuthology.orchestra.run.smithi204.stdout:(5/176): ceph-base-19.0.0-1555.g1c920afa.el9.x8 2.0 MB/s | 5.3 MB 00:02 2024-02-18T09:58:18.886 INFO:teuthology.orchestra.run.smithi204.stdout:(6/176): ceph-mgr-19.0.0-1555.g1c920afa.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-02-18T09:58:20.803 INFO:teuthology.orchestra.run.smithi204.stdout:(7/176): ceph-mon-19.0.0-1555.g1c920afa.el9.x86 2.4 MB/s | 4.7 MB 00:01 2024-02-18T09:58:21.239 INFO:teuthology.orchestra.run.smithi118.stdout:(10/176): ceph-osd-19.0.0-1555.g1c920afa.el9.x8 2.1 MB/s | 17 MB 00:07 2024-02-18T09:58:21.422 INFO:teuthology.orchestra.run.smithi118.stdout:(11/176): cephfs-mirror-19.0.0-1555.g1c920afa.e 1.2 MB/s | 220 kB 00:00 2024-02-18T09:58:21.514 INFO:teuthology.orchestra.run.smithi118.stdout:(12/176): cephfs-shell-19.0.0-1555.g1c920afa.el 295 kB/s | 27 kB 00:00 2024-02-18T09:58:21.606 INFO:teuthology.orchestra.run.smithi118.stdout:(13/176): libcephfs-devel-19.0.0-1555.g1c920afa 341 kB/s | 31 kB 00:00 2024-02-18T09:58:22.173 INFO:teuthology.orchestra.run.smithi118.stdout:(14/176): libcephfs2-19.0.0-1555.g1c920afa.el9. 1.3 MB/s | 742 kB 00:00 2024-02-18T09:58:22.348 INFO:teuthology.orchestra.run.smithi118.stdout:(15/176): libcephsqlite-19.0.0-1555.g1c920afa.e 933 kB/s | 163 kB 00:00 2024-02-18T09:58:22.523 INFO:teuthology.orchestra.run.smithi118.stdout:(16/176): librados-devel-19.0.0-1555.g1c920afa. 725 kB/s | 127 kB 00:00 2024-02-18T09:58:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:(17/176): libradosstriper1-19.0.0-1555.g1c920af 1.0 MB/s | 499 kB 00:00 2024-02-18T09:58:24.861 INFO:teuthology.orchestra.run.smithi204.stdout:(8/176): ceph-osd-19.0.0-1555.g1c920afa.el9.x86 2.8 MB/s | 17 MB 00:05 2024-02-18T09:58:24.978 INFO:teuthology.orchestra.run.smithi204.stdout:(9/176): ceph-selinux-19.0.0-1555.g1c920afa.el9 218 kB/s | 25 kB 00:00 2024-02-18T09:58:25.998 INFO:teuthology.orchestra.run.smithi164.stdout:(8/176): ceph-radosgw-19.0.0-1555.g1c920afa.el9 1.1 MB/s | 9.8 MB 00:08 2024-02-18T09:58:26.057 INFO:teuthology.orchestra.run.smithi164.stdout:(9/176): ceph-selinux-19.0.0-1555.g1c920afa.el9 434 kB/s | 25 kB 00:00 2024-02-18T09:58:26.145 INFO:teuthology.orchestra.run.smithi204.stdout:(10/176): ceph-common-19.0.0-1555.g1c920afa.el9 2.0 MB/s | 20 MB 00:09 2024-02-18T09:58:26.303 INFO:teuthology.orchestra.run.smithi204.stdout:(11/176): ceph-radosgw-19.0.0-1555.g1c920afa.el 1.8 MB/s | 9.8 MB 00:05 2024-02-18T09:58:26.353 INFO:teuthology.orchestra.run.smithi204.stdout:(12/176): cephfs-mirror-19.0.0-1555.g1c920afa.e 1.0 MB/s | 220 kB 00:00 2024-02-18T09:58:26.395 INFO:teuthology.orchestra.run.smithi204.stdout:(13/176): cephfs-shell-19.0.0-1555.g1c920afa.el 297 kB/s | 27 kB 00:00 2024-02-18T09:58:26.454 INFO:teuthology.orchestra.run.smithi204.stdout:(14/176): libcephfs-devel-19.0.0-1555.g1c920afa 312 kB/s | 31 kB 00:00 2024-02-18T09:58:26.563 INFO:teuthology.orchestra.run.smithi204.stdout:(15/176): libcephsqlite-19.0.0-1555.g1c920afa.e 1.5 MB/s | 163 kB 00:00 2024-02-18T09:58:26.671 INFO:teuthology.orchestra.run.smithi204.stdout:(16/176): librados-devel-19.0.0-1555.g1c920afa. 1.2 MB/s | 127 kB 00:00 2024-02-18T09:58:26.890 INFO:teuthology.orchestra.run.smithi118.stdout:(18/176): ceph-common-19.0.0-1555.g1c920afa.el9 1.2 MB/s | 20 MB 00:15 2024-02-18T09:58:26.896 INFO:teuthology.orchestra.run.smithi204.stdout:(17/176): libcephfs2-19.0.0-1555.g1c920afa.el9. 1.4 MB/s | 742 kB 00:00 2024-02-18T09:58:26.980 INFO:teuthology.orchestra.run.smithi204.stdout:(18/176): libradosstriper1-19.0.0-1555.g1c920af 1.6 MB/s | 499 kB 00:00 2024-02-18T09:58:27.089 INFO:teuthology.orchestra.run.smithi204.stdout:(19/176): python3-ceph-argparse-19.0.0-1555.g1c 419 kB/s | 45 kB 00:00 2024-02-18T09:58:27.197 INFO:teuthology.orchestra.run.smithi204.stdout:(20/176): python3-ceph-common-19.0.0-1555.g1c92 1.2 MB/s | 131 kB 00:00 2024-02-18T09:58:27.306 INFO:teuthology.orchestra.run.smithi204.stdout:(21/176): python3-cephfs-19.0.0-1555.g1c920afa. 1.5 MB/s | 161 kB 00:00 2024-02-18T09:58:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:(19/176): librgw2-19.0.0-1555.g1c920afa.el9.x86 1.2 MB/s | 5.1 MB 00:04 2024-02-18T09:58:27.366 INFO:teuthology.orchestra.run.smithi118.stdout:(20/176): python3-ceph-argparse-19.0.0-1555.g1c 95 kB/s | 45 kB 00:00 2024-02-18T09:58:27.506 INFO:teuthology.orchestra.run.smithi204.stdout:(22/176): python3-rados-19.0.0-1555.g1c920afa.e 1.6 MB/s | 320 kB 00:00 2024-02-18T09:58:27.674 INFO:teuthology.orchestra.run.smithi118.stdout:(21/176): python3-ceph-common-19.0.0-1555.g1c92 394 kB/s | 131 kB 00:00 2024-02-18T09:58:27.698 INFO:teuthology.orchestra.run.smithi204.stdout:(23/176): python3-rbd-19.0.0-1555.g1c920afa.el9 1.5 MB/s | 298 kB 00:00 2024-02-18T09:58:27.699 INFO:teuthology.orchestra.run.smithi118.stdout:(22/176): python3-cephfs-19.0.0-1555.g1c920afa. 484 kB/s | 161 kB 00:00 2024-02-18T09:58:27.732 INFO:teuthology.orchestra.run.smithi164.stdout:(10/176): ceph-common-19.0.0-1555.g1c920afa.el9 1.3 MB/s | 20 MB 00:15 2024-02-18T09:58:27.774 INFO:teuthology.orchestra.run.smithi204.stdout:(24/176): python3-rgw-19.0.0-1555.g1c920afa.el9 1.3 MB/s | 99 kB 00:00 2024-02-18T09:58:27.850 INFO:teuthology.orchestra.run.smithi118.stdout:(23/176): python3-rados-19.0.0-1555.g1c920afa.e 1.8 MB/s | 320 kB 00:00 2024-02-18T09:58:27.890 INFO:teuthology.orchestra.run.smithi204.stdout:(25/176): rbd-fuse-19.0.0-1555.g1c920afa.el9.x8 735 kB/s | 85 kB 00:00 2024-02-18T09:58:27.915 INFO:teuthology.orchestra.run.smithi164.stdout:(11/176): cephfs-mirror-19.0.0-1555.g1c920afa.e 1.2 MB/s | 220 kB 00:00 2024-02-18T09:58:27.934 INFO:teuthology.orchestra.run.smithi118.stdout:(24/176): python3-rgw-19.0.0-1555.g1c920afa.el9 1.2 MB/s | 99 kB 00:00 2024-02-18T09:58:27.999 INFO:teuthology.orchestra.run.smithi164.stdout:(12/176): cephfs-shell-19.0.0-1555.g1c920afa.el 324 kB/s | 27 kB 00:00 2024-02-18T09:58:28.017 INFO:teuthology.orchestra.run.smithi118.stdout:(25/176): python3-rbd-19.0.0-1555.g1c920afa.el9 939 kB/s | 298 kB 00:00 2024-02-18T09:58:28.042 INFO:teuthology.orchestra.run.smithi118.stdout:(26/176): rbd-fuse-19.0.0-1555.g1c920afa.el9.x8 788 kB/s | 85 kB 00:00 2024-02-18T09:58:28.074 INFO:teuthology.orchestra.run.smithi164.stdout:(13/176): libcephfs-devel-19.0.0-1555.g1c920afa 415 kB/s | 31 kB 00:00 2024-02-18T09:58:28.193 INFO:teuthology.orchestra.run.smithi118.stdout:(27/176): rbd-nbd-19.0.0-1555.g1c920afa.el9.x86 1.1 MB/s | 171 kB 00:00 2024-02-18T09:58:28.310 INFO:teuthology.orchestra.run.smithi118.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1555.g 269 kB/s | 31 kB 00:00 2024-02-18T09:58:28.485 INFO:teuthology.orchestra.run.smithi118.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1555.g1c920af 789 kB/s | 138 kB 00:00 2024-02-18T09:58:28.541 INFO:teuthology.orchestra.run.smithi164.stdout:(14/176): libcephfs2-19.0.0-1555.g1c920afa.el9. 1.6 MB/s | 742 kB 00:00 2024-02-18T09:58:28.708 INFO:teuthology.orchestra.run.smithi164.stdout:(15/176): libcephsqlite-19.0.0-1555.g1c920afa.e 980 kB/s | 163 kB 00:00 2024-02-18T09:58:28.808 INFO:teuthology.orchestra.run.smithi164.stdout:(16/176): librados-devel-19.0.0-1555.g1c920afa. 1.2 MB/s | 127 kB 00:00 2024-02-18T09:58:29.100 INFO:teuthology.orchestra.run.smithi164.stdout:(17/176): libradosstriper1-19.0.0-1555.g1c920af 1.7 MB/s | 499 kB 00:00 2024-02-18T09:58:29.157 INFO:teuthology.orchestra.run.smithi204.stdout:(26/176): rbd-mirror-19.0.0-1555.g1c920afa.el9. 2.4 MB/s | 3.1 MB 00:01 2024-02-18T09:58:29.219 INFO:teuthology.orchestra.run.smithi118.stdout:(30/176): ceph-test-19.0.0-1555.g1c920afa.el9.x 3.4 MB/s | 47 MB 00:13 2024-02-18T09:58:29.274 INFO:teuthology.orchestra.run.smithi204.stdout:(27/176): rbd-nbd-19.0.0-1555.g1c920afa.el9.x86 1.4 MB/s | 171 kB 00:00 2024-02-18T09:58:29.383 INFO:teuthology.orchestra.run.smithi204.stdout:(28/176): librgw2-19.0.0-1555.g1c920afa.el9.x86 2.1 MB/s | 5.1 MB 00:02 2024-02-18T09:58:29.408 INFO:teuthology.orchestra.run.smithi204.stdout:(29/176): ceph-grafana-dashboards-19.0.0-1555.g 237 kB/s | 31 kB 00:00 2024-02-18T09:58:29.501 INFO:teuthology.orchestra.run.smithi204.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1555.g1c920af 1.2 MB/s | 138 kB 00:00 2024-02-18T09:58:29.644 INFO:teuthology.orchestra.run.smithi118.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1555.g1c920 1.5 MB/s | 1.8 MB 00:01 2024-02-18T09:58:30.027 INFO:teuthology.orchestra.run.smithi118.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1555.g1c 647 kB/s | 248 kB 00:00 2024-02-18T09:58:30.119 INFO:teuthology.orchestra.run.smithi118.stdout:(33/176): ceph-mgr-rook-19.0.0-1555.g1c920afa.e 570 kB/s | 52 kB 00:00 2024-02-18T09:58:30.212 INFO:teuthology.orchestra.run.smithi118.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1555.g1 167 kB/s | 15 kB 00:00 2024-02-18T09:58:30.276 INFO:teuthology.orchestra.run.smithi204.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1555.g1c920 2.1 MB/s | 1.8 MB 00:00 2024-02-18T09:58:30.529 INFO:teuthology.orchestra.run.smithi118.stdout:(35/176): ceph-volume-19.0.0-1555.g1c920afa.el9 832 kB/s | 264 kB 00:00 2024-02-18T09:58:30.576 INFO:teuthology.orchestra.run.smithi204.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1555.g1c 828 kB/s | 248 kB 00:00 2024-02-18T09:58:30.693 INFO:teuthology.orchestra.run.smithi204.stdout:(33/176): ceph-mgr-rook-19.0.0-1555.g1c920afa.e 451 kB/s | 52 kB 00:00 2024-02-18T09:58:30.802 INFO:teuthology.orchestra.run.smithi204.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1555.g1 142 kB/s | 15 kB 00:00 2024-02-18T09:58:31.002 INFO:teuthology.orchestra.run.smithi204.stdout:(35/176): ceph-volume-19.0.0-1555.g1c920afa.el9 1.3 MB/s | 264 kB 00:00 2024-02-18T09:58:31.304 INFO:teuthology.orchestra.run.smithi118.stdout:(36/176): cephadm-19.0.0-1555.g1c920afa.el9.noa 966 kB/s | 748 kB 00:00 2024-02-18T09:58:31.387 INFO:teuthology.orchestra.run.smithi118.stdout:(37/176): cephfs-top-19.0.0-1555.g1c920afa.el9. 219 kB/s | 18 kB 00:00 2024-02-18T09:58:31.492 INFO:teuthology.orchestra.run.smithi164.stdout:(18/176): librgw2-19.0.0-1555.g1c920afa.el9.x86 2.1 MB/s | 5.1 MB 00:02 2024-02-18T09:58:31.504 INFO:teuthology.orchestra.run.smithi118.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 5.5 MB/s | 662 kB 00:00 2024-02-18T09:58:31.546 INFO:teuthology.orchestra.run.smithi118.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 22 MB/s | 920 kB 00:00 2024-02-18T09:58:31.567 INFO:teuthology.orchestra.run.smithi164.stdout:(19/176): python3-ceph-argparse-19.0.0-1555.g1c 604 kB/s | 45 kB 00:00 2024-02-18T09:58:31.580 INFO:teuthology.orchestra.run.smithi118.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-02-18T09:58:31.614 INFO:teuthology.orchestra.run.smithi118.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 615 kB/s | 20 kB 00:00 2024-02-18T09:58:31.644 INFO:teuthology.orchestra.run.smithi204.stdout:(36/176): cephadm-19.0.0-1555.g1c920afa.el9.noa 1.1 MB/s | 748 kB 00:00 2024-02-18T09:58:31.647 INFO:teuthology.orchestra.run.smithi118.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 9.1 MB/s | 307 kB 00:00 2024-02-18T09:58:31.650 INFO:teuthology.orchestra.run.smithi164.stdout:(20/176): python3-ceph-common-19.0.0-1555.g1c92 1.5 MB/s | 131 kB 00:00 2024-02-18T09:58:31.681 INFO:teuthology.orchestra.run.smithi118.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 955 kB/s | 32 kB 00:00 2024-02-18T09:58:31.744 INFO:teuthology.orchestra.run.smithi204.stdout:(37/176): cephfs-top-19.0.0-1555.g1c920afa.el9. 184 kB/s | 18 kB 00:00 2024-02-18T09:58:31.756 INFO:teuthology.orchestra.run.smithi118.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2024-02-18T09:58:31.790 INFO:teuthology.orchestra.run.smithi118.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 514 kB/s | 17 kB 00:00 2024-02-18T09:58:31.801 INFO:teuthology.orchestra.run.smithi164.stdout:(21/176): python3-cephfs-19.0.0-1555.g1c920afa. 1.1 MB/s | 161 kB 00:00 2024-02-18T09:58:31.823 INFO:teuthology.orchestra.run.smithi118.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2024-02-18T09:58:31.857 INFO:teuthology.orchestra.run.smithi118.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-02-18T09:58:31.916 INFO:teuthology.orchestra.run.smithi118.stdout:(48/176): rbd-mirror-19.0.0-1555.g1c920afa.el9. 811 kB/s | 3.1 MB 00:03 2024-02-18T09:58:31.919 INFO:teuthology.orchestra.run.smithi204.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2024-02-18T09:58:31.933 INFO:teuthology.orchestra.run.smithi118.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-02-18T09:58:31.958 INFO:teuthology.orchestra.run.smithi118.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2024-02-18T09:58:31.983 INFO:teuthology.orchestra.run.smithi118.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-02-18T09:58:31.984 INFO:teuthology.orchestra.run.smithi164.stdout:(22/176): python3-rados-19.0.0-1555.g1c920afa.e 1.7 MB/s | 320 kB 00:00 2024-02-18T09:58:32.009 INFO:teuthology.orchestra.run.smithi118.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 495 kB/s | 24 kB 00:00 2024-02-18T09:58:32.020 INFO:teuthology.orchestra.run.smithi204.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 9.1 MB/s | 920 kB 00:00 2024-02-18T09:58:32.034 INFO:teuthology.orchestra.run.smithi118.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 923 kB/s | 46 kB 00:00 2024-02-18T09:58:32.059 INFO:teuthology.orchestra.run.smithi118.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-02-18T09:58:32.061 INFO:teuthology.orchestra.run.smithi204.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-02-18T09:58:32.085 INFO:teuthology.orchestra.run.smithi118.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-02-18T09:58:32.095 INFO:teuthology.orchestra.run.smithi204.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 619 kB/s | 20 kB 00:00 2024-02-18T09:58:32.110 INFO:teuthology.orchestra.run.smithi118.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 684 kB/s | 34 kB 00:00 2024-02-18T09:58:32.126 INFO:teuthology.orchestra.run.smithi164.stdout:(23/176): python3-rbd-19.0.0-1555.g1c920afa.el9 2.1 MB/s | 298 kB 00:00 2024-02-18T09:58:32.137 INFO:teuthology.orchestra.run.smithi204.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2024-02-18T09:58:32.171 INFO:teuthology.orchestra.run.smithi204.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 966 kB/s | 32 kB 00:00 2024-02-18T09:58:32.202 INFO:teuthology.orchestra.run.smithi164.stdout:(24/176): python3-rgw-19.0.0-1555.g1c920afa.el9 1.3 MB/s | 99 kB 00:00 2024-02-18T09:58:32.202 INFO:teuthology.orchestra.run.smithi118.stdout:(57/176): ceph-mgr-diskprediction-local-19.0.0- 2.5 MB/s | 7.4 MB 00:02 2024-02-18T09:58:32.271 INFO:teuthology.orchestra.run.smithi204.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-02-18T09:58:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:(25/176): rbd-fuse-19.0.0-1555.g1c920afa.el9.x8 1.1 MB/s | 85 kB 00:00 2024-02-18T09:58:32.286 INFO:teuthology.orchestra.run.smithi118.stdout:(58/176): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-02-18T09:58:32.305 INFO:teuthology.orchestra.run.smithi204.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 527 kB/s | 17 kB 00:00 2024-02-18T09:58:32.330 INFO:teuthology.orchestra.run.smithi204.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 418 kB/s | 10 kB 00:00 2024-02-18T09:58:32.364 INFO:teuthology.orchestra.run.smithi204.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.8 MB/s | 159 kB 00:00 2024-02-18T09:58:32.383 INFO:teuthology.orchestra.run.smithi118.stdout:(59/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-02-18T09:58:32.389 INFO:teuthology.orchestra.run.smithi204.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 44 kB 00:00 2024-02-18T09:58:32.428 INFO:teuthology.orchestra.run.smithi118.stdout:(60/176): postgresql-13.11-1.el9.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2024-02-18T09:58:32.448 INFO:teuthology.orchestra.run.smithi204.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-02-18T09:58:32.461 INFO:teuthology.orchestra.run.smithi118.stdout:(61/176): postgresql-contrib-13.11-1.el9.x86_64 4.6 MB/s | 811 kB 00:00 2024-02-18T09:58:32.487 INFO:teuthology.orchestra.run.smithi118.stdout:(62/176): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-02-18T09:58:32.498 INFO:teuthology.orchestra.run.smithi204.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-02-18T09:58:32.520 INFO:teuthology.orchestra.run.smithi118.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-02-18T09:58:32.532 INFO:teuthology.orchestra.run.smithi204.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 747 kB/s | 24 kB 00:00 2024-02-18T09:58:32.565 INFO:teuthology.orchestra.run.smithi204.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-02-18T09:58:32.607 INFO:teuthology.orchestra.run.smithi204.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 282 kB 00:00 2024-02-18T09:58:32.612 INFO:teuthology.orchestra.run.smithi118.stdout:(64/176): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2024-02-18T09:58:32.629 INFO:teuthology.orchestra.run.smithi118.stdout:(65/176): python3-attrs-20.3.0-7.el9.noarch.rpm 549 kB/s | 78 kB 00:00 2024-02-18T09:58:32.649 INFO:teuthology.orchestra.run.smithi204.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-02-18T09:58:32.683 INFO:teuthology.orchestra.run.smithi204.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-02-18T09:58:32.713 INFO:teuthology.orchestra.run.smithi118.stdout:(66/176): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-02-18T09:58:32.738 INFO:teuthology.orchestra.run.smithi118.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 231 kB/s | 24 kB 00:00 2024-02-18T09:58:32.764 INFO:teuthology.orchestra.run.smithi118.stdout:(68/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 227 kB 00:00 2024-02-18T09:58:32.780 INFO:teuthology.orchestra.run.smithi118.stdout:(69/176): python3-jsonpointer-2.0-4.el9.noarch. 271 kB/s | 18 kB 00:00 2024-02-18T09:58:32.806 INFO:teuthology.orchestra.run.smithi118.stdout:(70/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-02-18T09:58:32.825 INFO:teuthology.orchestra.run.smithi204.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2024-02-18T09:58:32.889 INFO:teuthology.orchestra.run.smithi118.stdout:(71/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 4.8 MB 00:00 2024-02-18T09:58:32.906 INFO:teuthology.orchestra.run.smithi118.stdout:(72/176): python3-markupsafe-1.1.1-12.el9.x86_6 252 kB/s | 32 kB 00:00 2024-02-18T09:58:32.931 INFO:teuthology.orchestra.run.smithi118.stdout:(73/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-02-18T09:58:32.942 INFO:teuthology.orchestra.run.smithi204.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-02-18T09:58:32.956 INFO:teuthology.orchestra.run.smithi118.stdout:(74/176): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-02-18T09:58:32.974 INFO:teuthology.orchestra.run.smithi118.stdout:(75/176): python3-prettytable-0.7.2-27.el9.noar 993 kB/s | 41 kB 00:00 2024-02-18T09:58:33.007 INFO:teuthology.orchestra.run.smithi118.stdout:(76/176): python3-packaging-20.9-5.el9.noarch.r 915 kB/s | 69 kB 00:00 2024-02-18T09:58:33.032 INFO:teuthology.orchestra.run.smithi118.stdout:(77/176): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-02-18T09:58:33.044 INFO:teuthology.orchestra.run.smithi164.stdout:(26/176): rbd-mirror-19.0.0-1555.g1c920afa.el9. 4.0 MB/s | 3.1 MB 00:00 2024-02-18T09:58:33.057 INFO:teuthology.orchestra.run.smithi118.stdout:(78/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2024-02-18T09:58:33.083 INFO:teuthology.orchestra.run.smithi118.stdout:(79/176): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-02-18T09:58:33.094 INFO:teuthology.orchestra.run.smithi164.stdout:(27/176): rbd-nbd-19.0.0-1555.g1c920afa.el9.x86 3.4 MB/s | 171 kB 00:00 2024-02-18T09:58:33.099 INFO:teuthology.orchestra.run.smithi118.stdout:(80/176): python3-pytz-2021.1-5.el9.noarch.rpm 710 kB/s | 47 kB 00:00 2024-02-18T09:58:33.101 INFO:teuthology.orchestra.run.smithi204.stdout:(58/176): ceph-mgr-diskprediction-local-19.0.0- 2.1 MB/s | 7.4 MB 00:03 2024-02-18T09:58:33.117 INFO:teuthology.orchestra.run.smithi118.stdout:(81/176): python3-requests-oauthlib-1.3.0-12.el 733 kB/s | 43 kB 00:00 2024-02-18T09:58:33.144 INFO:teuthology.orchestra.run.smithi164.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1555.g 628 kB/s | 31 kB 00:00 2024-02-18T09:58:33.159 INFO:teuthology.orchestra.run.smithi204.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 7.0 MB/s | 1.5 MB 00:00 2024-02-18T09:58:33.167 INFO:teuthology.orchestra.run.smithi118.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 579 kB/s | 39 kB 00:00 2024-02-18T09:58:33.203 INFO:teuthology.orchestra.run.smithi164.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1555.g1c920af 2.3 MB/s | 138 kB 00:00 2024-02-18T09:58:33.210 INFO:teuthology.orchestra.run.smithi204.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 8.4 MB/s | 811 kB 00:00 2024-02-18T09:58:33.225 INFO:teuthology.orchestra.run.smithi118.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 390 kB/s | 41 kB 00:00 2024-02-18T09:58:33.227 INFO:teuthology.orchestra.run.smithi204.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2024-02-18T09:58:33.369 INFO:teuthology.orchestra.run.smithi204.stdout:(62/176): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-02-18T09:58:33.392 INFO:teuthology.orchestra.run.smithi118.stdout:(84/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 54 MB/s | 16 MB 00:00 2024-02-18T09:58:33.411 INFO:teuthology.orchestra.run.smithi204.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-02-18T09:58:33.416 INFO:teuthology.orchestra.run.smithi118.stdout:(85/176): qatlib-23.11.0-1.el9.x86_64.rpm 874 kB/s | 215 kB 00:00 2024-02-18T09:58:33.434 INFO:teuthology.orchestra.run.smithi118.stdout:(86/176): qatlib-service-23.11.0-1.el9.x86_64.r 164 kB/s | 34 kB 00:00 2024-02-18T09:58:33.450 INFO:teuthology.orchestra.run.smithi118.stdout:(87/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 747 kB/s | 43 kB 00:00 2024-02-18T09:58:33.461 INFO:teuthology.orchestra.run.smithi204.stdout:(64/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.6 MB/s | 78 kB 00:00 2024-02-18T09:58:33.586 INFO:teuthology.orchestra.run.smithi204.stdout:(65/176): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-02-18T09:58:33.603 INFO:teuthology.orchestra.run.smithi164.stdout:(30/176): ceph-mgr-dashboard-19.0.0-1555.g1c920 4.5 MB/s | 1.8 MB 00:00 2024-02-18T09:58:33.611 INFO:teuthology.orchestra.run.smithi204.stdout:(66/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 227 kB 00:00 2024-02-18T09:58:33.645 INFO:teuthology.orchestra.run.smithi204.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 759 kB/s | 24 kB 00:00 2024-02-18T09:58:33.670 INFO:teuthology.orchestra.run.smithi204.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 317 kB/s | 18 kB 00:00 2024-02-18T09:58:33.712 INFO:teuthology.orchestra.run.smithi204.stdout:(69/176): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2024-02-18T09:58:33.737 INFO:teuthology.orchestra.run.smithi204.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 482 kB/s | 32 kB 00:00 2024-02-18T09:58:33.779 INFO:teuthology.orchestra.run.smithi204.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.3 MB/s | 217 kB 00:00 2024-02-18T09:58:33.893 INFO:teuthology.orchestra.run.smithi118.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 123 kB/s | 56 kB 00:00 2024-02-18T09:58:33.904 INFO:teuthology.orchestra.run.smithi204.stdout:(72/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-02-18T09:58:33.921 INFO:teuthology.orchestra.run.smithi204.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2024-02-18T09:58:33.963 INFO:teuthology.orchestra.run.smithi204.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-02-18T09:58:33.989 INFO:teuthology.orchestra.run.smithi204.stdout:(75/176): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-02-18T09:58:34.040 INFO:teuthology.orchestra.run.smithi204.stdout:(76/176): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-02-18T09:58:34.072 INFO:teuthology.orchestra.run.smithi204.stdout:(77/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2024-02-18T09:58:34.106 INFO:teuthology.orchestra.run.smithi204.stdout:(78/176): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 211 kB 00:00 2024-02-18T09:58:34.131 INFO:teuthology.orchestra.run.smithi204.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 845 kB/s | 47 kB 00:00 2024-02-18T09:58:34.157 INFO:teuthology.orchestra.run.smithi204.stdout:(80/176): python3-requests-oauthlib-1.3.0-12.el 869 kB/s | 43 kB 00:00 2024-02-18T09:58:34.168 INFO:teuthology.orchestra.run.smithi118.stdout:(89/176): socat-1.7.4.1-5.el9.x86_64.rpm 408 kB/s | 300 kB 00:00 2024-02-18T09:58:34.235 INFO:teuthology.orchestra.run.smithi118.stdout:(90/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 111 kB/s | 87 kB 00:00 2024-02-18T09:58:34.294 INFO:teuthology.orchestra.run.smithi118.stdout:(91/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 156 kB/s | 63 kB 00:00 2024-02-18T09:58:34.310 INFO:teuthology.orchestra.run.smithi118.stdout:(92/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-02-18T09:58:34.336 INFO:teuthology.orchestra.run.smithi118.stdout:(93/176): fuse-2.9.9-15.el9.x86_64.rpm 786 kB/s | 79 kB 00:00 2024-02-18T09:58:34.361 INFO:teuthology.orchestra.run.smithi118.stdout:(94/176): jq-1.6-16.el9.x86_64.rpm 2.7 MB/s | 186 kB 00:00 2024-02-18T09:58:34.432 INFO:teuthology.orchestra.run.smithi204.stdout:(81/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 52 MB/s | 16 MB 00:00 2024-02-18T09:58:34.457 INFO:teuthology.orchestra.run.smithi204.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 137 kB/s | 39 kB 00:00 2024-02-18T09:58:34.499 INFO:teuthology.orchestra.run.smithi204.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 41 kB 00:00 2024-02-18T09:58:34.528 INFO:teuthology.orchestra.run.smithi118.stdout:(95/176): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 802 kB 00:00 2024-02-18T09:58:34.553 INFO:teuthology.orchestra.run.smithi118.stdout:(96/176): libquadmath-11.4.1-3.el9.x86_64.rpm 896 kB/s | 194 kB 00:00 2024-02-18T09:58:34.578 INFO:teuthology.orchestra.run.smithi118.stdout:(97/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 999 kB/s | 217 kB 00:00 2024-02-18T09:58:34.604 INFO:teuthology.orchestra.run.smithi118.stdout:(98/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-02-18T09:58:34.611 INFO:teuthology.orchestra.run.smithi204.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 1.4 MB/s | 215 kB 00:00 2024-02-18T09:58:34.666 INFO:teuthology.orchestra.run.smithi204.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 648 kB/s | 34 kB 00:00 2024-02-18T09:58:34.692 INFO:teuthology.orchestra.run.smithi204.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 564 kB/s | 43 kB 00:00 2024-02-18T09:58:34.696 INFO:teuthology.orchestra.run.smithi118.stdout:(99/176): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.1 MB 00:00 2024-02-18T09:58:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:(100/176): python3-ply-3.11-14.el9.noarch.rpm 726 kB/s | 103 kB 00:00 2024-02-18T09:58:34.725 INFO:teuthology.orchestra.run.smithi204.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-02-18T09:58:34.746 INFO:teuthology.orchestra.run.smithi118.stdout:(101/176): python3-pycparser-2.20-6.el9.noarch. 876 kB/s | 124 kB 00:00 2024-02-18T09:58:34.759 INFO:teuthology.orchestra.run.smithi204.stdout:(88/176): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2024-02-18T09:58:34.772 INFO:teuthology.orchestra.run.smithi118.stdout:(102/176): python3-requests-2.25.1-8.el9.noarch 1.5 MB/s | 113 kB 00:00 2024-02-18T09:58:34.784 INFO:teuthology.orchestra.run.smithi204.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-02-18T09:58:34.797 INFO:teuthology.orchestra.run.smithi118.stdout:(103/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-02-18T09:58:34.809 INFO:teuthology.orchestra.run.smithi204.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-02-18T09:58:34.835 INFO:teuthology.orchestra.run.smithi204.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 900 kB/s | 44 kB 00:00 2024-02-18T09:58:34.860 INFO:teuthology.orchestra.run.smithi204.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-02-18T09:58:34.880 INFO:teuthology.orchestra.run.smithi118.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-02-18T09:58:34.894 INFO:teuthology.orchestra.run.smithi204.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2024-02-18T09:58:34.936 INFO:teuthology.orchestra.run.smithi204.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 11 MB/s | 802 kB 00:00 2024-02-18T09:58:34.961 INFO:teuthology.orchestra.run.smithi204.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 194 kB 00:00 2024-02-18T09:58:34.981 INFO:teuthology.orchestra.run.smithi118.stdout:(105/176): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-02-18T09:58:34.994 INFO:teuthology.orchestra.run.smithi204.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2024-02-18T09:58:35.020 INFO:teuthology.orchestra.run.smithi204.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 241 kB 00:00 2024-02-18T09:58:35.073 INFO:teuthology.orchestra.run.smithi118.stdout:(106/176): python3-devel-3.9.17-2.el9.x86_64.rp 753 kB/s | 245 kB 00:00 2024-02-18T09:58:35.078 INFO:teuthology.orchestra.run.smithi204.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-02-18T09:58:35.095 INFO:teuthology.orchestra.run.smithi164.stdout:(31/176): ceph-osd-19.0.0-1555.g1c920afa.el9.x8 931 kB/s | 17 MB 00:18 2024-02-18T09:58:35.104 INFO:teuthology.orchestra.run.smithi204.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-02-18T09:58:35.121 INFO:teuthology.orchestra.run.smithi204.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 3.0 MB/s | 124 kB 00:00 2024-02-18T09:58:35.146 INFO:teuthology.orchestra.run.smithi204.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 2.8 MB/s | 113 kB 00:00 2024-02-18T09:58:35.171 INFO:teuthology.orchestra.run.smithi204.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.8 MB/s | 187 kB 00:00 2024-02-18T09:58:35.187 INFO:teuthology.orchestra.run.smithi164.stdout:(32/176): ceph-mgr-diskprediction-local-19.0.0- 4.7 MB/s | 7.4 MB 00:01 2024-02-18T09:58:35.230 INFO:teuthology.orchestra.run.smithi204.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 388 kB/s | 22 kB 00:00 2024-02-18T09:58:35.246 INFO:teuthology.orchestra.run.smithi164.stdout:(33/176): ceph-mgr-rook-19.0.0-1555.g1c920afa.e 897 kB/s | 52 kB 00:00 2024-02-18T09:58:35.271 INFO:teuthology.orchestra.run.smithi164.stdout:(34/176): ceph-mgr-modules-core-19.0.0-1555.g1c 1.4 MB/s | 248 kB 00:00 2024-02-18T09:58:35.297 INFO:teuthology.orchestra.run.smithi164.stdout:(35/176): ceph-prometheus-alerts-19.0.0-1555.g1 306 kB/s | 15 kB 00:00 2024-02-18T09:58:35.306 INFO:teuthology.orchestra.run.smithi118.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-02-18T09:58:35.322 INFO:teuthology.orchestra.run.smithi204.stdout:(104/176): python3-devel-3.9.17-2.el9.x86_64.rp 1.4 MB/s | 245 kB 00:00 2024-02-18T09:58:35.372 INFO:teuthology.orchestra.run.smithi204.stdout:(105/176): protobuf-compiler-3.14.0-13.el9.x86_ 6.0 MB/s | 863 kB 00:00 2024-02-18T09:58:35.397 INFO:teuthology.orchestra.run.smithi164.stdout:(36/176): ceph-volume-19.0.0-1555.g1c920afa.el9 2.1 MB/s | 264 kB 00:00 2024-02-18T09:58:35.472 INFO:teuthology.orchestra.run.smithi164.stdout:(37/176): cephfs-top-19.0.0-1555.g1c920afa.el9. 244 kB/s | 18 kB 00:00 2024-02-18T09:58:35.505 INFO:teuthology.orchestra.run.smithi164.stdout:(38/176): cephadm-19.0.0-1555.g1c920afa.el9.noa 3.5 MB/s | 748 kB 00:00 2024-02-18T09:58:35.540 INFO:teuthology.orchestra.run.smithi118.stdout:(108/176): abseil-cpp-20211102.0-3.el9.x86_64.r 831 kB/s | 548 kB 00:00 2024-02-18T09:58:35.566 INFO:teuthology.orchestra.run.smithi118.stdout:(109/176): gperftools-libs-2.9.1-2.el9.x86_64.r 528 kB/s | 309 kB 00:00 2024-02-18T09:58:35.639 INFO:teuthology.orchestra.run.smithi164.stdout:(39/176): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 662 kB 00:00 2024-02-18T09:58:35.641 INFO:teuthology.orchestra.run.smithi118.stdout:(110/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 258 kB/s | 26 kB 00:00 2024-02-18T09:58:35.681 INFO:teuthology.orchestra.run.smithi164.stdout:(40/176): bison-3.7.4-5.el9.x86_64.rpm 5.1 MB/s | 920 kB 00:00 2024-02-18T09:58:35.698 INFO:teuthology.orchestra.run.smithi164.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-02-18T09:58:35.723 INFO:teuthology.orchestra.run.smithi164.stdout:(42/176): elfutils-libelf-devel-0.190-2.el9.x86 488 kB/s | 20 kB 00:00 2024-02-18T09:58:35.741 INFO:teuthology.orchestra.run.smithi118.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 675 kB/s | 67 kB 00:00 2024-02-18T09:58:35.748 INFO:teuthology.orchestra.run.smithi164.stdout:(43/176): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-02-18T09:58:35.764 INFO:teuthology.orchestra.run.smithi204.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 790 kB/s | 309 kB 00:00 2024-02-18T09:58:35.773 INFO:teuthology.orchestra.run.smithi164.stdout:(44/176): flexiblas-3.0.4-8.el9.x86_64.rpm 638 kB/s | 32 kB 00:00 2024-02-18T09:58:35.798 INFO:teuthology.orchestra.run.smithi204.stdout:(107/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-02-18T09:58:35.823 INFO:teuthology.orchestra.run.smithi204.stdout:(108/176): grpc-data-1.46.7-10.el9.noarch.rpm 337 kB/s | 19 kB 00:00 2024-02-18T09:58:35.841 INFO:teuthology.orchestra.run.smithi164.stdout:(45/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-02-18T09:58:35.841 INFO:teuthology.orchestra.run.smithi118.stdout:(112/176): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-02-18T09:58:35.866 INFO:teuthology.orchestra.run.smithi164.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 190 kB/s | 17 kB 00:00 2024-02-18T09:58:35.899 INFO:teuthology.orchestra.run.smithi204.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 349 kB/s | 26 kB 00:00 2024-02-18T09:58:35.899 INFO:teuthology.orchestra.run.smithi164.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2024-02-18T09:58:35.900 INFO:teuthology.orchestra.run.smithi118.stdout:(113/176): liboath-2.6.7-2.el9.x86_64.rpm 145 kB/s | 49 kB 00:00 2024-02-18T09:58:35.925 INFO:teuthology.orchestra.run.smithi164.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-02-18T09:58:35.950 INFO:teuthology.orchestra.run.smithi164.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-02-18T09:58:36.015 INFO:teuthology.orchestra.run.smithi204.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 419 kB/s | 49 kB 00:00 2024-02-18T09:58:36.051 INFO:teuthology.orchestra.run.smithi118.stdout:(114/176): libarrow-9.0.0-10.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-02-18T09:58:36.051 INFO:teuthology.orchestra.run.smithi164.stdout:(50/176): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 661 kB 00:00 2024-02-18T09:58:36.117 INFO:teuthology.orchestra.run.smithi118.stdout:(115/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-02-18T09:58:36.142 INFO:teuthology.orchestra.run.smithi118.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-02-18T09:58:36.157 INFO:teuthology.orchestra.run.smithi204.stdout:(111/176): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-02-18T09:58:36.208 INFO:teuthology.orchestra.run.smithi204.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 352 kB/s | 67 kB 00:00 2024-02-18T09:58:36.209 INFO:teuthology.orchestra.run.smithi118.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 349 kB/s | 32 kB 00:00 2024-02-18T09:58:36.228 INFO:teuthology.orchestra.run.smithi164.stdout:(51/176): libtool-2.4.6-45.el9.x86_64.rpm 2.0 MB/s | 578 kB 00:00 2024-02-18T09:58:36.235 INFO:teuthology.orchestra.run.smithi118.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-02-18T09:58:36.253 INFO:teuthology.orchestra.run.smithi164.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 121 kB/s | 24 kB 00:00 2024-02-18T09:58:36.258 INFO:teuthology.orchestra.run.smithi204.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-02-18T09:58:36.279 INFO:teuthology.orchestra.run.smithi164.stdout:(53/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 926 kB/s | 46 kB 00:00 2024-02-18T09:58:36.302 INFO:teuthology.orchestra.run.smithi118.stdout:(119/176): python3-asyncssh-2.13.2-4.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-02-18T09:58:36.304 INFO:teuthology.orchestra.run.smithi164.stdout:(54/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-02-18T09:58:36.327 INFO:teuthology.orchestra.run.smithi118.stdout:(120/176): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-02-18T09:58:36.329 INFO:teuthology.orchestra.run.smithi164.stdout:(55/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-02-18T09:58:36.352 INFO:teuthology.orchestra.run.smithi118.stdout:(121/176): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-02-18T09:58:36.355 INFO:teuthology.orchestra.run.smithi164.stdout:(56/176): openblas-0.3.21-2.el9.x86_64.rpm 684 kB/s | 34 kB 00:00 2024-02-18T09:58:36.384 INFO:teuthology.orchestra.run.smithi204.stdout:(114/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2024-02-18T09:58:36.411 INFO:teuthology.orchestra.run.smithi118.stdout:(122/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-02-18T09:58:36.428 INFO:teuthology.orchestra.run.smithi118.stdout:(123/176): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-02-18T09:58:36.431 INFO:teuthology.orchestra.run.smithi164.stdout:(57/176): openblas-openmp-0.3.21-2.el9.x86_64.r 47 MB/s | 4.7 MB 00:00 2024-02-18T09:58:36.443 INFO:teuthology.orchestra.run.smithi204.stdout:(115/176): python3-asyncssh-2.13.2-4.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-02-18T09:58:36.453 INFO:teuthology.orchestra.run.smithi118.stdout:(124/176): python3-google-auth-2.27.0-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-02-18T09:58:36.459 INFO:teuthology.orchestra.run.smithi204.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 582 kB/s | 43 kB 00:00 2024-02-18T09:58:36.489 INFO:teuthology.orchestra.run.smithi164.stdout:(58/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 23 MB/s | 3.0 MB 00:00 2024-02-18T09:58:36.501 INFO:teuthology.orchestra.run.smithi204.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 558 kB/s | 32 kB 00:00 2024-02-18T09:58:36.518 INFO:teuthology.orchestra.run.smithi204.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 258 kB/s | 15 kB 00:00 2024-02-18T09:58:36.531 INFO:teuthology.orchestra.run.smithi164.stdout:(59/176): postgresql-13.11-1.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2024-02-18T09:58:36.537 INFO:teuthology.orchestra.run.smithi118.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-02-18T09:58:36.562 INFO:teuthology.orchestra.run.smithi118.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-02-18T09:58:36.564 INFO:teuthology.orchestra.run.smithi164.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-02-18T09:58:36.585 INFO:teuthology.orchestra.run.smithi204.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-02-18T09:58:36.589 INFO:teuthology.orchestra.run.smithi164.stdout:(61/176): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-02-18T09:58:36.629 INFO:teuthology.orchestra.run.smithi118.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-02-18T09:58:36.636 INFO:teuthology.orchestra.run.smithi204.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-02-18T09:58:36.654 INFO:teuthology.orchestra.run.smithi118.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-02-18T09:58:36.682 INFO:teuthology.orchestra.run.smithi164.stdout:(62/176): postgresql-server-13.11-1.el9.x86_64. 49 MB/s | 5.7 MB 00:00 2024-02-18T09:58:36.686 INFO:teuthology.orchestra.run.smithi204.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-02-18T09:58:36.703 INFO:teuthology.orchestra.run.smithi204.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 534 kB/s | 35 kB 00:00 2024-02-18T09:58:36.713 INFO:teuthology.orchestra.run.smithi118.stdout:(129/176): python3-grpcio-1.46.7-10.el9.x86_64. 6.8 MB/s | 2.0 MB 00:00 2024-02-18T09:58:36.715 INFO:teuthology.orchestra.run.smithi164.stdout:(63/176): protobuf-3.14.0-13.el9.x86_64.rpm 8.3 MB/s | 1.0 MB 00:00 2024-02-18T09:58:36.730 INFO:teuthology.orchestra.run.smithi118.stdout:(130/176): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-02-18T09:58:36.741 INFO:teuthology.orchestra.run.smithi164.stdout:(64/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-02-18T09:58:36.747 INFO:teuthology.orchestra.run.smithi118.stdout:(131/176): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-02-18T09:58:36.770 INFO:teuthology.orchestra.run.smithi204.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-02-18T09:58:36.840 INFO:teuthology.orchestra.run.smithi118.stdout:(132/176): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-02-18T09:58:36.841 INFO:teuthology.orchestra.run.smithi164.stdout:(65/176): python3-babel-2.9.1-2.el9.noarch.rpm 46 MB/s | 5.8 MB 00:00 2024-02-18T09:58:36.856 INFO:teuthology.orchestra.run.smithi118.stdout:(133/176): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-02-18T09:58:36.866 INFO:teuthology.orchestra.run.smithi164.stdout:(66/176): python3-jinja2-2.11.3-5.el9.noarch.rp 1.8 MB/s | 227 kB 00:00 2024-02-18T09:58:36.873 INFO:teuthology.orchestra.run.smithi118.stdout:(134/176): python3-more-itertools-8.12.0-2.el9. 628 kB/s | 79 kB 00:00 2024-02-18T09:58:36.891 INFO:teuthology.orchestra.run.smithi164.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 493 kB/s | 24 kB 00:00 2024-02-18T09:58:36.912 INFO:teuthology.orchestra.run.smithi204.stdout:(124/176): python3-grpcio-1.46.7-10.el9.x86_64. 9.8 MB/s | 2.0 MB 00:00 2024-02-18T09:58:36.917 INFO:teuthology.orchestra.run.smithi164.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 361 kB/s | 18 kB 00:00 2024-02-18T09:58:36.931 INFO:teuthology.orchestra.run.smithi118.stdout:(135/176): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2024-02-18T09:58:36.937 INFO:teuthology.orchestra.run.smithi204.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 871 kB/s | 144 kB 00:00 2024-02-18T09:58:36.942 INFO:teuthology.orchestra.run.smithi164.stdout:(69/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-02-18T09:58:36.965 INFO:teuthology.orchestra.run.smithi118.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-02-18T09:58:36.967 INFO:teuthology.orchestra.run.smithi164.stdout:(70/176): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2024-02-18T09:58:36.979 INFO:teuthology.orchestra.run.smithi204.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 162 kB/s | 11 kB 00:00 2024-02-18T09:58:36.990 INFO:teuthology.orchestra.run.smithi118.stdout:(137/176): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-02-18T09:58:37.004 INFO:teuthology.orchestra.run.smithi204.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-02-18T09:58:37.024 INFO:teuthology.orchestra.run.smithi118.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 971 kB/s | 90 kB 00:00 2024-02-18T09:58:37.038 INFO:teuthology.orchestra.run.smithi204.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 397 kB/s | 23 kB 00:00 2024-02-18T09:58:37.051 INFO:teuthology.orchestra.run.smithi164.stdout:(71/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 4.8 MB 00:00 2024-02-18T09:58:37.063 INFO:teuthology.orchestra.run.smithi118.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 289 kB/s | 28 kB 00:00 2024-02-18T09:58:37.063 INFO:teuthology.orchestra.run.smithi204.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 336 kB/s | 19 kB 00:00 2024-02-18T09:58:37.076 INFO:teuthology.orchestra.run.smithi164.stdout:(72/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 217 kB 00:00 2024-02-18T09:58:37.080 INFO:teuthology.orchestra.run.smithi118.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 344 kB/s | 31 kB 00:00 2024-02-18T09:58:37.102 INFO:teuthology.orchestra.run.smithi164.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-02-18T09:58:37.114 INFO:teuthology.orchestra.run.smithi204.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 265 kB/s | 20 kB 00:00 2024-02-18T09:58:37.122 INFO:teuthology.orchestra.run.smithi118.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 1.9 MB/s | 188 kB 00:00 2024-02-18T09:58:37.126 INFO:teuthology.orchestra.run.smithi164.stdout:(74/176): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-02-18T09:58:37.152 INFO:teuthology.orchestra.run.smithi164.stdout:(75/176): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2024-02-18T09:58:37.155 INFO:teuthology.orchestra.run.smithi118.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-02-18T09:58:37.164 INFO:teuthology.orchestra.run.smithi204.stdout:(131/176): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-02-18T09:58:37.173 INFO:teuthology.orchestra.run.smithi118.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-02-18T09:58:37.177 INFO:teuthology.orchestra.run.smithi164.stdout:(76/176): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-02-18T09:58:37.189 INFO:teuthology.orchestra.run.smithi204.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 623 kB/s | 46 kB 00:00 2024-02-18T09:58:37.202 INFO:teuthology.orchestra.run.smithi164.stdout:(77/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-02-18T09:58:37.214 INFO:teuthology.orchestra.run.smithi118.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 552 kB/s | 51 kB 00:00 2024-02-18T09:58:37.228 INFO:teuthology.orchestra.run.smithi164.stdout:(78/176): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-02-18T09:58:37.231 INFO:teuthology.orchestra.run.smithi204.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-02-18T09:58:37.253 INFO:teuthology.orchestra.run.smithi164.stdout:(79/176): python3-pytz-2021.1-5.el9.noarch.rpm 950 kB/s | 47 kB 00:00 2024-02-18T09:58:37.256 INFO:teuthology.orchestra.run.smithi118.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-02-18T09:58:37.257 INFO:teuthology.orchestra.run.smithi204.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 870 kB/s | 58 kB 00:00 2024-02-18T09:58:37.278 INFO:teuthology.orchestra.run.smithi164.stdout:(80/176): python3-requests-oauthlib-1.3.0-12.el 855 kB/s | 43 kB 00:00 2024-02-18T09:58:37.282 INFO:teuthology.orchestra.run.smithi118.stdout:(146/176): python3-websocket-client-1.2.3-2.el9 823 kB/s | 90 kB 00:00 2024-02-18T09:58:37.307 INFO:teuthology.orchestra.run.smithi204.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-02-18T09:58:37.324 INFO:teuthology.orchestra.run.smithi118.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-02-18T09:58:37.332 INFO:teuthology.orchestra.run.smithi204.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 220 kB/s | 16 kB 00:00 2024-02-18T09:58:37.349 INFO:teuthology.orchestra.run.smithi118.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-02-18T09:58:37.366 INFO:teuthology.orchestra.run.smithi204.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-02-18T09:58:37.383 INFO:teuthology.orchestra.run.smithi118.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-02-18T09:58:37.399 INFO:teuthology.orchestra.run.smithi204.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 426 kB/s | 28 kB 00:00 2024-02-18T09:58:37.425 INFO:teuthology.orchestra.run.smithi204.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 530 kB/s | 31 kB 00:00 2024-02-18T09:58:37.467 INFO:teuthology.orchestra.run.smithi204.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-02-18T09:58:37.492 INFO:teuthology.orchestra.run.smithi204.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 890 kB/s | 59 kB 00:00 2024-02-18T09:58:37.521 INFO:teuthology.orchestra.run.smithi164.stdout:(81/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2024-02-18T09:58:37.543 INFO:teuthology.orchestra.run.smithi204.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 479 kB/s | 36 kB 00:00 2024-02-18T09:58:37.546 INFO:teuthology.orchestra.run.smithi164.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 146 kB/s | 39 kB 00:00 2024-02-18T09:58:37.568 INFO:teuthology.orchestra.run.smithi204.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 680 kB/s | 51 kB 00:00 2024-02-18T09:58:37.571 INFO:teuthology.orchestra.run.smithi164.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 823 kB/s | 41 kB 00:00 2024-02-18T09:58:37.596 INFO:teuthology.orchestra.run.smithi164.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 215 kB 00:00 2024-02-18T09:58:37.610 INFO:teuthology.orchestra.run.smithi204.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-02-18T09:58:37.621 INFO:teuthology.orchestra.run.smithi164.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 678 kB/s | 34 kB 00:00 2024-02-18T09:58:37.635 INFO:teuthology.orchestra.run.smithi204.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-02-18T09:58:37.647 INFO:teuthology.orchestra.run.smithi164.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 866 kB/s | 43 kB 00:00 2024-02-18T09:58:37.672 INFO:teuthology.orchestra.run.smithi164.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-02-18T09:58:37.685 INFO:teuthology.orchestra.run.smithi204.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-02-18T09:58:37.689 INFO:teuthology.orchestra.run.smithi164.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-02-18T09:58:37.711 INFO:teuthology.orchestra.run.smithi204.stdout:(147/176): python3-zc-lockfile-2.0-10.el9.noarc 267 kB/s | 20 kB 00:00 2024-02-18T09:58:37.714 INFO:teuthology.orchestra.run.smithi164.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2024-02-18T09:58:37.731 INFO:teuthology.orchestra.run.smithi164.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-18T09:58:37.745 INFO:teuthology.orchestra.run.smithi204.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-02-18T09:58:37.748 INFO:teuthology.orchestra.run.smithi164.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-18T09:58:37.773 INFO:teuthology.orchestra.run.smithi164.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-02-18T09:58:37.798 INFO:teuthology.orchestra.run.smithi164.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-18T09:58:37.832 INFO:teuthology.orchestra.run.smithi164.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-02-18T09:58:37.836 INFO:teuthology.orchestra.run.smithi204.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-02-18T09:58:37.859 INFO:teuthology.orchestra.run.smithi164.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 194 kB 00:00 2024-02-18T09:58:37.883 INFO:teuthology.orchestra.run.smithi164.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-02-18T09:58:37.908 INFO:teuthology.orchestra.run.smithi164.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-18T09:58:37.950 INFO:teuthology.orchestra.run.smithi164.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-02-18T09:58:37.976 INFO:teuthology.orchestra.run.smithi164.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-02-18T09:58:38.001 INFO:teuthology.orchestra.run.smithi164.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2024-02-18T09:58:38.026 INFO:teuthology.orchestra.run.smithi164.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-02-18T09:58:38.060 INFO:teuthology.orchestra.run.smithi164.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.1 MB/s | 187 kB 00:00 2024-02-18T09:58:38.183 INFO:teuthology.orchestra.run.smithi118.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-02-18T09:58:38.216 INFO:teuthology.orchestra.run.smithi118.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-02-18T09:58:38.227 INFO:teuthology.orchestra.run.smithi164.stdout:(103/176): python3-devel-3.9.17-2.el9.x86_64.rp 1.2 MB/s | 245 kB 00:00 2024-02-18T09:58:38.361 INFO:teuthology.orchestra.run.smithi118.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-02-18T09:58:38.444 INFO:teuthology.orchestra.run.smithi118.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-02-18T09:58:38.494 INFO:teuthology.orchestra.run.smithi118.stdout:(154/176): librados2-19.0.0-1555.g1c920afa.el9. 2.9 MB/s | 3.4 MB 00:01 2024-02-18T09:58:38.520 INFO:teuthology.orchestra.run.smithi118.stdout:(155/176): NetworkManager-team-1.45.91-1.el9.x8 550 kB/s | 41 kB 00:00 2024-02-18T09:58:38.545 INFO:teuthology.orchestra.run.smithi118.stdout:(156/176): NetworkManager-tui-1.45.91-1.el9.x86 4.8 MB/s | 246 kB 00:00 2024-02-18T09:58:38.570 INFO:teuthology.orchestra.run.smithi118.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2024-02-18T09:58:38.587 INFO:teuthology.orchestra.run.smithi118.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 849 kB/s | 35 kB 00:00 2024-02-18T09:58:38.612 INFO:teuthology.orchestra.run.smithi118.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-02-18T09:58:38.638 INFO:teuthology.orchestra.run.smithi118.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-02-18T09:58:38.661 INFO:teuthology.orchestra.run.smithi164.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2024-02-18T09:58:38.671 INFO:teuthology.orchestra.run.smithi118.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-02-18T09:58:38.705 INFO:teuthology.orchestra.run.smithi118.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 6.5 MB/s | 433 kB 00:00 2024-02-18T09:58:38.722 INFO:teuthology.orchestra.run.smithi118.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-02-18T09:58:38.747 INFO:teuthology.orchestra.run.smithi118.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.5 MB/s | 107 kB 00:00 2024-02-18T09:58:38.773 INFO:teuthology.orchestra.run.smithi118.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-18T09:58:38.798 INFO:teuthology.orchestra.run.smithi118.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-18T09:58:38.815 INFO:teuthology.orchestra.run.smithi118.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 63 kB 00:00 2024-02-18T09:58:38.832 INFO:teuthology.orchestra.run.smithi118.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 828 kB/s | 28 kB 00:00 2024-02-18T09:58:38.874 INFO:teuthology.orchestra.run.smithi118.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2024-02-18T09:58:38.924 INFO:teuthology.orchestra.run.smithi118.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 24 MB/s | 2.1 MB 00:00 2024-02-18T09:58:39.044 INFO:teuthology.orchestra.run.smithi118.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 13 MB/s | 2.2 MB 00:00 2024-02-18T09:58:39.075 INFO:teuthology.orchestra.run.smithi118.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 2.9 MB/s | 438 kB 00:00 2024-02-18T09:58:39.100 INFO:teuthology.orchestra.run.smithi118.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 541 kB/s | 30 kB 00:00 2024-02-18T09:58:39.125 INFO:teuthology.orchestra.run.smithi118.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-02-18T09:58:39.168 INFO:teuthology.orchestra.run.smithi118.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-02-18T09:58:39.219 INFO:teuthology.orchestra.run.smithi164.stdout:(105/176): protobuf-compiler-3.14.0-13.el9.x86_ 871 kB/s | 863 kB 00:00 2024-02-18T09:58:39.244 INFO:teuthology.orchestra.run.smithi164.stdout:(106/176): abseil-cpp-20211102.0-3.el9.x86_64.r 940 kB/s | 548 kB 00:00 2024-02-18T09:58:39.295 INFO:teuthology.orchestra.run.smithi204.stdout:(150/176): librbd1-19.0.0-1555.g1c920afa.el9.x8 2.1 MB/s | 3.1 MB 00:01 2024-02-18T09:58:39.328 INFO:teuthology.orchestra.run.smithi204.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 68 kB 00:00 2024-02-18T09:58:39.361 INFO:teuthology.orchestra.run.smithi164.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 167 kB/s | 19 kB 00:00 2024-02-18T09:58:39.409 INFO:teuthology.orchestra.run.smithi118.stdout:(176/176): librbd1-19.0.0-1555.g1c920afa.el9.x8 1.5 MB/s | 3.1 MB 00:02 2024-02-18T09:58:39.413 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-02-18T09:58:39.413 INFO:teuthology.orchestra.run.smithi118.stdout:Total 7.7 MB/s | 223 MB 00:28 2024-02-18T09:58:39.445 INFO:teuthology.orchestra.run.smithi204.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 19 MB/s | 2.3 MB 00:00 2024-02-18T09:58:39.460 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-02-18T09:58:39.521 INFO:teuthology.orchestra.run.smithi204.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-02-18T09:58:39.554 INFO:teuthology.orchestra.run.smithi204.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-02-18T09:58:39.596 INFO:teuthology.orchestra.run.smithi204.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 5.9 MB/s | 246 kB 00:00 2024-02-18T09:58:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2024-02-18T09:58:39.663 INFO:teuthology.orchestra.run.smithi204.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 35 kB 00:00 2024-02-18T09:58:39.705 INFO:teuthology.orchestra.run.smithi204.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-02-18T09:58:39.728 INFO:teuthology.orchestra.run.smithi164.stdout:(108/176): gperftools-libs-2.9.1-2.el9.x86_64.r 607 kB/s | 309 kB 00:00 2024-02-18T09:58:39.732 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-02-18T09:58:39.732 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-02-18T09:58:39.789 INFO:teuthology.orchestra.run.smithi204.stdout:(159/176): librados2-19.0.0-1555.g1c920afa.el9. 1.6 MB/s | 3.4 MB 00:02 2024-02-18T09:58:39.823 INFO:teuthology.orchestra.run.smithi204.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 2.1 MB/s | 254 kB 00:00 2024-02-18T09:58:39.845 INFO:teuthology.orchestra.run.smithi164.stdout:(109/176): libarrow-9.0.0-10.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-02-18T09:58:39.856 INFO:teuthology.orchestra.run.smithi204.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-02-18T09:58:39.862 INFO:teuthology.orchestra.run.smithi164.stdout:(110/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-02-18T09:58:39.892 INFO:teuthology.orchestra.run.smithi204.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 6.6 MB/s | 433 kB 00:00 2024-02-18T09:58:39.917 INFO:teuthology.orchestra.run.smithi204.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 22 kB 00:00 2024-02-18T09:58:39.942 INFO:teuthology.orchestra.run.smithi204.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-18T09:58:39.946 INFO:teuthology.orchestra.run.smithi164.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-02-18T09:58:39.968 INFO:teuthology.orchestra.run.smithi204.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.1 MB/s | 154 kB 00:00 2024-02-18T09:58:39.971 INFO:teuthology.orchestra.run.smithi164.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-02-18T09:58:39.993 INFO:teuthology.orchestra.run.smithi204.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.7 MB/s | 135 kB 00:00 2024-02-18T09:58:40.019 INFO:teuthology.orchestra.run.smithi204.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 63 kB 00:00 2024-02-18T09:58:40.044 INFO:teuthology.orchestra.run.smithi204.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 562 kB/s | 28 kB 00:00 2024-02-18T09:58:40.054 INFO:teuthology.orchestra.run.smithi164.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-02-18T09:58:40.103 INFO:teuthology.orchestra.run.smithi204.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-02-18T09:58:40.203 INFO:teuthology.orchestra.run.smithi204.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 15 MB/s | 2.1 MB 00:00 2024-02-18T09:58:40.287 INFO:teuthology.orchestra.run.smithi204.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 13 MB/s | 2.2 MB 00:00 2024-02-18T09:58:40.321 INFO:teuthology.orchestra.run.smithi204.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 438 kB 00:00 2024-02-18T09:58:40.337 INFO:teuthology.orchestra.run.smithi204.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 657 kB/s | 30 kB 00:00 2024-02-18T09:58:40.380 INFO:teuthology.orchestra.run.smithi204.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2024-02-18T09:58:40.430 INFO:teuthology.orchestra.run.smithi204.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-02-18T09:58:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(114/176): ceph-test-19.0.0-1555.g1c920afa.el9. 3.3 MB/s | 47 MB 00:14 2024-02-18T09:58:40.580 INFO:teuthology.orchestra.run.smithi164.stdout:(115/176): python3-asyncssh-2.13.2-4.el9.noarch 1.0 MB/s | 548 kB 00:00 2024-02-18T09:58:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:(116/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.3 MB/s | 838 kB 00:00 2024-02-18T09:58:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-02-18T09:58:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-02-18T09:58:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-02-18T09:58:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-02-18T09:58:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:(121/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-02-18T09:58:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:(122/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-02-18T09:58:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:(123/176): python3-colorama-0.4.4-12.el9.noarch 324 kB/s | 35 kB 00:00 2024-02-18T09:58:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-02-18T09:58:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:(125/176): python3-google-auth-2.27.0-1.el9.noa 701 kB/s | 203 kB 00:00 2024-02-18T09:58:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 67 kB/s | 11 kB 00:00 2024-02-18T09:58:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:(127/176): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-02-18T09:58:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:(128/176): python3-jaraco-classes-3.2.1-5.el9.n 170 kB/s | 18 kB 00:00 2024-02-18T09:58:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:(129/176): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-02-18T09:58:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:(130/176): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-02-18T09:58:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:(131/176): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-02-18T09:58:41.416 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-02-18T09:58:41.417 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-02-18T09:58:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2024-02-18T09:58:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-02-18T09:58:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 532 kB/s | 58 kB 00:00 2024-02-18T09:58:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:(135/176): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2024-02-18T09:58:41.828 INFO:teuthology.orchestra.run.smithi164.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 836 kB/s | 272 kB 00:00 2024-02-18T09:58:41.844 INFO:teuthology.orchestra.run.smithi164.stdout:(137/176): python3-portend-3.1.0-2.el9.noarch.r 60 kB/s | 16 kB 00:00 2024-02-18T09:58:41.870 INFO:teuthology.orchestra.run.smithi164.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 336 kB/s | 90 kB 00:00 2024-02-18T09:58:41.928 INFO:teuthology.orchestra.run.smithi164.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-02-18T09:58:41.945 INFO:teuthology.orchestra.run.smithi164.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-02-18T09:58:41.979 INFO:teuthology.orchestra.run.smithi164.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-02-18T09:58:42.029 INFO:teuthology.orchestra.run.smithi164.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-02-18T09:58:42.046 INFO:teuthology.orchestra.run.smithi164.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-02-18T09:58:42.080 INFO:teuthology.orchestra.run.smithi164.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2024-02-18T09:58:42.138 INFO:teuthology.orchestra.run.smithi164.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-02-18T09:58:42.164 INFO:teuthology.orchestra.run.smithi164.stdout:(146/176): python3-websocket-client-1.2.3-2.el9 765 kB/s | 90 kB 00:00 2024-02-18T09:58:42.188 INFO:teuthology.orchestra.run.smithi164.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-02-18T09:58:42.239 INFO:teuthology.orchestra.run.smithi164.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-02-18T09:58:42.273 INFO:teuthology.orchestra.run.smithi164.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-02-18T09:58:42.398 INFO:teuthology.orchestra.run.smithi164.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-02-18T09:58:42.431 INFO:teuthology.orchestra.run.smithi164.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-02-18T09:58:42.498 INFO:teuthology.orchestra.run.smithi164.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 34 MB/s | 2.3 MB 00:00 2024-02-18T09:58:42.557 INFO:teuthology.orchestra.run.smithi164.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 31 MB/s | 1.8 MB 00:00 2024-02-18T09:58:42.582 INFO:teuthology.orchestra.run.smithi164.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 1.6 MB/s | 41 kB 00:00 2024-02-18T09:58:42.616 INFO:teuthology.orchestra.run.smithi164.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 7.2 MB/s | 246 kB 00:00 2024-02-18T09:58:42.649 INFO:teuthology.orchestra.run.smithi164.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-02-18T09:58:42.675 INFO:teuthology.orchestra.run.smithi164.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 1.4 MB/s | 35 kB 00:00 2024-02-18T09:58:42.708 INFO:teuthology.orchestra.run.smithi164.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 5.6 MB/s | 191 kB 00:00 2024-02-18T09:58:42.750 INFO:teuthology.orchestra.run.smithi164.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 5.9 MB/s | 254 kB 00:00 2024-02-18T09:58:42.792 INFO:teuthology.orchestra.run.smithi164.stdout:(160/176): iproute-6.7.0-2.el9.x86_64.rpm 19 MB/s | 802 kB 00:00 2024-02-18T09:58:42.843 INFO:teuthology.orchestra.run.smithi164.stdout:(161/176): librbd1-19.0.0-1555.g1c920afa.el9.x8 5.5 MB/s | 3.1 MB 00:00 2024-02-18T09:58:42.868 INFO:teuthology.orchestra.run.smithi164.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.6 MB/s | 433 kB 00:00 2024-02-18T09:58:42.893 INFO:teuthology.orchestra.run.smithi164.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-02-18T09:58:42.918 INFO:teuthology.orchestra.run.smithi164.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-18T09:58:42.944 INFO:teuthology.orchestra.run.smithi164.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-18T09:58:42.961 INFO:teuthology.orchestra.run.smithi164.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 135 kB 00:00 2024-02-18T09:58:42.986 INFO:teuthology.orchestra.run.smithi164.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 63 kB 00:00 2024-02-18T09:58:43.003 INFO:teuthology.orchestra.run.smithi164.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 663 kB/s | 28 kB 00:00 2024-02-18T09:58:43.037 INFO:teuthology.orchestra.run.smithi164.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 23 MB/s | 1.2 MB 00:00 2024-02-18T09:58:43.079 INFO:teuthology.orchestra.run.smithi164.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 29 MB/s | 2.1 MB 00:00 2024-02-18T09:58:43.129 INFO:teuthology.orchestra.run.smithi164.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 25 MB/s | 2.2 MB 00:00 2024-02-18T09:58:43.234 INFO:teuthology.orchestra.run.smithi164.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 2.8 MB/s | 438 kB 00:00 2024-02-18T09:58:43.255 INFO:teuthology.orchestra.run.smithi164.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 241 kB/s | 30 kB 00:00 2024-02-18T09:58:43.280 INFO:teuthology.orchestra.run.smithi164.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 6.9 MB/s | 321 kB 00:00 2024-02-18T09:58:43.322 INFO:teuthology.orchestra.run.smithi164.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-02-18T09:58:43.380 INFO:teuthology.orchestra.run.smithi164.stdout:(176/176): librados2-19.0.0-1555.g1c920afa.el9. 3.0 MB/s | 3.4 MB 00:01 2024-02-18T09:58:43.384 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-02-18T09:58:43.384 INFO:teuthology.orchestra.run.smithi164.stdout:Total 7.1 MB/s | 223 MB 00:31 2024-02-18T09:58:43.434 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-02-18T09:58:43.580 INFO:teuthology.orchestra.run.smithi204.stdout:(176/176): ceph-test-19.0.0-1555.g1c920afa.el9. 2.5 MB/s | 47 MB 00:18 2024-02-18T09:58:43.589 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-02-18T09:58:43.590 INFO:teuthology.orchestra.run.smithi204.stdout:Total 8.0 MB/s | 223 MB 00:27 2024-02-18T09:58:43.713 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-02-18T09:58:43.713 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-02-18T09:58:43.728 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-02-18T09:58:44.111 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-02-18T09:58:44.111 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-02-18T09:58:45.397 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-02-18T09:58:45.397 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-02-18T09:58:46.366 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-02-18T09:58:46.367 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-02-18T09:58:48.552 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-02-18T09:58:48.680 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-18T09:58:48.715 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-18T09:58:48.753 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-18T09:58:48.777 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-18T09:58:48.840 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-18T09:58:48.878 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-18T09:58:48.933 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-18T09:58:48.966 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-18T09:58:48.992 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-18T09:58:49.034 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-18T09:58:49.416 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-18T09:58:49.460 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:58:49.564 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:58:49.636 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:58:49.727 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:58:49.757 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 13/202 2024-02-18T09:58:49.914 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-18T09:58:49.996 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-18T09:58:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:58:50.127 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:58:50.150 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 17/202 2024-02-18T09:58:50.214 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 17/202 2024-02-18T09:58:50.262 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-18T09:58:50.285 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-18T09:58:50.300 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-18T09:58:50.476 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-18T09:58:50.507 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-18T09:58:50.539 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-18T09:58:50.643 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-18T09:58:50.717 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-18T09:58:50.777 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-18T09:58:50.846 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:50.896 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:51.113 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:51.217 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-18T09:58:51.312 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-18T09:58:51.358 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-18T09:58:51.426 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-18T09:58:51.480 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-18T09:58:51.511 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-18T09:58:51.548 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-18T09:58:51.588 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-18T09:58:51.651 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-18T09:58:51.695 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-18T09:58:51.739 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-18T09:58:51.780 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-18T09:58:51.807 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-18T09:58:51.877 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-18T09:58:51.913 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:19.0.0-1555.g1c920afa.el9. 39/202 2024-02-18T09:58:51.955 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el 40/202 2024-02-18T09:58:51.985 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_6 41/202 2024-02-18T09:58:52.053 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-18T09:58:52.099 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-18T09:58:52.173 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-18T09:58:52.306 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-18T09:58:52.344 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-02-18T09:58:52.369 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-18T09:58:52.450 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-18T09:58:52.476 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-18T09:58:52.509 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-18T09:58:52.533 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-18T09:58:52.588 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-18T09:58:52.626 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-18T09:58:52.680 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-18T09:58:52.722 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-18T09:58:52.748 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-18T09:58:52.790 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-18T09:58:52.884 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-18T09:58:52.963 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-18T09:58:53.049 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-18T09:58:53.093 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-18T09:58:53.100 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-18T09:58:53.109 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-18T09:58:53.139 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-18T09:58:53.178 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_6 52/202 2024-02-18T09:58:53.182 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:58:53.209 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-18T09:58:53.294 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-18T09:58:53.304 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:58:53.333 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:58:53.352 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-18T09:58:53.416 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:58:53.445 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 13/202 2024-02-18T09:58:53.566 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-18T09:58:53.620 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-18T09:58:53.676 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-02-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 17/202 2024-02-18T09:58:53.827 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-18T09:58:53.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 17/202 2024-02-18T09:58:53.917 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-18T09:58:53.940 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-18T09:58:53.955 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-18T09:58:53.963 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-18T09:58:53.971 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-18T09:58:54.019 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-18T09:58:54.035 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-18T09:58:54.074 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-18T09:58:54.122 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-18T09:58:54.139 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-18T09:58:54.146 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-18T09:58:54.170 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-18T09:58:54.178 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-18T09:58:54.203 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-18T09:58:54.215 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-18T09:58:54.250 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-18T09:58:54.264 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-18T09:58:54.300 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-18T09:58:54.306 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-18T09:58:54.319 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-18T09:58:54.349 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-18T09:58:54.357 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-18T09:58:54.391 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-18T09:58:54.397 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-18T09:58:54.440 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-18T09:58:54.474 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-18T09:58:54.500 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:54.525 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-18T09:58:54.558 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:54.580 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-18T09:58:54.611 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-18T09:58:54.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-18T09:58:54.752 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-18T09:58:54.767 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:54.792 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-18T09:58:54.840 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-18T09:58:54.866 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-18T09:58:54.871 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-18T09:58:54.891 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-18T09:58:54.949 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-18T09:58:54.962 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-18T09:58:54.975 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-18T09:58:54.997 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:58:55.004 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-18T09:58:55.073 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-18T09:58:55.099 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-18T09:58:55.127 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-18T09:58:55.155 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:58:55.158 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-18T09:58:55.180 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-18T09:58:55.181 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:58:55.193 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-18T09:58:55.234 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-18T09:58:55.249 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-18T09:58:55.298 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-18T09:58:55.303 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:58:55.307 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-18T09:58:55.341 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-18T09:58:55.349 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 13/202 2024-02-18T09:58:55.352 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-18T09:58:55.384 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-18T09:58:55.416 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-18T09:58:55.445 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-18T09:58:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-18T09:58:55.536 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-18T09:58:55.550 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.0.0-1555.g1c920afa.el9. 39/202 2024-02-18T09:58:55.590 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-18T09:58:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el 40/202 2024-02-18T09:58:55.612 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-18T09:58:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_6 41/202 2024-02-18T09:58:55.666 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-18T09:58:55.691 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:58:55.692 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-18T09:58:55.737 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-18T09:58:55.739 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-18T09:58:55.777 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-18T09:58:55.810 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-18T09:58:55.810 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-18T09:58:55.841 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-18T09:58:55.876 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-18T09:58:55.877 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:58:55.908 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-18T09:58:55.934 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 17/202 2024-02-18T09:58:55.936 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-18T09:58:55.946 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-18T09:58:55.971 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-18T09:58:55.998 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-18T09:58:56.018 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-18T09:58:56.024 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 17/202 2024-02-18T09:58:56.050 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-18T09:58:56.077 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-18T09:58:56.080 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-18T09:58:56.110 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-18T09:58:56.155 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-18T09:58:56.183 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-18T09:58:56.190 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-18T09:58:56.223 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-18T09:58:56.265 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-18T09:58:56.299 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-18T09:58:56.387 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-18T09:58:56.452 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-18T09:58:56.502 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-18T09:58:56.503 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-18T09:58:56.524 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-18T09:58:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-18T09:58:56.571 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-18T09:58:56.579 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-18T09:58:56.601 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-18T09:58:56.626 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-18T09:58:56.674 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-18T09:58:56.713 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-18T09:58:56.720 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-18T09:58:56.722 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-18T09:58:56.760 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-18T09:58:56.788 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-18T09:58:56.797 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_6 52/202 2024-02-18T09:58:56.829 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-18T09:58:56.920 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-18T09:58:56.920 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-18T09:58:56.980 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-18T09:58:57.084 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-18T09:58:57.172 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-18T09:58:57.207 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-18T09:58:57.376 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:57.386 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-18T09:58:57.429 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:57.457 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-18T09:58:57.502 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-18T09:58:57.512 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-18T09:58:57.561 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-18T09:58:57.595 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-18T09:58:57.643 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-18T09:58:57.645 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-18T09:58:57.700 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-18T09:58:57.722 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-18T09:58:57.754 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-18T09:58:57.763 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-18T09:58:57.778 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-18T09:58:57.827 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-18T09:58:57.867 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-18T09:58:57.903 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-18T09:58:57.939 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-18T09:58:57.950 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-18T09:58:57.955 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-18T09:58:57.969 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-18T09:58:57.986 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-18T09:58:58.029 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-18T09:58:58.046 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-18T09:58:58.071 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-18T09:58:58.080 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-18T09:58:58.127 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-18T09:58:58.207 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-18T09:58:58.229 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-18T09:58:58.261 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-18T09:58:58.289 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-18T09:58:58.291 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-18T09:58:58.322 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-18T09:58:58.332 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-18T09:58:58.376 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-18T09:58:58.424 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-18T09:58:58.434 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-18T09:58:58.474 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-18T09:58:58.514 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-18T09:58:58.527 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-18T09:58:58.540 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-18T09:58:58.564 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-18T09:58:58.574 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-18T09:58:58.637 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-18T09:58:58.654 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-18T09:58:58.683 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-18T09:58:58.704 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-18T09:58:58.736 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-18T09:58:58.760 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-18T09:58:58.819 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-18T09:58:58.852 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-18T09:58:58.866 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-18T09:58:58.889 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:19.0.0-1555.g1c920afa.el9. 39/202 2024-02-18T09:58:58.914 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-18T09:58:58.932 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el 40/202 2024-02-18T09:58:58.953 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_6 41/202 2024-02-18T09:58:58.963 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-18T09:58:59.019 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-18T09:58:59.055 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-18T09:58:59.106 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-18T09:58:59.212 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-18T09:58:59.231 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-18T09:58:59.269 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-18T09:58:59.398 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-18T09:58:59.404 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-18T09:58:59.442 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-18T09:58:59.469 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-18T09:58:59.475 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-18T09:58:59.506 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-18T09:58:59.558 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-18T09:58:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-18T09:58:59.643 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-18T09:58:59.676 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-18T09:58:59.716 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-18T09:58:59.748 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-18T09:58:59.778 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-18T09:58:59.854 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-18T09:58:59.888 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-18T09:58:59.921 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-18T09:58:59.963 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-18T09:58:59.997 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-18T09:59:00.016 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-18T09:59:00.085 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-18T09:59:00.091 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-18T09:59:00.118 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-18T09:59:00.124 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-18T09:59:00.168 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-18T09:59:00.215 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-18T09:59:00.220 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-18T09:59:00.251 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-18T09:59:00.299 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-18T09:59:00.344 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-18T09:59:00.396 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-18T09:59:00.419 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-18T09:59:00.426 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-18T09:59:00.445 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-18T09:59:00.448 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 125/202 2024-02-18T09:59:00.454 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-18T09:59:00.524 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-18T09:59:00.538 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 125/202 2024-02-18T09:59:00.570 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 126/202 2024-02-18T09:59:00.577 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_6 52/202 2024-02-18T09:59:00.606 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-18T09:59:00.624 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-18T09:59:00.849 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-18T09:59:00.914 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-18T09:59:01.060 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-18T09:59:01.085 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 129/202 2024-02-18T09:59:01.147 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 129/202 2024-02-18T09:59:01.170 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 130/202 2024-02-18T09:59:01.176 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-18T09:59:01.225 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-18T09:59:01.259 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-18T09:59:01.307 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-18T09:59:01.311 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-18T09:59:01.395 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-18T09:59:01.427 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-18T09:59:01.531 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-18T09:59:01.597 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-18T09:59:01.624 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-18T09:59:01.625 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-18T09:59:01.684 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-18T09:59:01.702 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-18T09:59:01.891 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-18T09:59:01.938 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-18T09:59:02.015 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-18T09:59:02.107 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-18T09:59:02.163 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-18T09:59:02.203 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-18T09:59:02.272 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-18T09:59:02.310 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-18T09:59:02.342 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-18T09:59:02.374 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-18T09:59:02.442 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-18T09:59:02.463 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-18T09:59:02.638 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-18T09:59:02.691 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-18T09:59:02.739 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-18T09:59:02.798 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-18T09:59:02.937 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-18T09:59:02.978 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-18T09:59:03.023 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-18T09:59:03.060 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-18T09:59:03.093 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-18T09:59:03.256 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-18T09:59:03.297 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:03.342 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:03.427 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-18T09:59:03.561 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-18T09:59:03.621 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-18T09:59:03.670 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-18T09:59:03.683 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-18T09:59:03.737 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-18T09:59:03.756 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-18T09:59:03.784 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-18T09:59:03.875 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:03.920 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 132/202 2024-02-18T09:59:04.002 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 132/202 2024-02-18T09:59:04.002 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-18T09:59:04.002 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-18T09:59:04.002 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:04.030 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 133/202 2024-02-18T09:59:04.031 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-18T09:59:04.064 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-18T09:59:04.084 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-18T09:59:04.094 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 125/202 2024-02-18T09:59:04.168 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 125/202 2024-02-18T09:59:04.198 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 126/202 2024-02-18T09:59:04.234 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-18T09:59:04.257 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-18T09:59:04.299 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-18T09:59:04.338 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-18T09:59:04.379 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-18T09:59:04.417 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-18T09:59:04.453 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-18T09:59:04.496 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-18T09:59:04.542 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-18T09:59:04.609 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-18T09:59:04.666 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-18T09:59:04.689 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-18T09:59:04.714 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-18T09:59:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 129/202 2024-02-18T09:59:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 129/202 2024-02-18T09:59:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 130/202 2024-02-18T09:59:04.876 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-18T09:59:04.915 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-18T09:59:04.958 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-18T09:59:05.022 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-18T09:59:05.061 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-18T09:59:05.207 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-18T09:59:05.324 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-18T09:59:05.390 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-18T09:59:05.426 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-18T09:59:05.484 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-18T09:59:05.623 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-18T09:59:05.684 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-18T09:59:06.643 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-18T09:59:06.698 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-18T09:59:06.732 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-18T09:59:06.789 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-18T09:59:06.883 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:06.919 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-18T09:59:06.920 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:06.958 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-18T09:59:07.187 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-18T09:59:07.222 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-18T09:59:07.314 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-18T09:59:07.461 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:07.499 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 132/202 2024-02-18T09:59:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 132/202 2024-02-18T09:59:07.572 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-18T09:59:07.572 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-18T09:59:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 133/202 2024-02-18T09:59:08.097 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-18T09:59:08.241 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-18T09:59:09.745 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-18T09:59:09.820 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-18T09:59:09.846 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-18T09:59:10.220 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-18T09:59:10.249 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 125/202 2024-02-18T09:59:10.369 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 125/202 2024-02-18T09:59:10.405 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 126/202 2024-02-18T09:59:10.480 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-18T09:59:10.981 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-18T09:59:11.011 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 129/202 2024-02-18T09:59:11.102 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 129/202 2024-02-18T09:59:11.138 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 130/202 2024-02-18T09:59:13.807 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:13.844 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:14.468 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 131/202 2024-02-18T09:59:14.513 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 132/202 2024-02-18T09:59:14.662 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 132/202 2024-02-18T09:59:14.662 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-18T09:59:14.662 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-18T09:59:14.662 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:14.697 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 133/202 2024-02-18T09:59:16.186 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 133/202 2024-02-18T09:59:16.186 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-02-18T09:59:16.186 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-02-18T09:59:16.187 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-02-18T09:59:16.187 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-02-18T09:59:16.187 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-02-18T09:59:16.187 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-02-18T09:59:16.187 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-02-18T09:59:16.187 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:16.345 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 134/202 2024-02-18T09:59:16.360 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 134/202 2024-02-18T09:59:16.360 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:16.360 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-18T09:59:16.360 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:17.831 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 135/202 2024-02-18T09:59:17.856 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 135/202 2024-02-18T09:59:17.857 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:17.857 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-18T09:59:17.857 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-18T09:59:17.857 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-18T09:59:17.857 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:18.083 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 136/202 2024-02-18T09:59:18.105 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 136/202 2024-02-18T09:59:18.105 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:18.106 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-18T09:59:18.106 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-18T09:59:18.106 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-18T09:59:18.106 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:18.560 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 137/202 2024-02-18T09:59:18.582 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 137/202 2024-02-18T09:59:18.582 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:18.582 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-18T09:59:18.582 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-18T09:59:18.582 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-18T09:59:18.582 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:18.670 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-18T09:59:19.130 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 139/202 2024-02-18T09:59:19.154 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 139/202 2024-02-18T09:59:19.177 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.e 140/202 2024-02-18T09:59:19.238 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa. 141/202 2024-02-18T09:59:19.242 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 133/202 2024-02-18T09:59:19.242 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-02-18T09:59:19.242 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-02-18T09:59:19.242 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-02-18T09:59:19.242 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-02-18T09:59:19.242 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-02-18T09:59:19.243 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-02-18T09:59:19.243 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-02-18T09:59:19.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:19.260 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 142/202 2024-02-18T09:59:19.406 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 134/202 2024-02-18T09:59:19.421 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 134/202 2024-02-18T09:59:19.421 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:19.421 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-18T09:59:19.422 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:19.487 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 142/202 2024-02-18T09:59:19.520 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 143/202 2024-02-18T09:59:20.481 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 143/202 2024-02-18T09:59:20.512 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 144/202 2024-02-18T09:59:20.611 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 144/202 2024-02-18T09:59:20.767 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el 145/202 2024-02-18T09:59:20.797 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 146/202 2024-02-18T09:59:20.820 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 146/202 2024-02-18T09:59:20.820 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:20.821 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-18T09:59:20.821 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-18T09:59:20.821 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-18T09:59:20.821 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:20.874 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 147/202 2024-02-18T09:59:20.884 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 147/202 2024-02-18T09:59:20.921 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 148/202 2024-02-18T09:59:20.927 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 135/202 2024-02-18T09:59:20.952 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 135/202 2024-02-18T09:59:20.952 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:20.952 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-18T09:59:20.952 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-18T09:59:20.952 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-18T09:59:20.952 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:21.160 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 136/202 2024-02-18T09:59:21.182 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 136/202 2024-02-18T09:59:21.183 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:21.183 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-18T09:59:21.183 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-18T09:59:21.183 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-18T09:59:21.183 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:21.644 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 137/202 2024-02-18T09:59:21.667 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 137/202 2024-02-18T09:59:21.667 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:21.667 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-18T09:59:21.667 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-18T09:59:21.667 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-18T09:59:21.667 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:21.762 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-18T09:59:21.763 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-18T09:59:21.792 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 150/202 2024-02-18T09:59:21.814 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 150/202 2024-02-18T09:59:21.815 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:21.815 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-18T09:59:21.815 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-18T09:59:21.815 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-18T09:59:21.815 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:21.859 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1555.g1c920 151/202 2024-02-18T09:59:21.881 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1555.g1c920 151/202 2024-02-18T09:59:21.881 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:21.881 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-18T09:59:21.881 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:21.927 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 152/202 2024-02-18T09:59:21.949 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 152/202 2024-02-18T09:59:21.949 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:21.949 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-18T09:59:21.949 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-18T09:59:21.949 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-18T09:59:21.949 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:22.148 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 139/202 2024-02-18T09:59:22.170 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 139/202 2024-02-18T09:59:22.201 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.e 140/202 2024-02-18T09:59:22.262 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa. 141/202 2024-02-18T09:59:22.293 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 142/202 2024-02-18T09:59:22.302 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:22.325 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:22.325 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:22.325 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-18T09:59:22.326 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-18T09:59:22.326 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-18T09:59:22.326 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:22.520 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 142/202 2024-02-18T09:59:22.552 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 143/202 2024-02-18T09:59:23.519 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 143/202 2024-02-18T09:59:23.544 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 144/202 2024-02-18T09:59:23.643 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 144/202 2024-02-18T09:59:23.809 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el 145/202 2024-02-18T09:59:23.840 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 146/202 2024-02-18T09:59:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 146/202 2024-02-18T09:59:23.863 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:23.863 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-18T09:59:23.863 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-18T09:59:23.863 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-18T09:59:23.863 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:23.907 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 147/202 2024-02-18T09:59:23.918 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 147/202 2024-02-18T09:59:23.964 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 148/202 2024-02-18T09:59:24.820 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-18T09:59:24.843 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 150/202 2024-02-18T09:59:24.865 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 150/202 2024-02-18T09:59:24.865 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:24.865 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-18T09:59:24.865 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-18T09:59:24.865 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-18T09:59:24.866 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:24.910 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1555.g1c920 151/202 2024-02-18T09:59:24.932 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1555.g1c920 151/202 2024-02-18T09:59:24.932 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:24.932 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-18T09:59:24.932 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:24.977 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 152/202 2024-02-18T09:59:24.999 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 152/202 2024-02-18T09:59:25.000 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:25.000 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-18T09:59:25.000 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-18T09:59:25.000 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-18T09:59:25.000 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:25.311 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:25.334 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:25.334 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-18T09:59:25.334 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-18T09:59:25.334 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-18T09:59:25.334 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:26.766 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 154/202 2024-02-18T09:59:26.857 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 155/202 2024-02-18T09:59:26.887 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 156/202 2024-02-18T09:59:26.906 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-18T09:59:27.086 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 158/202 2024-02-18T09:59:27.250 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-18T09:59:27.296 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 160/202 2024-02-18T09:59:27.344 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-18T09:59:27.396 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-18T09:59:27.427 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 133/202 2024-02-18T09:59:27.427 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-02-18T09:59:27.427 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-02-18T09:59:27.427 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-02-18T09:59:27.427 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-02-18T09:59:27.427 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-02-18T09:59:27.428 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2024-02-18T09:59:27.428 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-02-18T09:59:27.428 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:27.499 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-18T09:59:27.540 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-18T09:59:27.567 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-18T09:59:27.589 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_ 166/202 2024-02-18T09:59:27.619 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-18T09:59:27.647 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 134/202 2024-02-18T09:59:27.696 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 134/202 2024-02-18T09:59:27.696 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:27.696 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-18T09:59:27.696 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:27.730 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-18T09:59:27.774 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-18T09:59:27.818 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-18T09:59:28.391 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:28.475 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:28.495 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:29.301 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 172/202 2024-02-18T09:59:29.308 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 135/202 2024-02-18T09:59:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 135/202 2024-02-18T09:59:29.383 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:29.383 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-18T09:59:29.383 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-18T09:59:29.383 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-18T09:59:29.383 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:29.429 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-18T09:59:29.470 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-18T09:59:29.592 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-18T09:59:29.608 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 136/202 2024-02-18T09:59:29.634 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-18T09:59:29.658 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-18T09:59:29.674 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 136/202 2024-02-18T09:59:29.675 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:29.675 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-18T09:59:29.675 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-18T09:59:29.675 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-18T09:59:29.675 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:29.684 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-18T09:59:29.777 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-18T09:59:29.777 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-18T09:59:29.782 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 154/202 2024-02-18T09:59:29.824 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 155/202 2024-02-18T09:59:29.853 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-18T09:59:29.854 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 156/202 2024-02-18T09:59:29.881 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-18T09:59:29.881 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-18T09:59:29.911 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-18T09:59:29.912 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-18T09:59:29.996 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-18T09:59:30.023 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-18T09:59:30.057 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-18T09:59:30.064 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 158/202 2024-02-18T09:59:30.081 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-18T09:59:30.108 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-18T09:59:30.159 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 137/202 2024-02-18T09:59:30.180 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-18T09:59:30.183 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-18T09:59:30.215 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-18T09:59:30.226 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 137/202 2024-02-18T09:59:30.227 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:30.227 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-18T09:59:30.227 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-18T09:59:30.227 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-18T09:59:30.227 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:30.230 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 160/202 2024-02-18T09:59:30.278 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-18T09:59:30.297 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-18T09:59:30.338 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-18T09:59:30.338 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-18T09:59:30.345 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-18T09:59:30.363 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-18T09:59:30.388 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-18T09:59:30.412 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-18T09:59:30.413 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-18T09:59:30.439 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-18T09:59:30.445 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:30.445 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:30.456 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-18T09:59:30.501 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-18T09:59:30.531 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_ 166/202 2024-02-18T09:59:30.560 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-18T09:59:30.625 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:30.625 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-18T09:59:30.633 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-18T09:59:30.674 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-18T09:59:30.708 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-18T09:59:30.717 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-18T09:59:30.733 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-18T09:59:30.759 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-18T09:59:30.784 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-18T09:59:30.817 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-18T09:59:30.882 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-18T09:59:31.058 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 139/202 2024-02-18T09:59:31.095 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 139/202 2024-02-18T09:59:31.144 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.e 140/202 2024-02-18T09:59:31.248 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa. 141/202 2024-02-18T09:59:31.274 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 142/202 2024-02-18T09:59:31.290 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:31.324 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:31.344 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:31.596 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 142/202 2024-02-18T09:59:31.625 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 143/202 2024-02-18T09:59:32.165 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 172/202 2024-02-18T09:59:32.227 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-18T09:59:32.268 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-18T09:59:32.350 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-18T09:59:32.390 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-18T09:59:32.414 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-18T09:59:32.440 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-18T09:59:32.475 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-18T09:59:32.475 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-18T09:59:32.560 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-18T09:59:32.596 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-18T09:59:32.626 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-18T09:59:32.626 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-18T09:59:32.710 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-18T09:59:32.737 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-18T09:59:32.756 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 143/202 2024-02-18T09:59:32.779 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-18T09:59:32.784 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 144/202 2024-02-18T09:59:32.803 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-18T09:59:32.831 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-18T09:59:32.863 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-18T09:59:32.896 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-18T09:59:32.927 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 144/202 2024-02-18T09:59:32.936 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-18T09:59:32.969 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-18T09:59:32.994 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-18T09:59:33.019 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-18T09:59:33.053 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-18T09:59:33.078 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-18T09:59:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:33.084 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:33.107 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el 145/202 2024-02-18T09:59:33.145 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 146/202 2024-02-18T09:59:33.215 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 146/202 2024-02-18T09:59:33.215 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:33.215 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-18T09:59:33.215 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-18T09:59:33.215 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-18T09:59:33.215 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:33.264 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:33.264 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-18T09:59:33.279 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 147/202 2024-02-18T09:59:33.316 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 147/202 2024-02-18T09:59:33.347 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-18T09:59:33.372 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-18T09:59:33.397 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-18T09:59:33.399 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 148/202 2024-02-18T09:59:33.422 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-18T09:59:33.455 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-18T09:59:33.522 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-18T09:59:34.383 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-18T09:59:34.414 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 150/202 2024-02-18T09:59:34.501 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 150/202 2024-02-18T09:59:34.501 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:34.501 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-18T09:59:34.501 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-18T09:59:34.501 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-18T09:59:34.501 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:34.557 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1555.g1c920 151/202 2024-02-18T09:59:34.652 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1555.g1c920 151/202 2024-02-18T09:59:34.653 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:34.653 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-18T09:59:34.653 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:34.740 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 152/202 2024-02-18T09:59:34.817 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 152/202 2024-02-18T09:59:34.817 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:34.817 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-18T09:59:34.817 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-18T09:59:34.817 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-18T09:59:34.817 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:35.224 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:35.301 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:35.301 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-18T09:59:35.301 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-18T09:59:35.301 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-18T09:59:35.301 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-18T09:59:35.301 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:36.239 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-18T09:59:36.239 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 1/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 2/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 3/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 4/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1555.g1c920 5/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 6/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 7/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 8/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 9/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 10/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:59:36.240 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 13/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 14/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_ 15/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 17/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_6 18/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 19/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 20/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el 21/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:19.0.0-1555.g1c920afa.el9. 22/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_6 23/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 24/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 25/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 26/202 2024-02-18T09:59:36.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 27/202 2024-02-18T09:59:36.242 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 28/202 2024-02-18T09:59:36.258 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 29/202 2024-02-18T09:59:36.258 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa. 30/202 2024-02-18T09:59:36.258 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 31/202 2024-02-18T09:59:36.258 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 32/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 33/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el 34/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 35/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.e 36/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 37/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 38/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 39/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-18T09:59:36.259 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-18T09:59:36.260 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-18T09:59:36.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-18T09:59:36.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-18T09:59:36.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-18T09:59:36.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-18T09:59:36.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-18T09:59:36.261 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-18T09:59:36.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-18T09:59:36.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-18T09:59:36.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-18T09:59:36.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-18T09:59:36.262 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-18T09:59:36.263 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-18T09:59:36.264 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-18T09:59:36.264 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-18T09:59:36.264 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-18T09:59:36.264 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-18T09:59:36.264 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-18T09:59:36.264 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-18T09:59:36.264 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-18T09:59:36.265 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-18T09:59:36.266 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-18T09:59:36.267 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-18T09:59:36.268 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-18T09:59:36.269 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 151/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-18T09:59:36.270 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-18T09:59:36.271 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-18T09:59:36.271 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-18T09:59:36.271 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-18T09:59:36.271 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-18T09:59:36.271 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-18T09:59:36.271 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-18T09:59:36.271 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-18T09:59:36.272 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-18T09:59:36.272 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-18T09:59:36.272 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-18T09:59:36.272 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-18T09:59:36.272 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-18T09:59:36.272 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-18T09:59:36.272 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-18T09:59:36.273 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-18T09:59:36.274 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-18T09:59:36.275 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-18T09:59:36.275 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-18T09:59:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-18T09:59:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 1/202 2024-02-18T09:59:38.344 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 2/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 3/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 4/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1555.g1c920 5/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 6/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 7/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 8/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 9/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 10/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 13/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 14/202 2024-02-18T09:59:38.345 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_ 15/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 17/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_6 18/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 19/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 20/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el 21/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.0.0-1555.g1c920afa.el9. 22/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_6 23/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 24/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 25/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 26/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 27/202 2024-02-18T09:59:38.346 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 28/202 2024-02-18T09:59:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 29/202 2024-02-18T09:59:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa. 30/202 2024-02-18T09:59:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 31/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 32/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 33/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el 34/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 35/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.e 36/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 37/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 38/202 2024-02-18T09:59:38.363 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 39/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-18T09:59:38.364 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-18T09:59:38.365 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-18T09:59:38.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-18T09:59:38.367 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-18T09:59:38.368 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-18T09:59:38.369 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-18T09:59:38.370 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-18T09:59:38.371 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 151/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-18T09:59:38.372 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-18T09:59:38.373 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-18T09:59:38.374 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-18T09:59:38.375 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:39.241 INFO:teuthology.orchestra.run.smithi118.stdout: acl-2.3.1-4.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.242 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.2-8.el9.noarch 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.7.4-5.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.243 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.244 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.245 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.4-9.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-16.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.246 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-18T09:59:39.247 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: lua-5.4.4-4.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-13.11-1.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-18T09:59:39.248 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-18T09:59:39.249 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-18T09:59:39.250 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-18T09:59:39.251 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-18T09:59:39.252 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-18T09:59:39.253 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-3.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-18T09:59:39.254 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-18T09:59:39.255 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-18T09:59:39.255 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:39.255 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-02-18T09:59:39.725 DEBUG:teuthology.parallel:result is None 2024-02-18T09:59:40.150 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 154/202 2024-02-18T09:59:40.205 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 155/202 2024-02-18T09:59:40.238 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 156/202 2024-02-18T09:59:40.293 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-18T09:59:40.579 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 158/202 2024-02-18T09:59:40.719 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-18T09:59:40.766 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 160/202 2024-02-18T09:59:40.818 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-18T09:59:40.873 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-18T09:59:40.975 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-18T09:59:41.025 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-18T09:59:41.071 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-18T09:59:41.099 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_ 166/202 2024-02-18T09:59:41.150 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-18T09:59:41.200 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-18T09:59:41.200 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-02-18T09:59:41.200 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: acl-2.3.1-4.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-18T09:59:41.201 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.202 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.203 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.204 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-18T09:59:41.205 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.6-16.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.206 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-18T09:59:41.207 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-13.11-1.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-18T09:59:41.208 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-18T09:59:41.209 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-18T09:59:41.210 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-18T09:59:41.211 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-18T09:59:41.212 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:41.213 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-3.el9.x86_64 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-02-18T09:59:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-18T09:59:41.378 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-18T09:59:41.418 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-18T09:59:41.841 DEBUG:teuthology.parallel:result is None 2024-02-18T09:59:42.498 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:42.549 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:42.604 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-18T09:59:43.966 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 172/202 2024-02-18T09:59:44.036 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-18T09:59:44.078 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-18T09:59:44.213 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-18T09:59:44.257 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-18T09:59:44.290 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-18T09:59:44.324 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-18T09:59:44.365 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-18T09:59:44.365 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-18T09:59:44.516 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-18T09:59:44.567 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-18T09:59:44.612 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-18T09:59:44.612 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-18T09:59:44.759 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-18T09:59:44.802 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-18T09:59:44.852 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-18T09:59:44.891 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-18T09:59:44.933 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-18T09:59:44.983 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-18T09:59:45.041 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-18T09:59:45.102 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-18T09:59:45.154 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-18T09:59:45.188 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-18T09:59:45.221 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-18T09:59:45.254 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-18T09:59:45.288 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-18T09:59:45.324 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:45.324 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:45.631 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-18T09:59:45.632 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-18T09:59:45.778 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-18T09:59:45.808 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-18T09:59:45.842 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-18T09:59:45.875 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-18T09:59:45.930 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-18T09:59:46.040 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-18T09:59:46.300 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-18T09:59:46.300 INFO:teuthology.orchestra.run.smithi204.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-18T09:59:46.300 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:50.930 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 1/202 2024-02-18T09:59:50.930 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 2/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 3/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 4/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1555.g1c920 5/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 6/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 7/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 8/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 9/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 10/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 11/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 12/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 13/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 14/202 2024-02-18T09:59:50.931 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_ 15/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 16/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 17/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_6 18/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86 19/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 20/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el 21/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:19.0.0-1555.g1c920afa.el9. 22/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_6 23/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 24/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 25/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 26/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 27/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 28/202 2024-02-18T09:59:50.932 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 29/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa. 30/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noa 31/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.n 32/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c9 33/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el 34/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 35/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.e 36/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 37/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 38/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 39/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-18T09:59:50.933 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-18T09:59:50.934 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-18T09:59:50.935 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-18T09:59:50.936 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-18T09:59:50.937 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-18T09:59:50.938 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-18T09:59:50.939 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-18T09:59:50.940 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 151/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 153/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-18T09:59:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-18T09:59:50.942 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-18T09:59:50.943 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-18T09:59:50.944 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-18T09:59:50.945 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-18T09:59:50.945 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-18T09:59:53.428 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-18T09:59:53.428 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:53.428 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: acl-2.3.1-4.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-18T09:59:53.429 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-18T09:59:53.430 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: automake-1.16.2-8.el9.noarch 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: bison-3.7.4-5.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.431 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.432 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-shell-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top-2:19.0.0-1555.g1c920afa.el9.noarch 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: flex-2.6.4-9.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: jq-1.6-16.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-18T09:59:53.433 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-18T09:59:53.434 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: lua-5.4.4-4.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-13.11-1.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-18T09:59:53.435 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-18T09:59:53.436 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-18T09:59:53.437 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2024-02-18T09:59:53.438 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-18T09:59:53.439 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-18T09:59:53.440 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:19.0.0-1555.g1c920afa.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-3.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:53.441 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-02-18T09:59:54.093 DEBUG:teuthology.parallel:result is None 2024-02-18T09:59:54.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1c920afa8316ea21877f3186850254947531ea22 2024-02-18T09:59:54.237 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-18T09:59:54.262 INFO:teuthology.orchestra.run.smithi118.stdout:19.0.0-1555.g1c920afa.el9 2024-02-18T09:59:54.263 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1555.g1c920afa.el9 2024-02-18T09:59:54.263 INFO:teuthology.task.install:The correct ceph version 19.0.0-1555.g1c920afa is installed. 2024-02-18T09:59:54.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1c920afa8316ea21877f3186850254947531ea22 2024-02-18T09:59:54.404 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-18T09:59:54.430 INFO:teuthology.orchestra.run.smithi164.stdout:19.0.0-1555.g1c920afa.el9 2024-02-18T09:59:54.431 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1555.g1c920afa.el9 2024-02-18T09:59:54.431 INFO:teuthology.task.install:The correct ceph version 19.0.0-1555.g1c920afa is installed. 2024-02-18T09:59:54.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1c920afa8316ea21877f3186850254947531ea22 2024-02-18T09:59:54.575 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-18T09:59:54.632 INFO:teuthology.orchestra.run.smithi204.stdout:19.0.0-1555.g1c920afa.el9 2024-02-18T09:59:54.632 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1555.g1c920afa.el9 2024-02-18T09:59:54.632 INFO:teuthology.task.install:The correct ceph version 19.0.0-1555.g1c920afa is installed. 2024-02-18T09:59:54.634 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-18T09:59:54.634 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:54.634 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-18T09:59:54.669 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:54.669 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-18T09:59:54.705 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:59:54.705 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-18T09:59:54.778 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-18T09:59:54.778 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:54.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-02-18T09:59:54.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-18T09:59:54.880 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:54.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-02-18T09:59:54.911 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-18T09:59:54.980 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:59:54.980 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-02-18T09:59:55.056 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-18T09:59:55.171 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-18T09:59:55.172 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:55.172 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-18T09:59:55.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-18T09:59:55.267 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:55.267 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-18T09:59:55.293 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-18T09:59:55.360 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:59:55.360 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-18T09:59:55.435 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-18T09:59:55.549 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-18T09:59:55.550 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:55.550 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-02-18T09:59:55.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-18T09:59:55.643 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:55.643 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-02-18T09:59:55.670 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-18T09:59:55.736 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:59:55.737 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-02-18T09:59:55.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-18T09:59:55.927 INFO:teuthology.run_tasks:Running task ceph... 2024-02-18T09:59:56.010 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-18T09:59:56.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2024-02-18T09:59:56.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-02-18T09:59:56.015 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-02-18T09:59:56.088 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-18T09:59:56.088 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-18T09:59:56.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-18T09:59:56.094 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-18T09:59:56.168 INFO:tasks.ceph:Creating extra log directories... 2024-02-18T09:59:56.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-18T09:59:56.172 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-18T09:59:56.174 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-18T09:59:56.249 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-18T09:59:56.249 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-18T09:59:56.249 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-18T09:59:56.250 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:56.250 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-18T09:59:56.264 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-18T09:59:56.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-18T09:59:56.410 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:56.410 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-18T09:59:56.425 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-18T09:59:56.543 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-18T09:59:56.570 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:59:56.570 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-18T09:59:56.611 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-18T09:59:56.826 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-18T09:59:56.901 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-18T09:59:56.902 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-18T09:59:56.902 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235', 'branch': 'wip-vshankar-testing-20240217.015652', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7564235', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240217.015652'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1c920afa8316ea21877f3186850254947531ea22'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1c920afa8316ea21877f3186850254947531ea22'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240217.015652', 'sha1': '1c920afa8316ea21877f3186850254947531ea22'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 218, 'sha1': '1c920afa8316ea21877f3186850254947531ea22', 'sleep_before_teardown': 0, 'subset': '793/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240217.015652', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1c920afa8316ea21877f3186850254947531ea22', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZioc6pa4+oz0XCTQljlJUduSe+1jIjC5Fd/aVbJThzKIigAJ8tMAY97unjHomM/Kr+lPwT2ZnhoHDwzJeFf6Y=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYQXOSdNYnapYj4jEuyCXlXEtYTzVQN5PHvDgwA3lbpsizkfA844XZUDsejkHpeA+WlFtFy6kA5uxDBmeYv/yo=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEmMb6FqGoyWzX8eSx4hpHjQmEenwlCRh7eo4G9jaP2v6LNgIXfax8fJXUI5J2v+9KwXG0HYZrjXDpQLedOwY7w='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1c920afa8316ea21877f3186850254947531ea22'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1c920afa8316ea21877f3186850254947531ea22', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-17_05:57:56', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-18T09:59:56.902 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-18T09:59:56.907 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-18T09:59:56.910 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-18T09:59:56.947 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2024-02-18T09:59:56.959 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-02-18T09:59:56.964 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-02-18T09:59:57.066 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:57.066 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-02-18T09:59:57.081 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-18T09:59:57.081 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-02-18T09:59:57.136 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-18T09:59:57.136 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:57.136 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-02-18T09:59:57.136 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:57.137 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:57.137 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-02-18 09:59:31.201967749 +0000 2024-02-18T09:59:57.137 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-02-18 09:56:07.731949472 +0000 2024-02-18T09:59:57.137 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-02-18 09:56:07.731949472 +0000 2024-02-18T09:59:57.137 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-02-18 09:56:07.731949472 +0000 2024-02-18T09:59:57.137 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-18T09:59:57.201 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-02-18T09:59:57.201 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-02-18T09:59:57.201 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000106213 s, 4.8 MB/s 2024-02-18T09:59:57.202 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-18T09:59:57.257 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 679 Links: 1 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-02-18 09:59:31.201967749 +0000 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-02-18 09:56:08.058942031 +0000 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-02-18 09:56:08.058942031 +0000 2024-02-18T09:59:57.313 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-02-18 09:56:08.058942031 +0000 2024-02-18T09:59:57.314 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-18T09:59:57.378 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-02-18T09:59:57.378 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-02-18T09:59:57.378 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.6254e-05 s, 5.3 MB/s 2024-02-18T09:59:57.380 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-18T09:59:57.435 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-02-18T09:59:57.489 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-02-18 09:59:31.202967727 +0000 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-02-18 09:56:08.401934225 +0000 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-02-18 09:56:08.401934225 +0000 2024-02-18T09:59:57.490 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-02-18 09:56:08.401934225 +0000 2024-02-18T09:59:57.490 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-18T09:59:57.555 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-02-18T09:59:57.555 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-02-18T09:59:57.556 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000102323 s, 5.0 MB/s 2024-02-18T09:59:57.557 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-18T09:59:57.612 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-02-18 09:59:31.202967727 +0000 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-02-18 09:56:08.736926601 +0000 2024-02-18T09:59:57.667 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-02-18 09:56:08.736926601 +0000 2024-02-18T09:59:57.668 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-02-18 09:56:08.736926601 +0000 2024-02-18T09:59:57.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-18T09:59:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-02-18T09:59:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-02-18T09:59:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000104565 s, 4.9 MB/s 2024-02-18T09:59:57.733 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-18T09:59:57.788 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-18T09:59:57.789 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:57.789 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-02-18T09:59:57.807 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-18T09:59:57.807 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-02-18T09:59:57.864 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-18T09:59:57.864 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:57.864 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 662 Links: 1 2024-02-18T09:59:57.864 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:57.864 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:57.864 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-02-18 09:59:33.868672971 +0000 2024-02-18T09:59:57.865 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-02-18 09:56:05.387608507 +0000 2024-02-18T09:59:57.865 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-02-18 09:56:05.387608507 +0000 2024-02-18T09:59:57.865 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-02-18 09:56:05.387608507 +0000 2024-02-18T09:59:57.865 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-18T09:59:57.932 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-02-18T09:59:57.932 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-02-18T09:59:57.932 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000194957 s, 2.6 MB/s 2024-02-18T09:59:57.934 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-18T09:59:57.992 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-02-18T09:59:58.048 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-18T09:59:58.048 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:58.049 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-02-18T09:59:58.049 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:58.049 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:58.049 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-02-18 09:59:33.868672971 +0000 2024-02-18T09:59:58.049 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-02-18 09:56:05.731602233 +0000 2024-02-18T09:59:58.049 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-02-18 09:56:05.731602233 +0000 2024-02-18T09:59:58.049 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-02-18 09:56:05.731602233 +0000 2024-02-18T09:59:58.049 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-18T09:59:58.116 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-02-18T09:59:58.116 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-02-18T09:59:58.117 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000196015 s, 2.6 MB/s 2024-02-18T09:59:58.118 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-18T09:59:58.175 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-02-18 09:59:33.869672953 +0000 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-02-18 09:56:06.077595922 +0000 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-02-18 09:56:06.077595922 +0000 2024-02-18T09:59:58.231 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-02-18 09:56:06.077595922 +0000 2024-02-18T09:59:58.232 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-18T09:59:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-02-18T09:59:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-02-18T09:59:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000276209 s, 1.9 MB/s 2024-02-18T09:59:58.299 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-18T09:59:58.356 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-02-18T09:59:58.411 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-18T09:59:58.411 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-18T09:59:58.411 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-02-18T09:59:58.411 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T09:59:58.411 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-02-18T09:59:58.412 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-02-18 09:59:33.869672953 +0000 2024-02-18T09:59:58.412 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-02-18 09:56:06.446589191 +0000 2024-02-18T09:59:58.412 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-02-18 09:56:06.446589191 +0000 2024-02-18T09:59:58.412 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-02-18 09:56:06.446589191 +0000 2024-02-18T09:59:58.412 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-18T09:59:58.477 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-02-18T09:59:58.477 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-02-18T09:59:58.477 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000187387 s, 2.7 MB/s 2024-02-18T09:59:58.478 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-18T09:59:58.534 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-18T09:59:58.534 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-18T09:59:58.534 INFO:tasks.ceph:Generating config... 2024-02-18T09:59:58.535 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-18T09:59:58.535 INFO:tasks.ceph:[client] debug client = 20 2024-02-18T09:59:58.535 INFO:tasks.ceph:[client] debug ms = 1 2024-02-18T09:59:58.535 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-18T09:59:58.536 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-18T09:59:58.536 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-02-18T09:59:58.536 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-18T09:59:58.536 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-18T09:59:58.537 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-18T09:59:58.537 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-18T09:59:58.537 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-18T09:59:58.537 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-18T09:59:58.537 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-18T09:59:58.537 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-18T09:59:58.538 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-18T09:59:58.538 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-18T09:59:58.538 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-18T09:59:58.538 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-18T09:59:58.538 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-18T09:59:58.538 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-18T09:59:58.538 INFO:tasks.ceph:Setting up mon.a... 2024-02-18T09:59:58.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-18T09:59:58.587 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.keyring 2024-02-18T09:59:58.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-18T09:59:58.634 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-18T09:59:58.701 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.118'), ('mon.b', '172.21.15.164'), ('mon.c', '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]')] 2024-02-18T09:59:58.701 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.118,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-18T09:59:58.702 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:58.702 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-18T09:59:58.756 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.118 --add b 172.21.15.164 --addv c '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: generated fsid 96fc967a-d47f-4a89-a97a-6d7920f41e97 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:setting min_mon_release = quincy 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 0 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:fsid 96fc967a-d47f-4a89-a97a-6d7920f41e97 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:last_changed 2024-02-18T09:59:58.838685+0000 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-02-18T09:59:58.838685+0000 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:min_mon_release 17 (quincy) 2024-02-18T09:59:58.840 INFO:teuthology.orchestra.run.smithi118.stdout:election_strategy: 1 2024-02-18T09:59:58.841 INFO:teuthology.orchestra.run.smithi118.stdout:0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.a 2024-02-18T09:59:58.841 INFO:teuthology.orchestra.run.smithi118.stdout:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-02-18T09:59:58.841 INFO:teuthology.orchestra.run.smithi118.stdout:2: [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] mon.c 2024-02-18T09:59:58.841 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-18T09:59:58.842 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-18T09:59:58.896 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 96fc967a-d47f-4a89-a97a-6d7920f41e97... 2024-02-18T09:59:58.897 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-18T09:59:58.939 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-18T09:59:58.942 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-18T09:59:58.987 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-02-18T09:59:58.987 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2024-02-18T09:59:58.987 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-18T09:59:58.987 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2024-02-18T09:59:58.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.987 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2024-02-18T09:59:58.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2024-02-18T09:59:58.989 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.118,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn min per osd = 0 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on skipped message = False 2024-02-18T09:59:58.990 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 96fc967a-d47f-4a89-a97a-6d7920f41e97 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2024-02-18T09:59:58.991 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug trim objects = true 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.992 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: bdev async discard = True 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: bdev enable discard = True 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore allocator = bitmap 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 1/20 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 4/10 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2024-02-18T09:59:58.993 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-02-18T09:59:58.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.995 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2024-02-18T09:59:58.996 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2024-02-18T09:59:58.997 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds balancer = 20 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-02-18T09:59:58.998 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-02-18T09:59:58.999 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-02-18T09:59:59.000 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.118,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-02-18T09:59:59.001 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn min per osd = 0 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 96fc967a-d47f-4a89-a97a-6d7920f41e97 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-02-18T09:59:59.002 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-02-18T09:59:59.003 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-02-18T09:59:59.004 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-02-18T09:59:59.005 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.006 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-02-18T09:59:59.007 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-02-18T09:59:59.008 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds balancer = 20 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2024-02-18T09:59:59.009 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-02-18T09:59:59.117 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-02-18T09:59:59.118 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-02-18T09:59:59.119 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.118,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn min per osd = 0 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on skipped message = False 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 96fc967a-d47f-4a89-a97a-6d7920f41e97 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-02-18T09:59:59.120 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.121 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-02-18T09:59:59.122 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-02-18T09:59:59.123 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-18T09:59:59.124 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2024-02-18T09:59:59.125 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2024-02-18T09:59:59.126 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2024-02-18T09:59:59.127 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2024-02-18T09:59:59.127 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2024-02-18T09:59:59.127 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2024-02-18T09:59:59.127 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2024-02-18T09:59:59.127 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2024-02-18T09:59:59.161 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-18T09:59:59.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-18T09:59:59.216 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-18T09:59:59.216 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:59.217 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-18T09:59:59.231 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:59.231 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-18T09:59:59.285 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T09:59:59.286 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:59.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-18T09:59:59.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-18T09:59:59.364 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T09:59:59.365 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-18T09:59:59.419 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T09:59:59.420 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:59.420 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-18T09:59:59.420 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-18T09:59:59.461 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T09:59:59.461 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-18T09:59:59.516 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-02-18T09:59:59.517 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:59:59.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-18T09:59:59.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-18T09:59:59.671 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T09:59:59.671 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-18T09:59:59.772 INFO:tasks.ceph:Setting up mon nodes... 2024-02-18T09:59:59.772 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-18T09:59:59.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-18T09:59:59.828 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-18T09:59:59.830 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-18T09:59:59.895 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-18T09:59:59.898 INFO:tasks.ceph:Setting up mds nodes... 2024-02-18T09:59:59.898 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-18T09:59:59.952 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-18T09:59:59.955 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-18T09:59:59.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-18T10:00:00.076 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-18T10:00:00.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-18T10:00:00.105 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-18T10:00:00.163 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-18T10:00:00.166 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-18T10:00:00.193 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-18T10:00:00.193 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-18T10:00:00.344 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-18T10:00:00.398 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-18T10:00:00.398 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-18T10:00:00.398 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-18T10:00:00.425 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:00.426 INFO:tasks.ceph:role: osd.0 2024-02-18T10:00:00.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T10:00:00.426 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-18T10:00:00.491 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:00.492 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:00.525 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-02-18T10:00:00.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-02-18T10:00:00.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-18T10:00:00.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-18T10:00:00.669 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-18T10:00:00.736 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:00.736 INFO:tasks.ceph:role: osd.1 2024-02-18T10:00:00.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T10:00:00.736 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:00.802 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:00.803 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:00.803 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:00.837 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-02-18T10:00:00.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-02-18T10:00:00.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-18T10:00:00.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-18T10:00:00.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-18T10:00:01.048 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:01.048 INFO:tasks.ceph:role: osd.2 2024-02-18T10:00:01.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T10:00:01.048 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-18T10:00:01.114 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:01.114 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:01.115 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:01.147 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-02-18T10:00:01.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-02-18T10:00:01.149 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-18T10:00:01.219 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-18T10:00:01.290 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-18T10:00:01.357 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:01.357 INFO:tasks.ceph:role: osd.3 2024-02-18T10:00:01.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T10:00:01.357 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:01.424 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:01.455 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-02-18T10:00:01.457 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-02-18T10:00:01.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-18T10:00:01.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-18T10:00:01.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:01.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:01.690+0000 7f165a549640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-18T10:00:01.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:01.691+0000 7f165a549640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-18T10:00:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:01.691+0000 7f165a549640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-18T10:00:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:01.691+0000 7f165a549640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-18T10:00:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:01.691+0000 7f165a549640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-18T10:00:01.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:01.691+0000 7f165a549640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-18T10:00:04.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-18T10:00:04.576 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:04.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:04.664+0000 7efdc7a9d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-18T10:00:04.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:04.664+0000 7efdc7a9d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-18T10:00:04.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:04.664+0000 7efdc7a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-18T10:00:04.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:04.664+0000 7efdc7a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-18T10:00:04.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:04.664+0000 7efdc7a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-18T10:00:04.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:04.665+0000 7efdc7a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-18T10:00:07.511 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-18T10:00:07.541 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:07.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:07.627+0000 7f111d8cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-18T10:00:07.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:07.627+0000 7f111d8cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-18T10:00:07.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:07.627+0000 7f111d8cc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-18T10:00:07.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:07.627+0000 7f111d8cc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-18T10:00:07.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:07.627+0000 7f111d8cc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-18T10:00:07.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:07.628+0000 7f111d8cc640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-18T10:00:10.474 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-18T10:00:10.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:10.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:10.595+0000 7fa3358c6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-18T10:00:10.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:10.595+0000 7fa3358c6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-18T10:00:10.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:10.595+0000 7fa3358c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-18T10:00:10.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:10.595+0000 7fa3358c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-18T10:00:10.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:10.595+0000 7fa3358c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-18T10:00:10.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:10.595+0000 7fa3358c6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-18T10:00:13.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-18T10:00:13.484 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-18T10:00:13.517 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:13.517 INFO:tasks.ceph:role: osd.4 2024-02-18T10:00:13.517 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T10:00:13.517 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-18T10:00:13.596 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:13.597 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:14.094 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-02-18T10:00:14.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-02-18T10:00:14.096 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-18T10:00:14.229 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-18T10:00:14.267 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-18T10:00:14.336 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:14.336 INFO:tasks.ceph:role: osd.5 2024-02-18T10:00:14.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T10:00:14.336 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-18T10:00:14.411 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:14.412 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:14.877 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-02-18T10:00:14.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-02-18T10:00:14.879 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-18T10:00:14.970 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-18T10:00:15.006 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-18T10:00:15.074 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:15.075 INFO:tasks.ceph:role: osd.6 2024-02-18T10:00:15.075 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T10:00:15.075 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-18T10:00:15.150 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:15.151 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:15.635 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-02-18T10:00:15.637 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-02-18T10:00:15.637 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-18T10:00:15.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-18T10:00:15.794 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-18T10:00:15.863 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-18T10:00:15.863 INFO:tasks.ceph:role: osd.7 2024-02-18T10:00:15.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T10:00:15.864 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-18T10:00:15.939 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-18T10:00:15.940 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-18T10:00:15.940 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-18T10:00:16.452 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-02-18T10:00:16.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-02-18T10:00:16.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-18T10:00:16.593 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-18T10:00:16.629 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:16.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:16.721+0000 7f3faf9bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-18T10:00:16.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:16.721+0000 7f3faf9bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-18T10:00:16.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:16.721+0000 7f3faf9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-18T10:00:16.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:16.721+0000 7f3faf9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-18T10:00:16.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:16.721+0000 7f3faf9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-18T10:00:16.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:16.722+0000 7f3faf9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-18T10:00:19.586 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-18T10:00:19.618 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:19.706+0000 7fddf360e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-18T10:00:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:19.706+0000 7fddf360e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-18T10:00:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:19.706+0000 7fddf360e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-18T10:00:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:19.706+0000 7fddf360e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-18T10:00:19.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:19.706+0000 7fddf360e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-18T10:00:19.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:19.707+0000 7fddf360e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-18T10:00:22.574 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-18T10:00:22.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:22.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:22.696+0000 7fd83621c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-18T10:00:22.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:22.696+0000 7fd83621c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-18T10:00:22.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:22.697+0000 7fd83621c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-18T10:00:22.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:22.697+0000 7fd83621c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-18T10:00:22.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:22.697+0000 7fd83621c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-18T10:00:22.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:22.697+0000 7fd83621c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-18T10:00:25.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-18T10:00:25.598 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:25.686+0000 7fca7f4a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-18T10:00:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:25.687+0000 7fca7f4a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-18T10:00:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:25.687+0000 7fca7f4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-18T10:00:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:25.687+0000 7fca7f4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-18T10:00:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:25.687+0000 7fca7f4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-18T10:00:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:25.687+0000 7fca7f4a4640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-18T10:00:26.904 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:00:26.907 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:00:26.909 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:00:28.552 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-18T10:00:28.584 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-18T10:00:28.584 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:28.584 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-18T10:00:28.616 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:28.616 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-18T10:00:28.687 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:28.687 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-18T10:00:28.756 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:28.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-18T10:00:28.824 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:28.824 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-18T10:00:28.892 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:28.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-18T10:00:28.960 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:28.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-18T10:00:29.028 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:29.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-18T10:00:29.060 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:29.061 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-18T10:00:29.130 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:29.130 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-18T10:00:29.199 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:29.199 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-18T10:00:29.268 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:29.268 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-18T10:00:29.337 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:29.337 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-18T10:00:29.405 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:00:29.405 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-18T10:00:29.462 INFO:tasks.ceph:Adding keys to all mons... 2024-02-18T10:00:29.462 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-18T10:00:29.464 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAf1dFl2jlJMRAADo3B6pLKJsxjgJy5Wjk6Kw== 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAf1dFlK8i4OBAAXyAQlEOhLk2JxG26TDjvMA== 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAg1dFln5KEBBAAPXVdsnZgh1+L7xmod1cy3w== 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2024-02-18T10:00:29.488 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAh1dFlUcU9KRAA2TQ9NJ/i+zoKpvdaM5UQ/g== 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAk1dFlIoSrJxAAgq4PFCxo4S4JcDOAdKBG5A== 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAn1dFlYqp5JRAAgLKJMl6dVqVrmdPiP/61iw== 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAq1dFlx7aIIxAAhIetQzGpdgRooeZMK/ntnQ== 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAf1dFlrTFTNRAArepKos3n7/2awmgj1vjjbg== 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAg1dFlaZ2rCRAAjoLyp5IMWyzQITIFoWfxNQ== 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAw1dFl+iUQKxAAMd711I16qWMRcc0MC8jr3Q== 2024-02-18T10:00:29.489 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2024-02-18T10:00:29.490 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAz1dFliSItKhAAYAKyR5+7k/6hOQhhJx/t9A== 2024-02-18T10:00:29.490 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2024-02-18T10:00:29.490 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA21dFllJeWKRAAvn/73gtTX5CEB2la4Mulhg== 2024-02-18T10:00:29.490 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2024-02-18T10:00:29.490 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA51dFlXuD+KBAA/BgFoqTKXewad426bvBp4g== 2024-02-18T10:00:29.490 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-02-18T10:00:29.490 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAg1dFl2zJ1FBAAQcxOcwyOcAlkdfSHOaIsTw== 2024-02-18T10:00:29.491 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2024-02-18T10:00:29.491 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAf1dFl2jlJMRAADo3B6pLKJsxjgJy5Wjk6Kw== 2024-02-18T10:00:29.491 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-02-18T10:00:29.491 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAf1dFlK8i4OBAAXyAQlEOhLk2JxG26TDjvMA== 2024-02-18T10:00:29.491 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2024-02-18T10:00:29.491 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAg1dFln5KEBBAAPXVdsnZgh1+L7xmod1cy3w== 2024-02-18T10:00:29.491 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAh1dFlUcU9KRAA2TQ9NJ/i+zoKpvdaM5UQ/g== 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAk1dFlIoSrJxAAgq4PFCxo4S4JcDOAdKBG5A== 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAn1dFlYqp5JRAAgLKJMl6dVqVrmdPiP/61iw== 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAq1dFlx7aIIxAAhIetQzGpdgRooeZMK/ntnQ== 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAf1dFlrTFTNRAArepKos3n7/2awmgj1vjjbg== 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAg1dFlaZ2rCRAAjoLyp5IMWyzQITIFoWfxNQ== 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAw1dFl+iUQKxAAMd711I16qWMRcc0MC8jr3Q== 2024-02-18T10:00:29.492 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2024-02-18T10:00:29.493 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAz1dFliSItKhAAYAKyR5+7k/6hOQhhJx/t9A== 2024-02-18T10:00:29.493 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2024-02-18T10:00:29.493 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQA21dFllJeWKRAAvn/73gtTX5CEB2la4Mulhg== 2024-02-18T10:00:29.493 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2024-02-18T10:00:29.493 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQA51dFlXuD+KBAA/BgFoqTKXewad426bvBp4g== 2024-02-18T10:00:29.493 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-02-18T10:00:29.493 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQAg1dFl2zJ1FBAAQcxOcwyOcAlkdfSHOaIsTw== 2024-02-18T10:00:29.494 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-18T10:00:29.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-18T10:00:29.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-18T10:00:29.589 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-18T10:00:29.643 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-18T10:00:29.646 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-18T10:00:29.700 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.756 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.811 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.864 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:29.915 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-18T10:00:29.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-18T10:00:29.968 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-18T10:00:29.970 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-18T10:00:30.024 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.027 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.080 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.082 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.133 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.135 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.188 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.190 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-18T10:00:30.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-18T10:00:30.243 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-18T10:00:30.299 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-18T10:00:30.299 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-18T10:00:30.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-18T10:00:30.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-18T10:00:30.448 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-18T10:00:30.475 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-18T10:00:30.572 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-18T10:00:30.599 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-18T10:00:30.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-18T10:00:30.762 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-18T10:00:30.789 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:30.791 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-18T10:00:30.844 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-18T10:00:30.844 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-18T10:00:30.844 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-18T10:00:30.847 INFO:tasks.ceph.mon.a:Started 2024-02-18T10:00:30.847 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-18T10:00:30.847 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-18T10:00:30.886 INFO:tasks.ceph.mon.b:Started 2024-02-18T10:00:30.887 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-18T10:00:30.887 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-18T10:00:30.889 INFO:tasks.ceph.mon.c:Started 2024-02-18T10:00:30.889 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-18T10:00:30.889 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-18T10:00:30.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-18T10:00:30.891 INFO:tasks.ceph.mgr.y:Started 2024-02-18T10:00:30.891 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-18T10:00:30.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-18T10:00:30.894 INFO:tasks.ceph.mgr.x:Started 2024-02-18T10:00:30.894 INFO:tasks.ceph:Setting crush tunables to default 2024-02-18T10:00:30.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd crush tunables default 2024-02-18T10:00:30.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.992+0000 7fecbd90c640 1 Processor -- start 2024-02-18T10:00:30.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.992+0000 7fecbd90c640 1 -- start start 2024-02-18T10:00:30.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.993+0000 7fecbd90c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7fecb80b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:30.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.993+0000 7fecbd90c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb814d9a0 con 0x7fecb80ba970 2024-02-18T10:00:30.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.993+0000 7fecbd90c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb814d090 con 0x7fecb80ba550 2024-02-18T10:00:30.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.993+0000 7fecbd90c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b5c40 con 0x7fecb80b5320 2024-02-18T10:00:30.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.993+0000 7fecb77fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fecb80ba970 0x7fecb81543c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45556/0 (socket says 172.21.15.118:45556) 2024-02-18T10:00:30.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.993+0000 7fecb77fe640 1 -- 172.21.15.118:0/2372239867 learned_addr learned my addr 172.21.15.118:0/2372239867 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:30.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.993+0000 7fecb6ffd640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7fecb80b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:30.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.994+0000 7fecb6ffd640 1 -- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 msgr2=0x7fecb80b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-18T10:00:30.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.994+0000 7fecb6ffd640 1 -- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 msgr2=0x7fecb80b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-18T10:00:30.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.994+0000 7fecb6ffd640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7fecb80b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-18T10:00:30.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:30.994+0000 7fecb6ffd640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7fecb80b5700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-18T10:00:31.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.168+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266283219 0 0) 0x7fecb814d9a0 con 0x7fecb80ba970 2024-02-18T10:00:31.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.168+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca0003520 con 0x7fecb80ba970 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3491865724 0 0) 0x7feca0003520 con 0x7fecb80ba970 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 msgr2=0x7fecb80b5700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7fecb80b5700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 >> v1:172.21.15.164:6789/0 conn(0x7fecb80ba550 legacy=0x7fecb81438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb814d350 con 0x7fecb80ba970 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fecb00019f0 con 0x7fecb80ba970 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 >> v1:172.21.15.118:6789/0 conn(0x7fecb80ba970 legacy=0x7fecb81543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00039a0 0x7feca0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7feca00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7feca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca000bb10 con 0x7feca0004d00 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca000bc50 con 0x7feca00039a0 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca000bde0 con 0x7fecb80b5320 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb77fe640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7feca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb6ffd640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00039a0 0x7feca0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb67fc640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7feca00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb77fe640 1 -- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 msgr2=0x7feca00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb77fe640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb80b5320 0x7feca00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb77fe640 1 -- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00039a0 msgr2=0x7feca0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb77fe640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feca00039a0 0x7feca0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.169+0000 7fecb77fe640 1 -- 172.21.15.118:0/2372239867 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0003520 con 0x7feca0004d00 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.170+0000 7fecb77fe640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7feca0005180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fecb000a830 tx=0x7feca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c5c9e66b800863 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.170+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb00072d0 con 0x7feca0004d00 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.170+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb002f070 con 0x7feca0004d00 2024-02-18T10:00:31.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.170+0000 7fecb5ffb640 1 -- 172.21.15.118:0/2372239867 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb00076b0 con 0x7feca0004d00 2024-02-18T10:00:31.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.171+0000 7fecbd90c640 1 -- 172.21.15.118:0/2372239867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 msgr2=0x7feca0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.171+0000 7fecbd90c640 1 --2- 172.21.15.118:0/2372239867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7feca0005180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fecb000a830 tx=0x7feca00057f0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.171+0000 7fecb77fe640 1 -- 172.21.15.118:0/2372239867 reap_dead start 2024-02-18T10:00:31.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.171+0000 7fecbd90c640 1 -- 172.21.15.118:0/2372239867 shutdown_connections 2024-02-18T10:00:31.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.171+0000 7fecbd90c640 1 -- 172.21.15.118:0/2372239867 >> 172.21.15.118:0/2372239867 conn(0x7fecb80a11c0 msgr2=0x7fecb80a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:31.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.171+0000 7fecbd90c640 1 -- 172.21.15.118:0/2372239867 shutdown_connections 2024-02-18T10:00:31.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.171+0000 7fecbd90c640 1 -- 172.21.15.118:0/2372239867 wait complete. 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.172+0000 7fecbd90c640 1 Processor -- start 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.172+0000 7fecbd90c640 1 -- start start 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecbd90c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7fecb813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecbd90c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb814c960 0x7fecb81e07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecbd90c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb81e0d10 0x7fecb813a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecbd90c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8140050 con 0x7feca0004d00 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecbd90c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80beff0 con 0x7fecb814c960 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecbd90c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb81e1190 con 0x7fecb81e0d10 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7fecb813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7fecb813fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47320/0 (socket says 172.21.15.118:47320) 2024-02-18T10:00:31.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 -- 172.21.15.118:0/3113772401 learned_addr learned my addr 172.21.15.118:0/3113772401 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb67fc640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb814c960 0x7fecb81e07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb77fe640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb81e0d10 0x7fecb813a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 -- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb81e0d10 msgr2=0x7fecb813a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb81e0d10 0x7fecb813a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 -- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb814c960 msgr2=0x7fecb81e07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb814c960 0x7fecb81e07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 -- 172.21.15.118:0/3113772401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80b6a40 con 0x7feca0004d00 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.173+0000 7fecb6ffd640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7fecb813fb10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fecac014aa0 tx=0x7fecac014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.174+0000 7fec9ffff640 1 -- 172.21.15.118:0/3113772401 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac009ba0 con 0x7feca0004d00 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.174+0000 7fec9ffff640 1 -- 172.21.15.118:0/3113772401 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac015040 con 0x7feca0004d00 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.174+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb814ad20 con 0x7feca0004d00 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.174+0000 7fec9ffff640 1 -- 172.21.15.118:0/3113772401 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac01b410 con 0x7feca0004d00 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.174+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80bed10 con 0x7feca0004d00 2024-02-18T10:00:31.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.174+0000 7fec9ffff640 1 -- 172.21.15.118:0/3113772401 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fecac01b570 con 0x7feca0004d00 2024-02-18T10:00:31.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.175+0000 7fec9ffff640 1 -- 172.21.15.118:0/3113772401 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fecac025950 con 0x7feca0004d00 2024-02-18T10:00:31.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.175+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb8075150 con 0x7feca0004d00 2024-02-18T10:00:31.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.178+0000 7fec9ffff640 1 -- 172.21.15.118:0/3113772401 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fecac025460 con 0x7feca0004d00 2024-02-18T10:00:31.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.243+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fecb8074af0 con 0x7feca0004d00 2024-02-18T10:00:31.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.245+0000 7fec9ffff640 1 -- 172.21.15.118:0/3113772401 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fecac025b60 con 0x7feca0004d00 2024-02-18T10:00:31.248 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2024-02-18T10:00:31.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 msgr2=0x7fecb813fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7fecb813fb10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fecac014aa0 tx=0x7fecac014ea0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 shutdown_connections 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fecb81e0d10 0x7fecb813a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecb814c960 0x7fecb81e07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 --2- 172.21.15.118:0/3113772401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca0004d00 0x7fecb813fb10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 >> 172.21.15.118:0/3113772401 conn(0x7fecb80a11c0 msgr2=0x7fecb8142a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 shutdown_connections 2024-02-18T10:00:31.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:31.246+0000 7fecbd90c640 1 -- 172.21.15.118:0/3113772401 wait complete. 2024-02-18T10:00:31.260 INFO:tasks.ceph:check_enable_crimson: False 2024-02-18T10:00:31.260 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-18T10:00:31.260 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:31.260 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-18T10:00:31.286 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:31.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-18T10:00:31.353 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:31.354 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-18T10:00:31.421 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-02-18T10:00:31.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-18T10:00:31.488 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:31.488 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-18T10:00:31.517 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:31.517 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-18T10:00:31.584 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:31.584 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-18T10:00:31.627 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:31.624+0000 7f481a050040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-18T10:00:31.645 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:31.643+0000 7fa6cddd7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-18T10:00:31.652 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-02-18T10:00:31.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-18T10:00:31.683 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:31.680+0000 7f481a050040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-18T10:00:31.698 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:31.696+0000 7fa6cddd7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-18T10:00:31.709 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new c1037ff2-f634-40ec-b542-0cf47fac647c 0 2024-02-18T10:00:31.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.847+0000 7f900a664640 1 Processor -- start 2024-02-18T10:00:31.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.847+0000 7f900a664640 1 -- start start 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f900a664640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9004150410 0x7f90041508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f900a664640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90040bab00 0x7f90040baf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f900a664640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9004072b60 con 0x7f900414d880 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f900a664640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900406c550 con 0x7f9004150410 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f900a664640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9004150de0 con 0x7f90040bab00 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f9003fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f900414d880 0x7f90040b9fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:53576/0 (socket says 172.21.15.164:53576) 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f9003fff640 1 -- 172.21.15.164:0/3620384577 learned_addr learned my addr 172.21.15.164:0/3620384577 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f90037fe640 1 --2- 172.21.15.164:0/3620384577 >> v2:172.21.15.118:3300/0 conn(0x7f9004150410 0x7f90041508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f9008c01640 1 --2- 172.21.15.164:0/3620384577 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90040bab00 0x7f90040baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.848+0000 7f9002ffd640 1 -- 172.21.15.164:0/3620384577 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958383955 0 0) 0x7f9004072b60 con 0x7f900414d880 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f9002ffd640 1 -- 172.21.15.164:0/3620384577 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fec003520 con 0x7f900414d880 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f9008c01640 1 -- 172.21.15.164:0/3620384577 >> v2:172.21.15.118:3300/0 conn(0x7f9004150410 msgr2=0x7f90041508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f9008c01640 1 --2- 172.21.15.164:0/3620384577 >> v2:172.21.15.118:3300/0 conn(0x7f9004150410 0x7f90041508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f9008c01640 1 -- 172.21.15.164:0/3620384577 >> v1:172.21.15.164:6789/0 conn(0x7f900414d880 legacy=0x7f90040b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f9008c01640 1 -- 172.21.15.164:0/3620384577 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90040ba6c0 con 0x7f90040bab00 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f90037fe640 1 --2- 172.21.15.164:0/3620384577 >> v2:172.21.15.118:3300/0 conn(0x7f9004150410 0x7f90041508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f9008c01640 1 --2- 172.21.15.164:0/3620384577 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90040bab00 0x7f90040baf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009d90 tx=0x7f8ffc02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a6a3b2e9eff9c57 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.849+0000 7f9002ffd640 1 -- 172.21.15.164:0/3620384577 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc02cce0 con 0x7f90040bab00 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f9002ffd640 1 -- 172.21.15.164:0/3620384577 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc02ce40 con 0x7f90040bab00 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f9002ffd640 1 -- 172.21.15.164:0/3620384577 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc034660 con 0x7f90040bab00 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 -- 172.21.15.164:0/3620384577 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90040bab00 msgr2=0x7f90040baf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 --2- 172.21.15.164:0/3620384577 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90040bab00 0x7f90040baf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009d90 tx=0x7f8ffc02bf30 comp rx=0 tx=0).stop 2024-02-18T10:00:31.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 -- 172.21.15.164:0/3620384577 shutdown_connections 2024-02-18T10:00:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 --2- 172.21.15.164:0/3620384577 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90040bab00 0x7f90040baf50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 --2- 172.21.15.164:0/3620384577 >> v2:172.21.15.118:3300/0 conn(0x7f9004150410 0x7f90041508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 -- 172.21.15.164:0/3620384577 >> 172.21.15.164:0/3620384577 conn(0x7f90040a11c0 msgr2=0x7f90040a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 -- 172.21.15.164:0/3620384577 shutdown_connections 2024-02-18T10:00:31.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.850+0000 7f900a664640 1 -- 172.21.15.164:0/3620384577 wait complete. 2024-02-18T10:00:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.851+0000 7f900a664640 1 Processor -- start 2024-02-18T10:00:31.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.851+0000 7f900a664640 1 -- start start 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f900a664640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90040bab00 0x7f900414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f900a664640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900414d880 0x7f90040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f900a664640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9004150410 0x7f90041e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f900a664640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900414fff0 con 0x7f90040bab00 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f900a664640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041e5a90 con 0x7f900414d880 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f900a664640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900414e470 con 0x7f9004150410 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900414d880 0x7f90040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f9008c01640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9004150410 0x7f90041e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900414d880 0x7f90040b71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55360/0 (socket says 172.21.15.164:55360) 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 -- 172.21.15.164:0/992900962 learned_addr learned my addr 172.21.15.164:0/992900962 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f9003fff640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90040bab00 0x7f900414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:31.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 -- 172.21.15.164:0/992900962 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9004150410 msgr2=0x7f90041e5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9004150410 0x7f90041e5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 -- 172.21.15.164:0/992900962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90040bab00 msgr2=0x7f900414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90040bab00 0x7f900414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f90037fe640 1 -- 172.21.15.164:0/992900962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff4009400 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.852+0000 7f9003fff640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90040bab00 0x7f900414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f90037fe640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900414d880 0x7f90040b71b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400e960 tx=0x7f8ff400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f9000ff9640 1 -- 172.21.15.164:0/992900962 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff400ca00 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f9000ff9640 1 -- 172.21.15.164:0/992900962 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff400cb60 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc009a70 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f9000ff9640 1 -- 172.21.15.164:0/992900962 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4013470 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90040b6900 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f9000ff9640 1 -- 172.21.15.164:0/992900962 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8ff4005990 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.853+0000 7f9000ff9640 1 -- 172.21.15.164:0/992900962 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8ff4013910 con 0x7f900414d880 2024-02-18T10:00:31.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.854+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90041e58e0 con 0x7f900414d880 2024-02-18T10:00:31.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.856+0000 7f9000ff9640 1 -- 172.21.15.164:0/992900962 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8ff4021060 con 0x7f900414d880 2024-02-18T10:00:31.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.928+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1037ff2-f634-40ec-b542-0cf47fac647c", "id": 0} v 0) v1 -- 0x7f9004075150 con 0x7f900414d880 2024-02-18T10:00:31.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.934+0000 7f9000ff9640 1 -- 172.21.15.164:0/992900962 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1037ff2-f634-40ec-b542-0cf47fac647c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ff4017070 con 0x7f900414d880 2024-02-18T10:00:31.936 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900414d880 msgr2=0x7f90040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900414d880 0x7f90040b71b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400e960 tx=0x7f8ff400ee20 comp rx=0 tx=0).stop 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 shutdown_connections 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9004150410 0x7f90041e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f900414d880 0x7f90040b71b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 --2- 172.21.15.164:0/992900962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90040bab00 0x7f900414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 >> 172.21.15.164:0/992900962 conn(0x7f90040a11c0 msgr2=0x7f9004146e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 shutdown_connections 2024-02-18T10:00:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:31.935+0000 7f900a664640 1 -- 172.21.15.164:0/992900962 wait complete. 2024-02-18T10:00:31.952 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 9411247d-c4cb-4f99-a9cc-a10cabe38c6c 1 2024-02-18T10:00:32.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.050+0000 7f5974dd0640 1 Processor -- start 2024-02-18T10:00:32.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.050+0000 7f5974dd0640 1 -- start start 2024-02-18T10:00:32.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.050+0000 7f5974dd0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f59700bce00 0x7f59701493a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.050+0000 7f5974dd0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f59700b2e30 0x7f59700b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f5974dd0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f597006bcf0 0x7f59700b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f5974dd0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59700ba000 con 0x7f597006bcf0 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f5974dd0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59700bd1e0 con 0x7f59700b2e30 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f5974dd0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5970148f10 con 0x7f59700bce00 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596dd9b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f59700b2e30 0x7f59700b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596e59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f59700bce00 0x7f59701493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596dd9b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f59700b2e30 0x7f59700b8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55372/0 (socket says 172.21.15.164:55372) 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596dd9b640 1 -- 172.21.15.164:0/3934562675 learned_addr learned my addr 172.21.15.164:0/3934562675 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596ed9d640 1 --2- 172.21.15.164:0/3934562675 >> v2:172.21.15.118:3300/0 conn(0x7f597006bcf0 0x7f59700b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596e59c640 1 -- 172.21.15.164:0/3934562675 >> v2:172.21.15.164:3300/0 conn(0x7f59700b2e30 msgr2=0x7f59700b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596e59c640 1 --2- 172.21.15.164:0/3934562675 >> v2:172.21.15.164:3300/0 conn(0x7f59700b2e30 0x7f59700b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596e59c640 1 -- 172.21.15.164:0/3934562675 >> v2:172.21.15.118:3300/0 conn(0x7f597006bcf0 msgr2=0x7f59700b8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596e59c640 1 --2- 172.21.15.164:0/3934562675 >> v2:172.21.15.118:3300/0 conn(0x7f597006bcf0 0x7f59700b8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596e59c640 1 -- 172.21.15.164:0/3934562675 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970066cd0 con 0x7f59700bce00 2024-02-18T10:00:32.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.051+0000 7f596dd9b640 1 --2- 172.21.15.164:0/3934562675 >> v2:172.21.15.164:3300/0 conn(0x7f59700b2e30 0x7f59700b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:32.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.052+0000 7f596e59c640 1 --2- 172.21.15.164:0/3934562675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f59700bce00 0x7f59701493a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f59700bafd0 tx=0x7f596002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de556f99fcd18510 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.052+0000 7f596d59a640 1 -- 172.21.15.164:0/3934562675 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596002e070 con 0x7f59700bce00 2024-02-18T10:00:32.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.052+0000 7f596d59a640 1 -- 172.21.15.164:0/3934562675 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59600315a0 con 0x7f59700bce00 2024-02-18T10:00:32.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.052+0000 7f596d59a640 1 -- 172.21.15.164:0/3934562675 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960031930 con 0x7f59700bce00 2024-02-18T10:00:32.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.052+0000 7f5974dd0640 1 -- 172.21.15.164:0/3934562675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f59700bce00 msgr2=0x7f59701493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.052+0000 7f5974dd0640 1 --2- 172.21.15.164:0/3934562675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f59700bce00 0x7f59701493a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f59700bafd0 tx=0x7f596002b840 comp rx=0 tx=0).stop 2024-02-18T10:00:32.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.053+0000 7f5974dd0640 1 -- 172.21.15.164:0/3934562675 shutdown_connections 2024-02-18T10:00:32.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.053+0000 7f5974dd0640 1 --2- 172.21.15.164:0/3934562675 >> v2:172.21.15.118:3300/0 conn(0x7f597006bcf0 0x7f59700b8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.053+0000 7f5974dd0640 1 --2- 172.21.15.164:0/3934562675 >> v2:172.21.15.164:3300/0 conn(0x7f59700b2e30 0x7f59700b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.053+0000 7f5974dd0640 1 --2- 172.21.15.164:0/3934562675 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f59700bce00 0x7f59701493a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.053+0000 7f5974dd0640 1 -- 172.21.15.164:0/3934562675 >> 172.21.15.164:0/3934562675 conn(0x7f59700ba3c0 msgr2=0x7f59700ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.053+0000 7f5974dd0640 1 -- 172.21.15.164:0/3934562675 shutdown_connections 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.053+0000 7f5974dd0640 1 -- 172.21.15.164:0/3934562675 wait complete. 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.054+0000 7f5974dd0640 1 Processor -- start 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.054+0000 7f5974dd0640 1 -- start start 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597006bcf0 0x7f597009c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59700b2e30 0x7f59700b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59700bce00 0x7f59700a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597009c510 con 0x7f59700bce00 2024-02-18T10:00:32.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597009a070 con 0x7f59700b2e30 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700b55c0 con 0x7f597006bcf0 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596e59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597006bcf0 0x7f597009c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596dd9b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59700b2e30 0x7f59700b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596e59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597006bcf0 0x7f597009c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44490/0 (socket says 172.21.15.164:44490) 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596e59c640 1 -- 172.21.15.164:0/919699095 learned_addr learned my addr 172.21.15.164:0/919699095 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596ed9d640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59700bce00 0x7f59700a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596dd9b640 1 -- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597006bcf0 msgr2=0x7f597009c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596dd9b640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597006bcf0 0x7f597009c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596dd9b640 1 -- 172.21.15.164:0/919699095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59700bce00 msgr2=0x7f59700a2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596dd9b640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59700bce00 0x7f59700a2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596dd9b640 1 -- 172.21.15.164:0/919699095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640094d0 con 0x7f59700b2e30 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596e59c640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597006bcf0 0x7f597009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596ed9d640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59700bce00 0x7f59700a2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f596dd9b640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59700b2e30 0x7f59700b68a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f596400e930 tx=0x7f596400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f595effd640 1 -- 172.21.15.164:0/919699095 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596400ca00 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f595effd640 1 -- 172.21.15.164:0/919699095 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596400cb60 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5960009400 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f595effd640 1 -- 172.21.15.164:0/919699095 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964004030 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.055+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597009e850 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.056+0000 7f595effd640 1 -- 172.21.15.164:0/919699095 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5964003610 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.056+0000 7f595effd640 1 -- 172.21.15.164:0/919699095 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5964013c80 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.056+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59700b5ae0 con 0x7f59700b2e30 2024-02-18T10:00:32.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.058+0000 7f595effd640 1 -- 172.21.15.164:0/919699095 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f59700b5ae0 con 0x7f59700b2e30 2024-02-18T10:00:32.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.131+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9411247d-c4cb-4f99-a9cc-a10cabe38c6c", "id": 1} v 0) v1 -- 0x7f597009c650 con 0x7f59700b2e30 2024-02-18T10:00:32.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.139+0000 7f595effd640 1 -- 172.21.15.164:0/919699095 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9411247d-c4cb-4f99-a9cc-a10cabe38c6c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f597009c650 con 0x7f59700b2e30 2024-02-18T10:00:32.141 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-02-18T10:00:32.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59700b2e30 msgr2=0x7f59700b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59700b2e30 0x7f59700b68a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f596400e930 tx=0x7f596400edf0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 shutdown_connections 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59700bce00 0x7f59700a2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f59700b2e30 0x7f59700b68a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 --2- 172.21.15.164:0/919699095 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f597006bcf0 0x7f597009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 >> 172.21.15.164:0/919699095 conn(0x7f59700ba3c0 msgr2=0x7f59700b8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 shutdown_connections 2024-02-18T10:00:32.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.140+0000 7f5974dd0640 1 -- 172.21.15.164:0/919699095 wait complete. 2024-02-18T10:00:32.153 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 5d278b57-76cc-404b-aa94-6b9a71ea914d 2 2024-02-18T10:00:32.200 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.197+0000 7fa6cddd7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-18T10:00:32.241 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.239+0000 7f481a050040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-18T10:00:32.253 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.250+0000 7fa6cddd7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-18T10:00:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bbde6d640 1 Processor -- start 2024-02-18T10:00:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bbde6d640 1 -- start start 2024-02-18T10:00:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bbde6d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7bb806dac0 0x7f7bb8070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bbde6d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7bb80ba2a0 0x7f7bb8145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bbde6d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80a1950 con 0x7f7bb81464f0 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bbde6d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb8072830 con 0x7f7bb806dac0 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bbde6d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb8071d50 con 0x7f7bb80ba2a0 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bb6ffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7bb80ba2a0 0x7f7bb8145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bb6ffd640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7bb80ba2a0 0x7f7bb8145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55390/0 (socket says 172.21.15.164:55390) 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bb6ffd640 1 -- 172.21.15.164:0/3439408909 learned_addr learned my addr 172.21.15.164:0/3439408909 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.251+0000 7f7bb77fe640 1 --2- 172.21.15.164:0/3439408909 >> v2:172.21.15.118:3300/0 conn(0x7f7bb806dac0 0x7f7bb8070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.252+0000 7f7bb6ffd640 1 -- 172.21.15.164:0/3439408909 >> v2:172.21.15.118:3300/0 conn(0x7f7bb806dac0 msgr2=0x7f7bb8070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:32.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.252+0000 7f7bb6ffd640 1 --2- 172.21.15.164:0/3439408909 >> v2:172.21.15.118:3300/0 conn(0x7f7bb806dac0 0x7f7bb8070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.252+0000 7f7bb6ffd640 1 -- 172.21.15.164:0/3439408909 >> v1:172.21.15.118:6789/0 conn(0x7f7bb81464f0 legacy=0x7f7bb8148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.252+0000 7f7bb6ffd640 1 -- 172.21.15.164:0/3439408909 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8072030 con 0x7f7bb80ba2a0 2024-02-18T10:00:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.252+0000 7f7bb6ffd640 1 --2- 172.21.15.164:0/3439408909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80ba2a0 0x7f7bb8145fb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7bb806e430 tx=0x7f7bac02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14fcafe0df0b5138 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bb67fc640 1 -- 172.21.15.164:0/3439408909 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac030860 con 0x7f7bb80ba2a0 2024-02-18T10:00:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bb67fc640 1 -- 172.21.15.164:0/3439408909 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac0309c0 con 0x7f7bb80ba2a0 2024-02-18T10:00:32.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bb67fc640 1 -- 172.21.15.164:0/3439408909 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac030d50 con 0x7f7bb80ba2a0 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 -- 172.21.15.164:0/3439408909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80ba2a0 msgr2=0x7f7bb8145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 --2- 172.21.15.164:0/3439408909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80ba2a0 0x7f7bb8145fb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7bb806e430 tx=0x7f7bac02b9a0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 -- 172.21.15.164:0/3439408909 shutdown_connections 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 --2- 172.21.15.164:0/3439408909 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb80ba2a0 0x7f7bb8145fb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 --2- 172.21.15.164:0/3439408909 >> v2:172.21.15.118:3300/0 conn(0x7f7bb806dac0 0x7f7bb8070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 -- 172.21.15.164:0/3439408909 >> 172.21.15.164:0/3439408909 conn(0x7f7bb80be420 msgr2=0x7f7bb80be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 -- 172.21.15.164:0/3439408909 shutdown_connections 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.253+0000 7f7bbde6d640 1 -- 172.21.15.164:0/3439408909 wait complete. 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.254+0000 7f7bbde6d640 1 Processor -- start 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.254+0000 7f7bbde6d640 1 -- start start 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bbde6d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb806dac0 0x7f7bb809e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bbde6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb80ba2a0 0x7f7bb8147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bbde6d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb81464f0 0x7f7bb80a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bbde6d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8147bb0 con 0x7f7bb80ba2a0 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bbde6d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80a0280 con 0x7f7bb806dac0 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bbde6d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb809ed90 con 0x7f7bb81464f0 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb806dac0 0x7f7bb809e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb806dac0 0x7f7bb809e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55404/0 (socket says 172.21.15.164:55404) 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 -- 172.21.15.164:0/4167000846 learned_addr learned my addr 172.21.15.164:0/4167000846 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb7fff640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb81464f0 0x7f7bb80a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb6ffd640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb80ba2a0 0x7f7bb8147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 -- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb81464f0 msgr2=0x7f7bb80a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb81464f0 0x7f7bb80a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 -- 172.21.15.164:0/4167000846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb80ba2a0 msgr2=0x7f7bb8147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb80ba2a0 0x7f7bb8147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb77fe640 1 -- 172.21.15.164:0/4167000846 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac0094d0 con 0x7f7bb806dac0 2024-02-18T10:00:32.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.255+0000 7f7bb7fff640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb81464f0 0x7f7bb80a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7bb77fe640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb806dac0 0x7f7bb809e2b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e9e0 tx=0x7f7ba800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7b9ffff640 1 -- 172.21.15.164:0/4167000846 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8009670 con 0x7f7bb806dac0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7b9ffff640 1 -- 172.21.15.164:0/4167000846 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba800c9d0 con 0x7f7bb806dac0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb809f070 con 0x7f7bb806dac0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7b9ffff640 1 -- 172.21.15.164:0/4167000846 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800cd80 con 0x7f7bb806dac0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb80a09f0 con 0x7f7bb806dac0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7b9ffff640 1 -- 172.21.15.164:0/4167000846 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7ba8005990 con 0x7f7bb806dac0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.256+0000 7f7b9ffff640 1 -- 172.21.15.164:0/4167000846 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7ba8013890 con 0x7f7bb806dac0 2024-02-18T10:00:32.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.257+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb8075150 con 0x7f7bb806dac0 2024-02-18T10:00:32.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.259+0000 7f7b9ffff640 1 -- 172.21.15.164:0/4167000846 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7ba8021060 con 0x7f7bb806dac0 2024-02-18T10:00:32.298 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.295+0000 7fa6cddd7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-18T10:00:32.298 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.296+0000 7f481a050040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-18T10:00:32.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.329+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5d278b57-76cc-404b-aa94-6b9a71ea914d", "id": 2} v 0) v1 -- 0x7f7bb8074af0 con 0x7f7bb806dac0 2024-02-18T10:00:32.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.332+0000 7f7b9ffff640 1 -- 172.21.15.164:0/4167000846 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d278b57-76cc-404b-aa94-6b9a71ea914d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ba8017070 con 0x7f7bb806dac0 2024-02-18T10:00:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-02-18T10:00:32.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.333+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb806dac0 msgr2=0x7f7bb809e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.333+0000 7f7bbde6d640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb806dac0 0x7f7bb809e2b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e9e0 tx=0x7f7ba800eea0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.333+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 shutdown_connections 2024-02-18T10:00:32.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.333+0000 7f7bbde6d640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7bb81464f0 0x7f7bb80a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.333+0000 7f7bbde6d640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb80ba2a0 0x7f7bb8147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.333+0000 7f7bbde6d640 1 --2- 172.21.15.164:0/4167000846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7bb806dac0 0x7f7bb809e2b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.333+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 >> 172.21.15.164:0/4167000846 conn(0x7f7bb80be420 msgr2=0x7f7bb80bc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.334+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 shutdown_connections 2024-02-18T10:00:32.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.334+0000 7f7bbde6d640 1 -- 172.21.15.164:0/4167000846 wait complete. 2024-02-18T10:00:32.344 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.342+0000 7f481a050040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-18T10:00:32.346 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new c63e7360-facb-478a-9de2-f80aa16f8d28 3 2024-02-18T10:00:32.351 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.349+0000 7fa6cddd7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-18T10:00:32.393 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.391+0000 7fa6cddd7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-18T10:00:32.401 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.399+0000 7f481a050040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-18T10:00:32.446 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.444+0000 7f481a050040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-18T10:00:32.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.444+0000 7f448bc8f640 1 Processor -- start 2024-02-18T10:00:32.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.444+0000 7f448bc8f640 1 -- start start 2024-02-18T10:00:32.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448bc8f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f44840bd0b0 0x7f44840b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448bc8f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f448414bd90 0x7f4484072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448bc8f640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448406e300 con 0x7f4484072e70 2024-02-18T10:00:32.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448bc8f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44840bcc60 con 0x7f44840bd0b0 2024-02-18T10:00:32.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448bc8f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448409d390 con 0x7f448414bd90 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f4489a2b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f44840bd0b0 0x7f44840b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448922a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f448414bd90 0x7f4484072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f4489a2b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f44840bd0b0 0x7f44840b9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55420/0 (socket says 172.21.15.164:55420) 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448922a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f448414bd90 0x7f4484072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44508/0 (socket says 172.21.15.164:44508) 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f4489a2b640 1 -- 172.21.15.164:0/2935128969 learned_addr learned my addr 172.21.15.164:0/2935128969 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448922a640 1 -- 172.21.15.164:0/2935128969 >> v2:172.21.15.164:3300/0 conn(0x7f44840bd0b0 msgr2=0x7f44840b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448922a640 1 --2- 172.21.15.164:0/2935128969 >> v2:172.21.15.164:3300/0 conn(0x7f44840bd0b0 0x7f44840b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448922a640 1 -- 172.21.15.164:0/2935128969 >> v1:172.21.15.118:6789/0 conn(0x7f4484072e70 legacy=0x7f448414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.445+0000 7f448922a640 1 -- 172.21.15.164:0/2935128969 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840b9790 con 0x7f448414bd90 2024-02-18T10:00:32.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.446+0000 7f448922a640 1 --2- 172.21.15.164:0/2935128969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f448414bd90 0x7f4484072930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f44800097a0 tx=0x7f448002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e246d509a9589 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.446+0000 7f4488a29640 1 -- 172.21.15.164:0/2935128969 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480031830 con 0x7f448414bd90 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.446+0000 7f4488a29640 1 -- 172.21.15.164:0/2935128969 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480031990 con 0x7f448414bd90 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.446+0000 7f4488a29640 1 -- 172.21.15.164:0/2935128969 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480031d20 con 0x7f448414bd90 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 -- 172.21.15.164:0/2935128969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f448414bd90 msgr2=0x7f4484072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 --2- 172.21.15.164:0/2935128969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f448414bd90 0x7f4484072930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f44800097a0 tx=0x7f448002b8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 -- 172.21.15.164:0/2935128969 shutdown_connections 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 --2- 172.21.15.164:0/2935128969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f448414bd90 0x7f4484072930 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 --2- 172.21.15.164:0/2935128969 >> v2:172.21.15.164:3300/0 conn(0x7f44840bd0b0 0x7f44840b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 -- 172.21.15.164:0/2935128969 >> 172.21.15.164:0/2935128969 conn(0x7f44840ba3c0 msgr2=0x7f44840ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 -- 172.21.15.164:0/2935128969 shutdown_connections 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.447+0000 7f448bc8f640 1 -- 172.21.15.164:0/2935128969 wait complete. 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.448+0000 7f448bc8f640 1 Processor -- start 2024-02-18T10:00:32.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.448+0000 7f448bc8f640 1 -- start start 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448bc8f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484072e70 0x7f44840a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448bc8f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44840bd0b0 0x7f44840a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448bc8f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f448414bd90 0x7f44841e4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448bc8f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840a3b00 con 0x7f4484072e70 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448bc8f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44841e4d60 con 0x7f448414bd90 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448bc8f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4484149910 con 0x7f44840bd0b0 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44840bd0b0 0x7f44840a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44840bd0b0 0x7f44840a35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44518/0 (socket says 172.21.15.164:44518) 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448a22c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f448414bd90 0x7f44841e4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 -- 172.21.15.164:0/2181807824 learned_addr learned my addr 172.21.15.164:0/2181807824 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f4489a2b640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484072e70 0x7f44840a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 -- 172.21.15.164:0/2181807824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f448414bd90 msgr2=0x7f44841e4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f448414bd90 0x7f44841e4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 -- 172.21.15.164:0/2181807824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484072e70 msgr2=0x7f44840a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484072e70 0x7f44840a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 -- 172.21.15.164:0/2181807824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480009400 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448922a640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44840bd0b0 0x7f44840a35c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4480000c00 tx=0x7f44800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f447a7fc640 1 -- 172.21.15.164:0/2181807824 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448003a830 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f447a7fc640 1 -- 172.21.15.164:0/2181807824 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448003a9b0 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4484149bf0 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.449+0000 7f447a7fc640 1 -- 172.21.15.164:0/2181807824 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448003ad60 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.450+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44840a2e30 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.450+0000 7f447a7fc640 1 -- 172.21.15.164:0/2181807824 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f448004d7e0 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.450+0000 7f447a7fc640 1 -- 172.21.15.164:0/2181807824 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f44800433a0 con 0x7f44840bd0b0 2024-02-18T10:00:32.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.450+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44840a1810 con 0x7f44840bd0b0 2024-02-18T10:00:32.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.452+0000 7f447a7fc640 1 -- 172.21.15.164:0/2181807824 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f44840a1810 con 0x7f44840bd0b0 2024-02-18T10:00:32.507 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.505+0000 7fa6cddd7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-18T10:00:32.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.525+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c63e7360-facb-478a-9de2-f80aa16f8d28", "id": 3} v 0) v1 -- 0x7f4484075150 con 0x7f44840bd0b0 2024-02-18T10:00:32.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.529+0000 7f447a7fc640 1 -- 172.21.15.164:0/2181807824 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c63e7360-facb-478a-9de2-f80aa16f8d28", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4480035020 con 0x7f44840bd0b0 2024-02-18T10:00:32.531 INFO:teuthology.orchestra.run.smithi164.stdout:3 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44840bd0b0 msgr2=0x7f44840a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44840bd0b0 0x7f44840a35c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4480000c00 tx=0x7f44800046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 shutdown_connections 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f448414bd90 0x7f44841e4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44840bd0b0 0x7f44840a35c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 --2- 172.21.15.164:0/2181807824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4484072e70 0x7f44840a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 >> 172.21.15.164:0/2181807824 conn(0x7f44840ba3c0 msgr2=0x7f448409e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 shutdown_connections 2024-02-18T10:00:32.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.530+0000 7f448bc8f640 1 -- 172.21.15.164:0/2181807824 wait complete. 2024-02-18T10:00:32.542 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66 4 2024-02-18T10:00:32.569 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.566+0000 7f481a050040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-18T10:00:32.577 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.574+0000 7fa6cddd7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-18T10:00:32.622 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.619+0000 7fa6cddd7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-18T10:00:32.642 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.639+0000 7f481a050040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-18T10:00:32.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.640+0000 7fd8e10fb640 1 Processor -- start 2024-02-18T10:00:32.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.640+0000 7fd8e10fb640 1 -- start start 2024-02-18T10:00:32.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8e10fb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd8dc0bd0b0 0x7fd8dc0b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8e10fb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd8dc14bd90 0x7fd8dc072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8e10fb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc06e300 con 0x7fd8dc072e70 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8e10fb640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0bcc60 con 0x7fd8dc0bd0b0 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8e10fb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc09d390 con 0x7fd8dc14bd90 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8da59c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd8dc14bd90 0x7fd8dc072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8db59e640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd8dc072e70 0x7fd8dc14f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:53578/0 (socket says 172.21.15.164:53578) 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8db59e640 1 -- 172.21.15.164:0/738909974 learned_addr learned my addr 172.21.15.164:0/738909974 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8da59c640 1 --2- 172.21.15.164:0/738909974 >> v2:172.21.15.164:3300/0 conn(0x7fd8dc14bd90 0x7fd8dc072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55446/0 (socket says 172.21.15.164:55446) 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8dad9d640 1 --2- 172.21.15.164:0/738909974 >> v2:172.21.15.118:3300/0 conn(0x7fd8dc0bd0b0 0x7fd8dc0b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8da59c640 1 -- 172.21.15.164:0/738909974 >> v2:172.21.15.118:3300/0 conn(0x7fd8dc0bd0b0 msgr2=0x7fd8dc0b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:32.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8da59c640 1 --2- 172.21.15.164:0/738909974 >> v2:172.21.15.118:3300/0 conn(0x7fd8dc0bd0b0 0x7fd8dc0b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8da59c640 1 -- 172.21.15.164:0/738909974 >> v1:172.21.15.164:6789/0 conn(0x7fd8dc072e70 legacy=0x7fd8dc14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8da59c640 1 -- 172.21.15.164:0/738909974 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0b9790 con 0x7fd8dc14bd90 2024-02-18T10:00:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.641+0000 7fd8d9d9b640 1 -- 172.21.15.164:0/738909974 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297425675 0 0) 0x7fd8dc06e300 con 0x7fd8dc072e70 2024-02-18T10:00:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.642+0000 7fd8da59c640 1 --2- 172.21.15.164:0/738909974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc072930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0bd870 tx=0x7fd8c402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd26d8c78e2cd79f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.642+0000 7fd8d9d9b640 1 -- 172.21.15.164:0/738909974 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4031830 con 0x7fd8dc14bd90 2024-02-18T10:00:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.642+0000 7fd8d9d9b640 1 -- 172.21.15.164:0/738909974 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4031990 con 0x7fd8dc14bd90 2024-02-18T10:00:32.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.642+0000 7fd8d9d9b640 1 -- 172.21.15.164:0/738909974 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4031d20 con 0x7fd8dc14bd90 2024-02-18T10:00:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 -- 172.21.15.164:0/738909974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 msgr2=0x7fd8dc072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 --2- 172.21.15.164:0/738909974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc072930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0bd870 tx=0x7fd8c402b8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 -- 172.21.15.164:0/738909974 shutdown_connections 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 --2- 172.21.15.164:0/738909974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc072930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 --2- 172.21.15.164:0/738909974 >> v2:172.21.15.118:3300/0 conn(0x7fd8dc0bd0b0 0x7fd8dc0b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 -- 172.21.15.164:0/738909974 >> 172.21.15.164:0/738909974 conn(0x7fd8dc0ba3c0 msgr2=0x7fd8dc0ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 -- 172.21.15.164:0/738909974 shutdown_connections 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.643+0000 7fd8e10fb640 1 -- 172.21.15.164:0/738909974 wait complete. 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.644+0000 7fd8e10fb640 1 Processor -- start 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.644+0000 7fd8e10fb640 1 -- start start 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8e10fb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8dc072e70 0x7fd8dc149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8e10fb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8dc0bd0b0 0x7fd8dc09bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8e10fb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc0a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8e10fb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc09c3e0 con 0x7fd8dc072e70 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8e10fb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0a1a00 con 0x7fd8dc14bd90 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8e10fb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0a0a70 con 0x7fd8dc0bd0b0 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc0a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8da59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8dc0bd0b0 0x7fd8dc09bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc0a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55462/0 (socket says 172.21.15.164:55462) 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 -- 172.21.15.164:0/3100454630 learned_addr learned my addr 172.21.15.164:0/3100454630 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8dad9d640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8dc072e70 0x7fd8dc149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 -- 172.21.15.164:0/3100454630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8dc0bd0b0 msgr2=0x7fd8dc09bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8dc0bd0b0 0x7fd8dc09bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 -- 172.21.15.164:0/3100454630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8dc072e70 msgr2=0x7fd8dc149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8dc072e70 0x7fd8dc149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 -- 172.21.15.164:0/3100454630 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4009400 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8dad9d640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8dc072e70 0x7fd8dc149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8db59e640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc0a14c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c7a0 tx=0x7fd8d400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.645+0000 7fd8d37fe640 1 -- 172.21.15.164:0/3100454630 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400a640 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.646+0000 7fd8d37fe640 1 -- 172.21.15.164:0/3100454630 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d400a7a0 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.646+0000 7fd8d37fe640 1 -- 172.21.15.164:0/3100454630 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400ab90 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.646+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc148240 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.646+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc148590 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.646+0000 7fd8d37fe640 1 -- 172.21.15.164:0/3100454630 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd8d400acf0 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.646+0000 7fd8d37fe640 1 -- 172.21.15.164:0/3100454630 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd8d4012910 con 0x7fd8dc14bd90 2024-02-18T10:00:32.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.647+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc075150 con 0x7fd8dc14bd90 2024-02-18T10:00:32.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.650+0000 7fd8d37fe640 1 -- 172.21.15.164:0/3100454630 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd8d4018070 con 0x7fd8dc14bd90 2024-02-18T10:00:32.674 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.671+0000 7fa6cddd7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-18T10:00:32.691 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.688+0000 7f481a050040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-18T10:00:32.720 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:32.717+0000 7fa6cddd7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-18T10:00:32.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.721+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66", "id": 4} v 0) v1 -- 0x7fd8dc074af0 con 0x7fd8dc14bd90 2024-02-18T10:00:32.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.725+0000 7fd8d37fe640 1 -- 172.21.15.164:0/3100454630 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd8d4012ce0 con 0x7fd8dc14bd90 2024-02-18T10:00:32.727 INFO:teuthology.orchestra.run.smithi164.stdout:4 2024-02-18T10:00:32.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 msgr2=0x7fd8dc0a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc0a14c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c7a0 tx=0x7fd8d400cc60 comp rx=0 tx=0).stop 2024-02-18T10:00:32.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 shutdown_connections 2024-02-18T10:00:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8dc14bd90 0x7fd8dc0a14c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd8dc0bd0b0 0x7fd8dc09bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 --2- 172.21.15.164:0/3100454630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8dc072e70 0x7fd8dc149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 >> 172.21.15.164:0/3100454630 conn(0x7fd8dc0ba3c0 msgr2=0x7fd8dc09e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 shutdown_connections 2024-02-18T10:00:32.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.726+0000 7fd8e10fb640 1 -- 172.21.15.164:0/3100454630 wait complete. 2024-02-18T10:00:32.739 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new c876ac02-f509-4d3b-998a-9a12446b2082 5 2024-02-18T10:00:32.745 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.743+0000 7f481a050040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-18T10:00:32.796 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:32.793+0000 7f481a050040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.843+0000 7f656ac64640 1 Processor -- start 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.843+0000 7f656ac64640 1 -- start start 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f656ac64640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f65640bd0b0 0x7f65640b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f656ac64640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f656414bd90 0x7f6564072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f656ac64640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656406e300 con 0x7f6564072e70 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f656ac64640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65640bcc60 con 0x7f65640bd0b0 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f656ac64640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656409d390 con 0x7f656414bd90 2024-02-18T10:00:32.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f6563fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f656414bd90 0x7f6564072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f6563fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f656414bd90 0x7f6564072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55468/0 (socket says 172.21.15.164:55468) 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f6563fff640 1 -- 172.21.15.164:0/2731206924 learned_addr learned my addr 172.21.15.164:0/2731206924 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.844+0000 7f6568a00640 1 --2- 172.21.15.164:0/2731206924 >> v2:172.21.15.118:3300/0 conn(0x7f65640bd0b0 0x7f65640b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.845+0000 7f6563fff640 1 -- 172.21.15.164:0/2731206924 >> v2:172.21.15.118:3300/0 conn(0x7f65640bd0b0 msgr2=0x7f65640b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.845+0000 7f6563fff640 1 --2- 172.21.15.164:0/2731206924 >> v2:172.21.15.118:3300/0 conn(0x7f65640bd0b0 0x7f65640b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.845+0000 7f6563fff640 1 -- 172.21.15.164:0/2731206924 >> v1:172.21.15.164:6789/0 conn(0x7f6564072e70 legacy=0x7f656414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.845+0000 7f65637fe640 1 -- 172.21.15.164:0/2731206924 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402616181 0 0) 0x7f656406e300 con 0x7f6564072e70 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.845+0000 7f6563fff640 1 -- 172.21.15.164:0/2731206924 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640b9790 con 0x7f656414bd90 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.845+0000 7f6563fff640 1 --2- 172.21.15.164:0/2731206924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f656414bd90 0x7f6564072930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65640bd870 tx=0x7f655802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86bb899ee9a47ab5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f65637fe640 1 -- 172.21.15.164:0/2731206924 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558030860 con 0x7f656414bd90 2024-02-18T10:00:32.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f65637fe640 1 -- 172.21.15.164:0/2731206924 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65580309c0 con 0x7f656414bd90 2024-02-18T10:00:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f65637fe640 1 -- 172.21.15.164:0/2731206924 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558030d50 con 0x7f656414bd90 2024-02-18T10:00:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 -- 172.21.15.164:0/2731206924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f656414bd90 msgr2=0x7f6564072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 --2- 172.21.15.164:0/2731206924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f656414bd90 0x7f6564072930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65640bd870 tx=0x7f655802b9a0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 -- 172.21.15.164:0/2731206924 shutdown_connections 2024-02-18T10:00:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 --2- 172.21.15.164:0/2731206924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f656414bd90 0x7f6564072930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 --2- 172.21.15.164:0/2731206924 >> v2:172.21.15.118:3300/0 conn(0x7f65640bd0b0 0x7f65640b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 -- 172.21.15.164:0/2731206924 >> 172.21.15.164:0/2731206924 conn(0x7f65640ba3c0 msgr2=0x7f65640ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 -- 172.21.15.164:0/2731206924 shutdown_connections 2024-02-18T10:00:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.846+0000 7f656ac64640 1 -- 172.21.15.164:0/2731206924 wait complete. 2024-02-18T10:00:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.847+0000 7f656ac64640 1 Processor -- start 2024-02-18T10:00:32.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.847+0000 7f656ac64640 1 -- start start 2024-02-18T10:00:32.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f656ac64640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6564072e70 0x7f6564149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f656ac64640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65640bd0b0 0x7f656409bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f656ac64640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f656414bd90 0x7f65640a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:32.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f656ac64640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656409c3e0 con 0x7f656414bd90 2024-02-18T10:00:32.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f656ac64640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640a1a00 con 0x7f6564072e70 2024-02-18T10:00:32.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f656ac64640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640a0a70 con 0x7f65640bd0b0 2024-02-18T10:00:32.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f6568a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6564072e70 0x7f6564149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f6568a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6564072e70 0x7f6564149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55470/0 (socket says 172.21.15.164:55470) 2024-02-18T10:00:32.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f6568a00640 1 -- 172.21.15.164:0/503096164 learned_addr learned my addr 172.21.15.164:0/503096164 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f6563fff640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65640bd0b0 0x7f656409bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.848+0000 7f6569201640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f656414bd90 0x7f65640a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f6568a00640 1 -- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65640bd0b0 msgr2=0x7f656409bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f6568a00640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65640bd0b0 0x7f656409bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f6568a00640 1 -- 172.21.15.164:0/503096164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f656414bd90 msgr2=0x7f65640a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f6568a00640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f656414bd90 0x7f65640a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f6568a00640 1 -- 172.21.15.164:0/503096164 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580094d0 con 0x7f6564072e70 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f6568a00640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6564072e70 0x7f6564149b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f655000e9b0 tx=0x7f655000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f65617fa640 1 -- 172.21.15.164:0/503096164 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550009670 con 0x7f6564072e70 2024-02-18T10:00:32.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f65617fa640 1 -- 172.21.15.164:0/503096164 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655000c9a0 con 0x7f6564072e70 2024-02-18T10:00:32.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6564148240 con 0x7f6564072e70 2024-02-18T10:00:32.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f65617fa640 1 -- 172.21.15.164:0/503096164 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655000cd50 con 0x7f6564072e70 2024-02-18T10:00:32.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6564148590 con 0x7f6564072e70 2024-02-18T10:00:32.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f65617fa640 1 -- 172.21.15.164:0/503096164 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6550013470 con 0x7f6564072e70 2024-02-18T10:00:32.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.849+0000 7f65617fa640 1 -- 172.21.15.164:0/503096164 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f65500123d0 con 0x7f6564072e70 2024-02-18T10:00:32.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.850+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6564075150 con 0x7f6564072e70 2024-02-18T10:00:32.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.854+0000 7f65617fa640 1 -- 172.21.15.164:0/503096164 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6550021060 con 0x7f6564072e70 2024-02-18T10:00:32.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.926+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c876ac02-f509-4d3b-998a-9a12446b2082", "id": 5} v 0) v1 -- 0x7f6564074af0 con 0x7f6564072e70 2024-02-18T10:00:32.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.930+0000 7f65617fa640 1 -- 172.21.15.164:0/503096164 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c876ac02-f509-4d3b-998a-9a12446b2082", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f655002a0b0 con 0x7f6564072e70 2024-02-18T10:00:32.932 INFO:teuthology.orchestra.run.smithi164.stdout:5 2024-02-18T10:00:32.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.930+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6564072e70 msgr2=0x7f6564149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:32.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.930+0000 7f656ac64640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6564072e70 0x7f6564149b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f655000e9b0 tx=0x7f655000ee70 comp rx=0 tx=0).stop 2024-02-18T10:00:32.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.931+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 shutdown_connections 2024-02-18T10:00:32.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.931+0000 7f656ac64640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f656414bd90 0x7f65640a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.931+0000 7f656ac64640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65640bd0b0 0x7f656409bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.931+0000 7f656ac64640 1 --2- 172.21.15.164:0/503096164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6564072e70 0x7f6564149b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:32.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.931+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 >> 172.21.15.164:0/503096164 conn(0x7f65640ba3c0 msgr2=0x7f656409e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:32.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.931+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 shutdown_connections 2024-02-18T10:00:32.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:32.931+0000 7f656ac64640 1 -- 172.21.15.164:0/503096164 wait complete. 2024-02-18T10:00:32.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 515631d7-2cc4-4dd0-9181-6f0c82f76121 6 2024-02-18T10:00:33.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.042+0000 7feac24fb640 1 Processor -- start 2024-02-18T10:00:33.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.042+0000 7feac24fb640 1 -- start start 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feac24fb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feabc14a7e0 0x7feabc0b9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feac24fb640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc0bc7c0 con 0x7feabc0bcc10 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feac24fb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc0b9b70 con 0x7feabc072ed0 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feac24fb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc0b9e50 con 0x7feabc14a7e0 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feabb7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7feabc14a7e0 0x7feabc0b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feabbfff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7feabc072ed0 0x7feabc14a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:53596/0 (socket says 172.21.15.164:53596) 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feabbfff640 1 -- 172.21.15.164:0/4013474266 learned_addr learned my addr 172.21.15.164:0/4013474266 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-02-18T10:00:33.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feabb7fe640 1 -- 172.21.15.164:0/4013474266 >> v1:172.21.15.164:6789/0 conn(0x7feabc072ed0 legacy=0x7feabc14a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feabb7fe640 1 -- 172.21.15.164:0/4013474266 >> v1:172.21.15.118:6789/0 conn(0x7feabc0bcc10 legacy=0x7feabc0bd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.043+0000 7feabb7fe640 1 -- 172.21.15.164:0/4013474266 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0ba130 con 0x7feabc14a7e0 2024-02-18T10:00:33.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.044+0000 7feabb7fe640 1 --2- 172.21.15.164:0/4013474266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc0b9540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feaac0097a0 tx=0x7feaac02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c523591412d0567c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.044+0000 7feabaffd640 1 -- 172.21.15.164:0/4013474266 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac030610 con 0x7feabc14a7e0 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.044+0000 7feabaffd640 1 -- 172.21.15.164:0/4013474266 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac030770 con 0x7feabc14a7e0 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.044+0000 7feabaffd640 1 -- 172.21.15.164:0/4013474266 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac030b00 con 0x7feabc14a7e0 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.045+0000 7feac24fb640 1 -- 172.21.15.164:0/4013474266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 msgr2=0x7feabc0b9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.045+0000 7feac24fb640 1 --2- 172.21.15.164:0/4013474266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc0b9540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feaac0097a0 tx=0x7feaac02b960 comp rx=0 tx=0).stop 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.045+0000 7feac24fb640 1 -- 172.21.15.164:0/4013474266 shutdown_connections 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.045+0000 7feac24fb640 1 --2- 172.21.15.164:0/4013474266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc0b9540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.045+0000 7feac24fb640 1 -- 172.21.15.164:0/4013474266 >> 172.21.15.164:0/4013474266 conn(0x7feabc0ba3c0 msgr2=0x7feabc0ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.045+0000 7feac24fb640 1 -- 172.21.15.164:0/4013474266 shutdown_connections 2024-02-18T10:00:33.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.045+0000 7feac24fb640 1 -- 172.21.15.164:0/4013474266 wait complete. 2024-02-18T10:00:33.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.046+0000 7feac24fb640 1 Processor -- start 2024-02-18T10:00:33.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.047+0000 7feac24fb640 1 -- start start 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac24fb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feabc072ed0 0x7feabc14cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac24fb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feabc0bcc10 0x7feabc141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac24fb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac24fb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1416a0 con 0x7feabc072ed0 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac24fb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc071f40 con 0x7feabc14a7e0 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac24fb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc070a90 con 0x7feabc0bcc10 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feabc0bcc10 0x7feabc141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac0a98640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feabc0bcc10 0x7feabc141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44544/0 (socket says 172.21.15.164:44544) 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 -- 172.21.15.164:0/3897984815 learned_addr learned my addr 172.21.15.164:0/3897984815 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabbfff640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feabc072ed0 0x7feabc14cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 -- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 msgr2=0x7feabc070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 -- 172.21.15.164:0/3897984815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feabc072ed0 msgr2=0x7feabc14cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feabc072ed0 0x7feabc14cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 -- 172.21.15.164:0/3897984815 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac009400 con 0x7feabc0bcc10 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feac0a98640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabbfff640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feabc072ed0 0x7feabc14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feabb7fe640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feabc0bcc10 0x7feabc141160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feaac009890 tx=0x7feaac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feab8ff9640 1 -- 172.21.15.164:0/3897984815 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac03e070 con 0x7feabc0bcc10 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.048+0000 7feab8ff9640 1 -- 172.21.15.164:0/3897984815 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac039a40 con 0x7feabc0bcc10 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.049+0000 7feab8ff9640 1 -- 172.21.15.164:0/3897984815 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac039dd0 con 0x7feabc0bcc10 2024-02-18T10:00:33.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.049+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc071cd0 con 0x7feabc0bcc10 2024-02-18T10:00:33.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.049+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc14d5e0 con 0x7feabc0bcc10 2024-02-18T10:00:33.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.049+0000 7feab8ff9640 1 -- 172.21.15.164:0/3897984815 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7feaac04b400 con 0x7feabc0bcc10 2024-02-18T10:00:33.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.049+0000 7feab8ff9640 1 -- 172.21.15.164:0/3897984815 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7feaac042c10 con 0x7feabc0bcc10 2024-02-18T10:00:33.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.049+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc0705c0 con 0x7feabc0bcc10 2024-02-18T10:00:33.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.052+0000 7feab8ff9640 1 -- 172.21.15.164:0/3897984815 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7feabc0705c0 con 0x7feabc0bcc10 2024-02-18T10:00:33.095 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.092+0000 7fa6cddd7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-18T10:00:33.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.125+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "515631d7-2cc4-4dd0-9181-6f0c82f76121", "id": 6} v 0) v1 -- 0x7feabc075180 con 0x7feabc0bcc10 2024-02-18T10:00:33.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.128+0000 7feab8ff9640 1 -- 172.21.15.164:0/3897984815 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "515631d7-2cc4-4dd0-9181-6f0c82f76121", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7feaac034070 con 0x7feabc0bcc10 2024-02-18T10:00:33.131 INFO:teuthology.orchestra.run.smithi164.stdout:6 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feabc0bcc10 msgr2=0x7feabc141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feabc0bcc10 0x7feabc141160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feaac009890 tx=0x7feaac0046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 shutdown_connections 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feabc14a7e0 0x7feabc070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7feabc0bcc10 0x7feabc141160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 --2- 172.21.15.164:0/3897984815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feabc072ed0 0x7feabc14cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 >> 172.21.15.164:0/3897984815 conn(0x7feabc0ba3c0 msgr2=0x7feabc06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 shutdown_connections 2024-02-18T10:00:33.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.129+0000 7feac24fb640 1 -- 172.21.15.164:0/3897984815 wait complete. 2024-02-18T10:00:33.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 234bf955-4743-4aaa-b275-aac0db07376f 7 2024-02-18T10:00:33.201 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.199+0000 7f481a050040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-18T10:00:33.229 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.226+0000 7fa6cddd7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-18T10:00:33.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.240+0000 7fc9317b5640 1 Processor -- start 2024-02-18T10:00:33.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.240+0000 7fc9317b5640 1 -- start start 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.241+0000 7fc9317b5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0bce00 0x7fc92c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.241+0000 7fc9317b5640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc92c0b9140 0x7fc92c153330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.241+0000 7fc9317b5640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c0ba000 con 0x7fc92c0b2e30 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc9317b5640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c0bd1e0 con 0x7fc92c0b9140 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc9317b5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c148f10 con 0x7fc92c0bce00 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0bce00 0x7fc92c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92b7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc92c0b9140 0x7fc92c153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0bce00 0x7fc92c1493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44556/0 (socket says 172.21.15.164:44556) 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92affd640 1 -- 172.21.15.164:0/18836368 learned_addr learned my addr 172.21.15.164:0/18836368 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92affd640 1 -- 172.21.15.164:0/18836368 >> v2:172.21.15.164:3300/0 conn(0x7fc92c0b9140 msgr2=0x7fc92c153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92affd640 1 --2- 172.21.15.164:0/18836368 >> v2:172.21.15.164:3300/0 conn(0x7fc92c0b9140 0x7fc92c153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92affd640 1 -- 172.21.15.164:0/18836368 >> v1:172.21.15.164:6789/0 conn(0x7fc92c0b2e30 legacy=0x7fc92c0b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92affd640 1 -- 172.21.15.164:0/18836368 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c066cd0 con 0x7fc92c0bce00 2024-02-18T10:00:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.242+0000 7fc92b7fe640 1 --2- 172.21.15.164:0/18836368 >> v2:172.21.15.164:3300/0 conn(0x7fc92c0b9140 0x7fc92c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.243+0000 7fc92affd640 1 --2- 172.21.15.164:0/18836368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0bce00 0x7fc92c1493a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc914009870 tx=0x7fc91402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d1c5c0ded80271 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.243+0000 7fc929ffb640 1 -- 172.21.15.164:0/18836368 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914030840 con 0x7fc92c0bce00 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.243+0000 7fc929ffb640 1 -- 172.21.15.164:0/18836368 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9140309a0 con 0x7fc92c0bce00 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.243+0000 7fc929ffb640 1 -- 172.21.15.164:0/18836368 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914030d30 con 0x7fc92c0bce00 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 -- 172.21.15.164:0/18836368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0bce00 msgr2=0x7fc92c1493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 --2- 172.21.15.164:0/18836368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0bce00 0x7fc92c1493a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc914009870 tx=0x7fc91402b980 comp rx=0 tx=0).stop 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 -- 172.21.15.164:0/18836368 shutdown_connections 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 --2- 172.21.15.164:0/18836368 >> v2:172.21.15.164:3300/0 conn(0x7fc92c0b9140 0x7fc92c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 --2- 172.21.15.164:0/18836368 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0bce00 0x7fc92c1493a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 -- 172.21.15.164:0/18836368 >> 172.21.15.164:0/18836368 conn(0x7fc92c0ba3c0 msgr2=0x7fc92c0ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 -- 172.21.15.164:0/18836368 shutdown_connections 2024-02-18T10:00:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.244+0000 7fc9317b5640 1 -- 172.21.15.164:0/18836368 wait complete. 2024-02-18T10:00:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.246+0000 7fc9317b5640 1 Processor -- start 2024-02-18T10:00:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.246+0000 7fc9317b5640 1 -- start start 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0b2e30 0x7fc92c0a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc92c0b9140 0x7fc92c13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc92c0bce00 0x7fc92c142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c0a34c0 con 0x7fc92c0bce00 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c072360 con 0x7fc92c0b9140 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c13e7a0 con 0x7fc92c0b2e30 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0b2e30 0x7fc92c0a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92a7fc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc92c0b9140 0x7fc92c13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0b2e30 0x7fc92c0a2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44564/0 (socket says 172.21.15.164:44564) 2024-02-18T10:00:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 -- 172.21.15.164:0/238749325 learned_addr learned my addr 172.21.15.164:0/238749325 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92b7fe640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc92c0bce00 0x7fc92c142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 -- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc92c0b9140 msgr2=0x7fc92c13de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc92c0b9140 0x7fc92c13de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 -- 172.21.15.164:0/238749325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc92c0bce00 msgr2=0x7fc92c142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc92c0bce00 0x7fc92c142220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 -- 172.21.15.164:0/238749325 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc924009a70 con 0x7fc92c0b2e30 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92a7fc640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc92c0b9140 0x7fc92c13de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc92affd640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0b2e30 0x7fc92c0a2f80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc91402b9c0 tx=0x7fc914004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9237fe640 1 -- 172.21.15.164:0/238749325 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914039a90 con 0x7fc92c0b2e30 2024-02-18T10:00:33.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9237fe640 1 -- 172.21.15.164:0/238749325 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914039bf0 con 0x7fc92c0b2e30 2024-02-18T10:00:33.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9140094d0 con 0x7fc92c0b2e30 2024-02-18T10:00:33.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9237fe640 1 -- 172.21.15.164:0/238749325 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914043410 con 0x7fc92c0b2e30 2024-02-18T10:00:33.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.247+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c13e360 con 0x7fc92c0b2e30 2024-02-18T10:00:33.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.248+0000 7fc9237fe640 1 -- 172.21.15.164:0/238749325 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc914043570 con 0x7fc92c0b2e30 2024-02-18T10:00:33.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.248+0000 7fc9237fe640 1 -- 172.21.15.164:0/238749325 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc91404ca10 con 0x7fc92c0b2e30 2024-02-18T10:00:33.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.248+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c141230 con 0x7fc92c0b2e30 2024-02-18T10:00:33.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.250+0000 7fc9237fe640 1 -- 172.21.15.164:0/238749325 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc92c141230 con 0x7fc92c0b2e30 2024-02-18T10:00:33.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.323+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "234bf955-4743-4aaa-b275-aac0db07376f", "id": 7} v 0) v1 -- 0x7fc92c075150 con 0x7fc92c0b2e30 2024-02-18T10:00:33.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.326+0000 7fc9237fe640 1 -- 172.21.15.164:0/238749325 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "234bf955-4743-4aaa-b275-aac0db07376f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc914048070 con 0x7fc92c0b2e30 2024-02-18T10:00:33.329 INFO:teuthology.orchestra.run.smithi164.stdout:7 2024-02-18T10:00:33.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.327+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0b2e30 msgr2=0x7fc92c0a2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.327+0000 7fc9317b5640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0b2e30 0x7fc92c0a2f80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc91402b9c0 tx=0x7fc914004730 comp rx=0 tx=0).stop 2024-02-18T10:00:33.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.327+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 shutdown_connections 2024-02-18T10:00:33.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.327+0000 7fc9317b5640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc92c0bce00 0x7fc92c142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.327+0000 7fc9317b5640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc92c0b9140 0x7fc92c13de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.327+0000 7fc9317b5640 1 --2- 172.21.15.164:0/238749325 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc92c0b2e30 0x7fc92c0a2f80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.327+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 >> 172.21.15.164:0/238749325 conn(0x7fc92c0ba3c0 msgr2=0x7fc92c06d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:33.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.328+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 shutdown_connections 2024-02-18T10:00:33.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-02-18T10:00:33.328+0000 7fc9317b5640 1 -- 172.21.15.164:0/238749325 wait complete. 2024-02-18T10:00:33.340 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-18T10:00:33.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-18T10:00:33.342 INFO:tasks.ceph.osd.0:Started 2024-02-18T10:00:33.343 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-18T10:00:33.343 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-18T10:00:33.344 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.341+0000 7f481a050040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-18T10:00:33.345 INFO:tasks.ceph.osd.1:Started 2024-02-18T10:00:33.345 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-18T10:00:33.345 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-18T10:00:33.347 INFO:tasks.ceph.osd.2:Started 2024-02-18T10:00:33.347 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-18T10:00:33.347 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-18T10:00:33.350 INFO:tasks.ceph.osd.3:Started 2024-02-18T10:00:33.350 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-18T10:00:33.350 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-18T10:00:33.352 INFO:tasks.ceph.osd.4:Started 2024-02-18T10:00:33.355 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-18T10:00:33.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-18T10:00:33.357 INFO:tasks.ceph.osd.5:Started 2024-02-18T10:00:33.357 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-18T10:00:33.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-18T10:00:33.358 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.356+0000 7fa6cddd7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-18T10:00:33.360 INFO:tasks.ceph.osd.6:Started 2024-02-18T10:00:33.360 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-18T10:00:33.360 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-18T10:00:33.364 INFO:tasks.ceph.osd.7:Started 2024-02-18T10:00:33.364 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:33.433 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.431+0000 7fa6cddd7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-18T10:00:33.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.478+0000 7f40b386f640 1 Processor -- start 2024-02-18T10:00:33.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.479+0000 7f40b386f640 1 -- start start 2024-02-18T10:00:33.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.479+0000 7f40b386f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40ac071c20 0x7f40ac0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.479+0000 7f40b386f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac142960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.479+0000 7f40b386f640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f40ac14c490 0x7f40ac14c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b386f640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac072860 con 0x7f40ac071c20 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b386f640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac14c000 con 0x7f40ac14c490 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40ac071c20 0x7f40ac0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b386f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0b3ee0 con 0x7f40ac072000 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40ac071c20 0x7f40ac0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47382/0 (socket says 172.21.15.118:47382) 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 -- 172.21.15.118:0/1534857808 learned_addr learned my addr 172.21.15.118:0/1534857808 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b1e0c640 1 --2- 172.21.15.118:0/1534857808 >> v2:172.21.15.164:3300/0 conn(0x7f40ac14c490 0x7f40ac14c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b0e0a640 1 --2- 172.21.15.118:0/1534857808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 -- 172.21.15.118:0/1534857808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 msgr2=0x7f40ac142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 --2- 172.21.15.118:0/1534857808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 -- 172.21.15.118:0/1534857808 >> v2:172.21.15.164:3300/0 conn(0x7f40ac14c490 msgr2=0x7f40ac14c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 --2- 172.21.15.118:0/1534857808 >> v2:172.21.15.164:3300/0 conn(0x7f40ac14c490 0x7f40ac14c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.480+0000 7f40b160b640 1 -- 172.21.15.118:0/1534857808 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac072580 con 0x7f40ac071c20 2024-02-18T10:00:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.481+0000 7f40b160b640 1 --2- 172.21.15.118:0/1534857808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac0712f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f40ac071830 tx=0x7f40a802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d173dac95475c215 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.481+0000 7f40a3fff640 1 -- 172.21.15.118:0/1534857808 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a802ee00 con 0x7f40ac071c20 2024-02-18T10:00:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.481+0000 7f40a3fff640 1 -- 172.21.15.118:0/1534857808 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8036440 con 0x7f40ac071c20 2024-02-18T10:00:33.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.481+0000 7f40a3fff640 1 -- 172.21.15.118:0/1534857808 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80367d0 con 0x7f40ac071c20 2024-02-18T10:00:33.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 -- 172.21.15.118:0/1534857808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 msgr2=0x7f40ac0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 --2- 172.21.15.118:0/1534857808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac0712f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f40ac071830 tx=0x7f40a802e050 comp rx=0 tx=0).stop 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 -- 172.21.15.118:0/1534857808 shutdown_connections 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 --2- 172.21.15.118:0/1534857808 >> v2:172.21.15.164:3300/0 conn(0x7f40ac14c490 0x7f40ac14c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 --2- 172.21.15.118:0/1534857808 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 --2- 172.21.15.118:0/1534857808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac0712f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 -- 172.21.15.118:0/1534857808 >> 172.21.15.118:0/1534857808 conn(0x7f40ac0badb0 msgr2=0x7f40ac0bb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 -- 172.21.15.118:0/1534857808 shutdown_connections 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.482+0000 7f40b386f640 1 -- 172.21.15.118:0/1534857808 wait complete. 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.483+0000 7f40b386f640 1 Processor -- start 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.483+0000 7f40b386f640 1 -- start start 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b386f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac13c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b386f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac1e1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b386f640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40ac14c490 0x7f40ac0a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b386f640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac13cc50 con 0x7f40ac071c20 2024-02-18T10:00:33.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b386f640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac1e0a20 con 0x7f40ac14c490 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b386f640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0b4c70 con 0x7f40ac072000 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac13c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac13c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47398/0 (socket says 172.21.15.118:47398) 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 -- 172.21.15.118:0/2155580780 learned_addr learned my addr 172.21.15.118:0/2155580780 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b0e0a640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac1e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 -- 172.21.15.118:0/2155580780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 msgr2=0x7f40ac1e1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac1e1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 -- 172.21.15.118:0/2155580780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40ac14c490 msgr2=0x7f40ac0a3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40ac14c490 0x7f40ac0a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 -- 172.21.15.118:0/2155580780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a800b770 con 0x7f40ac071c20 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.484+0000 7f40b160b640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac13c710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40a802e090 tx=0x7f40a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.485+0000 7f40a1ffb640 1 -- 172.21.15.118:0/2155580780 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a803f840 con 0x7f40ac071c20 2024-02-18T10:00:33.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.485+0000 7f40a1ffb640 1 -- 172.21.15.118:0/2155580780 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a803f9a0 con 0x7f40ac071c20 2024-02-18T10:00:33.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.485+0000 7f40a1ffb640 1 -- 172.21.15.118:0/2155580780 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a803fd50 con 0x7f40ac071c20 2024-02-18T10:00:33.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.485+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac1ddef0 con 0x7f40ac071c20 2024-02-18T10:00:33.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.485+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac1e0c70 con 0x7f40ac071c20 2024-02-18T10:00:33.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.485+0000 7f40a1ffb640 1 -- 172.21.15.118:0/2155580780 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f40a803d040 con 0x7f40ac071c20 2024-02-18T10:00:33.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.485+0000 7f40a1ffb640 1 -- 172.21.15.118:0/2155580780 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f40a803e390 con 0x7f40ac071c20 2024-02-18T10:00:33.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.486+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac074af0 con 0x7f40ac071c20 2024-02-18T10:00:33.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.488+0000 7f40a1ffb640 1 -- 172.21.15.118:0/2155580780 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f40a8045020 con 0x7f40ac071c20 2024-02-18T10:00:33.504 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.502+0000 7f481a050040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-18T10:00:33.549 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.547+0000 7f481a050040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-18T10:00:33.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.548+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40ac0b37e0 con 0x7f40ac071c20 2024-02-18T10:00:33.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.549+0000 7f40a1ffb640 1 -- 172.21.15.118:0/2155580780 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f40a803b070 con 0x7f40ac071c20 2024-02-18T10:00:33.552 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:33.552 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:33.325587+0000","last_up_change":"0.000000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 msgr2=0x7f40ac13c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac13c710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40a802e090 tx=0x7f40a80046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 shutdown_connections 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40ac14c490 0x7f40ac0a3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40ac072000 0x7f40ac1e1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 --2- 172.21.15.118:0/2155580780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40ac071c20 0x7f40ac13c710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 >> 172.21.15.118:0/2155580780 conn(0x7f40ac0badb0 msgr2=0x7f40ac1403a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 shutdown_connections 2024-02-18T10:00:33.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:33.550+0000 7f40b386f640 1 -- 172.21.15.118:0/2155580780 wait complete. 2024-02-18T10:00:33.554 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.552+0000 7fa6cddd7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-18T10:00:33.563 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-18T10:00:33.563 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-18T10:00:33.651 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.649+0000 7fa6cddd7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-18T10:00:33.660 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.658+0000 7f481a050040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-18T10:00:33.757 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.755+0000 7f481a050040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-18T10:00:33.807 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.805+0000 7fa6cddd7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-18T10:00:33.849 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:33.846+0000 7fa6cddd7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-18T10:00:33.910 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.908+0000 7f481a050040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-18T10:00:33.952 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:33.950+0000 7f481a050040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-18T10:00:33.954 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-02-18T10:00:33.951+0000 7fc844fbd640 -1 Falling back to public interface 2024-02-18T10:00:33.954 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-02-18T10:00:33.951+0000 7f8087621640 -1 Falling back to public interface 2024-02-18T10:00:33.954 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-02-18T10:00:33.951+0000 7fc843f6c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-02-18T10:00:33.954 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-02-18T10:00:33.951+0000 7fc843f6c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-02-18T10:00:33.959 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-02-18T10:00:33.956+0000 7f5164b0f640 -1 Falling back to public interface 2024-02-18T10:00:33.971 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-02-18T10:00:33.968+0000 7f0bf79f8640 -1 Falling back to public interface 2024-02-18T10:00:33.974 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-02-18T10:00:33.972+0000 7fbae740d640 -1 Falling back to public interface 2024-02-18T10:00:33.977 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-02-18T10:00:33.974+0000 7f995f8d3640 -1 Falling back to public interface 2024-02-18T10:00:33.977 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-02-18T10:00:33.974+0000 7f6724711640 -1 Falling back to public interface 2024-02-18T10:00:33.977 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-02-18T10:00:33.975+0000 7f217ac19640 -1 Falling back to public interface 2024-02-18T10:00:34.007 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:34.004+0000 7fa6cddd7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-18T10:00:34.109 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:34.106+0000 7f481a050040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-18T10:00:34.369 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:34.460 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.457+0000 7fcfa528a640 1 Processor -- start 2024-02-18T10:00:34.460 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.457+0000 7fcfa528a640 1 -- start start 2024-02-18T10:00:34.461 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcfa528a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcfa01439a0 0x7fcfa0143da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:34.461 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcfa528a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa014a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcfa528a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa0071ec0 con 0x7fcfa00b7bd0 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcfa528a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa0072aa0 con 0x7fcfa01439a0 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcfa528a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa014a640 con 0x7fcfa0149c70 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf97fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcfa01439a0 0x7fcfa0143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf9effd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fcfa00b7bd0 0x7fcfa00717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45584/0 (socket says 172.21.15.118:45584) 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf9effd640 1 -- 172.21.15.118:0/803040022 learned_addr learned my addr 172.21.15.118:0/803040022 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf9f7fe640 1 --2- 172.21.15.118:0/803040022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf97fff640 1 -- 172.21.15.118:0/803040022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 msgr2=0x7fcfa014a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf97fff640 1 --2- 172.21.15.118:0/803040022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa014a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf97fff640 1 -- 172.21.15.118:0/803040022 >> v1:172.21.15.118:6789/0 conn(0x7fcfa00b7bd0 legacy=0x7fcfa00717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf9e7fc640 1 -- 172.21.15.118:0/803040022 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014910760 0 0) 0x7fcf90001110 con 0x7fcfa00b7bd0 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf97fff640 1 -- 172.21.15.118:0/803040022 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0072100 con 0x7fcfa01439a0 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.458+0000 7fcf9f7fe640 1 --2- 172.21.15.118:0/803040022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:34.462 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.459+0000 7fcf97fff640 1 --2- 172.21.15.118:0/803040022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa0143da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf880097a0 tx=0x7fcf8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2141016660823ee4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:34.463 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.459+0000 7fcf9e7fc640 1 -- 172.21.15.118:0/803040022 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88031830 con 0x7fcfa01439a0 2024-02-18T10:00:34.463 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.459+0000 7fcf9e7fc640 1 -- 172.21.15.118:0/803040022 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf88031990 con 0x7fcfa01439a0 2024-02-18T10:00:34.463 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.459+0000 7fcf9e7fc640 1 -- 172.21.15.118:0/803040022 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88031d20 con 0x7fcfa01439a0 2024-02-18T10:00:34.466 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 -- 172.21.15.118:0/803040022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 msgr2=0x7fcfa0143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:34.466 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 --2- 172.21.15.118:0/803040022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa0143da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf880097a0 tx=0x7fcf8802b8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.466 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 -- 172.21.15.118:0/803040022 shutdown_connections 2024-02-18T10:00:34.466 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 --2- 172.21.15.118:0/803040022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 --2- 172.21.15.118:0/803040022 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa0143da0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 -- 172.21.15.118:0/803040022 >> 172.21.15.118:0/803040022 conn(0x7fcfa006bcf0 msgr2=0x7fcfa006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 -- 172.21.15.118:0/803040022 shutdown_connections 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.460+0000 7fcfa528a640 1 -- 172.21.15.118:0/803040022 wait complete. 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 Processor -- start 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 -- start start 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfa00b7bd0 0x7fcfa01d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa01df9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa01d5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01d53d0 con 0x7fcfa01439a0 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01df550 con 0x7fcfa00b7bd0 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.461+0000 7fcfa528a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa01d6b00 con 0x7fcfa0149c70 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa01df9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:34.467 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa01df9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47424/0 (socket says 172.21.15.118:47424) 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 -- 172.21.15.118:0/767928996 learned_addr learned my addr 172.21.15.118:0/767928996 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf9f7fe640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa01d5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf9effd640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfa00b7bd0 0x7fcfa01d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 -- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 msgr2=0x7fcfa01d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa01d5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 -- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfa00b7bd0 msgr2=0x7fcfa01d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfa00b7bd0 0x7fcfa01d4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.468 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 -- 172.21.15.118:0/767928996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88009400 con 0x7fcfa01439a0 2024-02-18T10:00:34.469 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf97fff640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa01df9e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcf8802bee0 tx=0x7fcf880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:34.469 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf977fe640 1 -- 172.21.15.118:0/767928996 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8803a6f0 con 0x7fcfa01439a0 2024-02-18T10:00:34.470 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf977fe640 1 -- 172.21.15.118:0/767928996 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8803a870 con 0x7fcfa01439a0 2024-02-18T10:00:34.470 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa014a190 con 0x7fcfa01439a0 2024-02-18T10:00:34.470 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf977fe640 1 -- 172.21.15.118:0/767928996 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8803ac20 con 0x7fcfa01439a0 2024-02-18T10:00:34.470 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa01d5660 con 0x7fcfa01439a0 2024-02-18T10:00:34.470 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf977fe640 1 -- 172.21.15.118:0/767928996 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcf8804d440 con 0x7fcfa01439a0 2024-02-18T10:00:34.470 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.462+0000 7fcf977fe640 1 -- 172.21.15.118:0/767928996 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcf88043c20 con 0x7fcfa01439a0 2024-02-18T10:00:34.470 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.463+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa0071cb0 con 0x7fcfa01439a0 2024-02-18T10:00:34.471 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.465+0000 7fcf977fe640 1 -- 172.21.15.118:0/767928996 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcf88048070 con 0x7fcfa01439a0 2024-02-18T10:00:34.529 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.527+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa0074b30 con 0x7fcfa01439a0 2024-02-18T10:00:34.530 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.527+0000 7fcf977fe640 1 -- 172.21.15.118:0/767928996 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fcf88035020 con 0x7fcfa01439a0 2024-02-18T10:00:34.530 INFO:teuthology.misc.health.smithi118.stdout: 2024-02-18T10:00:34.530 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":10,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:33.325587+0000","last_up_change":"0.000000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:34.531 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 msgr2=0x7fcfa01df9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:34.531 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa01df9e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcf8802bee0 tx=0x7fcf880046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.531 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 shutdown_connections 2024-02-18T10:00:34.531 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcfa0149c70 0x7fcfa01d5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.531 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcfa01439a0 0x7fcfa01df9e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.531 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 --2- 172.21.15.118:0/767928996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfa00b7bd0 0x7fcfa01d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:34.531 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 >> 172.21.15.118:0/767928996 conn(0x7fcfa006bcf0 msgr2=0x7fcfa00715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:34.532 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 shutdown_connections 2024-02-18T10:00:34.532 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:34.528+0000 7fcfa528a640 1 -- 172.21.15.118:0/767928996 wait complete. 2024-02-18T10:00:34.540 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-18T10:00:34.820 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:34.817+0000 7fa6cddd7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-18T10:00:34.889 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:34.887+0000 7f481a050040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-18T10:00:35.093 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:35.091+0000 7fa6cddd7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-18T10:00:35.144 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:35.141+0000 7fa6cddd7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-18T10:00:35.166 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:35.164+0000 7f481a050040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-18T10:00:35.218 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:35.216+0000 7f481a050040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-18T10:00:35.259 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:35.257+0000 7fa6cddd7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-18T10:00:35.339 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-02-18T10:00:35.337+0000 7f481a050040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-18T10:00:36.283 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:36.280+0000 7fa66f237640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-18T10:00:36.286 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-02-18T10:00:36.284+0000 7fa66f237640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-18T10:00:37.402 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-02-18T10:00:37.399+0000 7f8087621640 -1 osd.5 0 log_to_monitors true 2024-02-18T10:00:37.440 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-02-18T10:00:37.438+0000 7f995f8d3640 -1 osd.1 0 log_to_monitors true 2024-02-18T10:00:37.544 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-02-18T10:00:37.446+0000 7fc844fbd640 -1 osd.4 0 log_to_monitors true 2024-02-18T10:00:37.544 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-02-18T10:00:37.467+0000 7f0bf79f8640 -1 osd.3 0 log_to_monitors true 2024-02-18T10:00:37.545 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-02-18T10:00:37.449+0000 7f5164b0f640 -1 osd.6 0 log_to_monitors true 2024-02-18T10:00:37.545 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-02-18T10:00:37.478+0000 7f6724711640 -1 osd.2 0 log_to_monitors true 2024-02-18T10:00:37.545 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-02-18T10:00:37.480+0000 7f217ac19640 -1 osd.7 0 log_to_monitors true 2024-02-18T10:00:37.545 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-02-18T10:00:37.484+0000 7fbae740d640 -1 osd.0 0 log_to_monitors true 2024-02-18T10:00:40.596 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-02-18T10:00:40.593+0000 7f995b046640 -1 osd.1 0 waiting for initial osdmap 2024-02-18T10:00:40.611 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-02-18T10:00:40.609+0000 7f9953678640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:40.665 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-02-18T10:00:40.663+0000 7f0bf316b640 -1 osd.3 0 waiting for initial osdmap 2024-02-18T10:00:40.671 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-02-18T10:00:40.669+0000 7f671fe84640 -1 osd.2 0 waiting for initial osdmap 2024-02-18T10:00:40.678 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-02-18T10:00:40.676+0000 7f0beb79d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:40.680 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-02-18T10:00:40.678+0000 7fbae24b1640 -1 osd.0 0 waiting for initial osdmap 2024-02-18T10:00:40.685 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-02-18T10:00:40.683+0000 7f67184b6640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:40.697 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-02-18T10:00:40.695+0000 7fbadaae3640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:41.133 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-02-18T10:00:41.131+0000 7f5160282640 -1 osd.6 0 waiting for initial osdmap 2024-02-18T10:00:41.144 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-02-18T10:00:41.142+0000 7f51588b4640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:41.313 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-02-18T10:00:41.311+0000 7f2177601640 -1 osd.7 0 waiting for initial osdmap 2024-02-18T10:00:41.324 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-02-18T10:00:41.322+0000 7f216e3fb640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:41.334 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-02-18T10:00:41.332+0000 7f80827d4640 -1 osd.5 0 waiting for initial osdmap 2024-02-18T10:00:41.340 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-02-18T10:00:41.338+0000 7fc840730640 -1 osd.4 0 waiting for initial osdmap 2024-02-18T10:00:41.348 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:41.348 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-02-18T10:00:41.346+0000 7f807ae06640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:41.352 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-02-18T10:00:41.350+0000 7fc838d62640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-18T10:00:41.439 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.436+0000 7fc14c9e2640 1 Processor -- start 2024-02-18T10:00:41.439 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.436+0000 7fc14c9e2640 1 -- start start 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14c9e2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc148155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14c9e2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14814a1f0 con 0x7fc148143a90 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14c9e2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1480ba730 con 0x7fc14814a680 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14c9e2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc148143e70 con 0x7fc1480a0cd0 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14659c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc148143a90 0x7fc1480bbe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46506/0 (socket says 172.21.15.118:46506) 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14659c640 1 -- 172.21.15.118:0/996139684 learned_addr learned my addr 172.21.15.118:0/996139684 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc146d9d640 1 --2- 172.21.15.118:0/996139684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc148155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14559a640 1 -- 172.21.15.118:0/996139684 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161418561 0 0) 0x7fc14814a1f0 con 0x7fc148143a90 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14559a640 1 -- 172.21.15.118:0/996139684 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc130003520 con 0x7fc148143a90 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14559a640 1 -- 172.21.15.118:0/996139684 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083055641 0 0) 0x7fc1480ba730 con 0x7fc14814a680 2024-02-18T10:00:41.441 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.437+0000 7fc14559a640 1 -- 172.21.15.118:0/996139684 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc14814a1f0 con 0x7fc14814a680 2024-02-18T10:00:41.442 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.438+0000 7fc146d9d640 1 -- 172.21.15.118:0/996139684 >> v1:172.21.15.164:6789/0 conn(0x7fc14814a680 legacy=0x7fc1480ba020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.442 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.438+0000 7fc146d9d640 1 -- 172.21.15.118:0/996139684 >> v1:172.21.15.118:6789/0 conn(0x7fc148143a90 legacy=0x7fc1480bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.442 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.438+0000 7fc146d9d640 1 -- 172.21.15.118:0/996139684 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148149ba0 con 0x7fc1480a0cd0 2024-02-18T10:00:41.442 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.438+0000 7fc146d9d640 1 --2- 172.21.15.118:0/996139684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc148155320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097d0 tx=0x7fc14002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fccd098dff3efae server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:41.442 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.438+0000 7fc14559a640 1 -- 172.21.15.118:0/996139684 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140031770 con 0x7fc1480a0cd0 2024-02-18T10:00:41.442 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.438+0000 7fc14559a640 1 -- 172.21.15.118:0/996139684 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1400318d0 con 0x7fc1480a0cd0 2024-02-18T10:00:41.442 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.438+0000 7fc14559a640 1 -- 172.21.15.118:0/996139684 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140031c60 con 0x7fc1480a0cd0 2024-02-18T10:00:41.444 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.439+0000 7fc14c9e2640 1 -- 172.21.15.118:0/996139684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 msgr2=0x7fc148155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.439+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/996139684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc148155320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1400097d0 tx=0x7fc14002b810 comp rx=0 tx=0).stop 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.439+0000 7fc14c9e2640 1 -- 172.21.15.118:0/996139684 shutdown_connections 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.439+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/996139684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc148155320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.439+0000 7fc14c9e2640 1 -- 172.21.15.118:0/996139684 >> 172.21.15.118:0/996139684 conn(0x7fc14806b410 msgr2=0x7fc1480721e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.439+0000 7fc14c9e2640 1 -- 172.21.15.118:0/996139684 shutdown_connections 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.439+0000 7fc14c9e2640 1 -- 172.21.15.118:0/996139684 wait complete. 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.440+0000 7fc14c9e2640 1 Processor -- start 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.440+0000 7fc14c9e2640 1 -- start start 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc14c9e2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc1481df390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc14c9e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc148143a90 0x7fc1480b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc14c9e2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc14814a680 0x7fc14814bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc14c9e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480b5fb0 con 0x7fc148143a90 2024-02-18T10:00:41.445 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc14c9e2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480bd300 con 0x7fc14814a680 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc14c9e2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1481df9a0 con 0x7fc1480a0cd0 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc148143a90 0x7fc1480b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc148143a90 0x7fc1480b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35002/0 (socket says 172.21.15.118:35002) 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 -- 172.21.15.118:0/3260351497 learned_addr learned my addr 172.21.15.118:0/3260351497 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc146d9d640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc14814a680 0x7fc14814bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc14659c640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc1481df390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 -- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 msgr2=0x7fc1481df390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc1481df390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 -- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc14814a680 msgr2=0x7fc14814bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc14814a680 0x7fc14814bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc145d9b640 1 -- 172.21.15.118:0/3260351497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc140009400 con 0x7fc148143a90 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.441+0000 7fc146d9d640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc14814a680 0x7fc14814bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.442+0000 7fc145d9b640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc148143a90 0x7fc1480b5a70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c430 tx=0x7fc13c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:41.446 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.442+0000 7fc136ffd640 1 -- 172.21.15.118:0/3260351497 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0052d0 con 0x7fc148143a90 2024-02-18T10:00:41.447 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.442+0000 7fc136ffd640 1 -- 172.21.15.118:0/3260351497 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c005450 con 0x7fc148143a90 2024-02-18T10:00:41.447 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.442+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1481dfc80 con 0x7fc148143a90 2024-02-18T10:00:41.447 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.442+0000 7fc136ffd640 1 -- 172.21.15.118:0/3260351497 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c003830 con 0x7fc148143a90 2024-02-18T10:00:41.447 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.442+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1480bf550 con 0x7fc148143a90 2024-02-18T10:00:41.448 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.443+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1480bd790 con 0x7fc148143a90 2024-02-18T10:00:41.448 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.443+0000 7fc136ffd640 1 -- 172.21.15.118:0/3260351497 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7fc13c003990 con 0x7fc148143a90 2024-02-18T10:00:41.448 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.443+0000 7fc136ffd640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc12806bc10 0x7fc12806e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.448 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.444+0000 7fc14659c640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc12806bc10 0x7fc12806e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.448 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.444+0000 7fc136ffd640 1 -- 172.21.15.118:0/3260351497 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fc13c088da0 con 0x7fc148143a90 2024-02-18T10:00:41.448 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.444+0000 7fc14659c640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc12806bc10 0x7fc12806e0d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc138001560 tx=0x7fc138009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:41.450 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.448+0000 7fc136ffd640 1 -- 172.21.15.118:0/3260351497 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1480bd790 con 0x7fc148143a90 2024-02-18T10:00:41.629 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.627+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1480bd790 con 0x7fc148143a90 2024-02-18T10:00:41.630 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.627+0000 7fc136ffd640 1 -- 172.21.15.118:0/3260351497 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10933 (secure 0 0 0) 0x7fc1480bd790 con 0x7fc148143a90 2024-02-18T10:00:41.630 INFO:teuthology.misc.health.smithi118.stdout: 2024-02-18T10:00:41.630 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":13,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:41.464642+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:41.632 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc12806bc10 msgr2=0x7fc12806e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.632 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc12806bc10 0x7fc12806e0d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc138001560 tx=0x7fc138009040 comp rx=0 tx=0).stop 2024-02-18T10:00:41.632 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc148143a90 msgr2=0x7fc1480b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.632 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc148143a90 0x7fc1480b5a70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c430 tx=0x7fc13c00c8f0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 shutdown_connections 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc12806bc10 0x7fc12806e0d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc14814a680 0x7fc14814bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc148143a90 0x7fc1480b5a70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 --2- 172.21.15.118:0/3260351497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1480a0cd0 0x7fc1481df390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 >> 172.21.15.118:0/3260351497 conn(0x7fc14806b410 msgr2=0x7fc1480a39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 shutdown_connections 2024-02-18T10:00:41.633 INFO:teuthology.misc.health.smithi118.stderr:2024-02-18T10:00:41.629+0000 7fc14c9e2640 1 -- 172.21.15.118:0/3260351497 wait complete. 2024-02-18T10:00:41.641 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-18T10:00:41.641 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-18T10:00:41.642 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-18T10:00:41.642 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-18T10:00:41.644 INFO:tasks.ceph.mds.a:Started 2024-02-18T10:00:41.644 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-18T10:00:41.644 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-18T10:00:41.646 INFO:tasks.ceph.mds.c:Started 2024-02-18T10:00:41.646 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-18T10:00:41.646 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-18T10:00:41.649 INFO:tasks.ceph.mds.b:Started 2024-02-18T10:00:41.649 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-18T10:00:41.649 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:41.720 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-02-18T10:00:41.721 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-02-18T10:00:41.723 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-02-18T10:00:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.750+0000 7fc84cb43640 1 Processor -- start 2024-02-18T10:00:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.750+0000 7fc84cb43640 1 -- start start 2024-02-18T10:00:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84cb43640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84cb43640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc84814c490 0x7fc84814c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84cb43640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84814c000 con 0x7fc848072000 2024-02-18T10:00:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84cb43640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc848072860 con 0x7fc84814c490 2024-02-18T10:00:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84cb43640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480b3ee0 con 0x7fc848071c20 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84659c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc846d9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc84814c490 0x7fc84814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84659c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:58068/0 (socket says 172.21.15.118:58068) 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc846d9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc84814c490 0x7fc84814c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:49420/0 (socket says 172.21.15.118:49420) 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc845d9b640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc848072000 0x7fc848142960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:43598/0 (socket says 172.21.15.118:43598) 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.751+0000 7fc84659c640 1 -- 172.21.15.118:0/790824892 learned_addr learned my addr 172.21.15.118:0/790824892 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.752+0000 7fc846d9d640 1 -- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 msgr2=0x7fc8480712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.752+0000 7fc846d9d640 1 --2- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.752+0000 7fc846d9d640 1 -- 172.21.15.118:0/790824892 >> v1:172.21.15.164:6789/0 conn(0x7fc848072000 legacy=0x7fc848142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.752+0000 7fc846d9d640 1 -- 172.21.15.118:0/790824892 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc848143070 con 0x7fc84814c490 2024-02-18T10:00:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.752+0000 7fc84659c640 1 --2- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.752+0000 7fc846d9d640 1 --2- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 0x7fc84814c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc840009dc0 tx=0x7fc84002bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cad163594660a341 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84559a640 1 -- 172.21.15.118:0/790824892 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84002cb20 con 0x7fc84814c490 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84559a640 1 -- 172.21.15.118:0/790824892 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84002cc80 con 0x7fc84814c490 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84559a640 1 -- 172.21.15.118:0/790824892 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840034440 con 0x7fc84814c490 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 -- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 msgr2=0x7fc84814c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 --2- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 0x7fc84814c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc840009dc0 tx=0x7fc84002bd70 comp rx=0 tx=0).stop 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 -- 172.21.15.118:0/790824892 shutdown_connections 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 --2- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 0x7fc84814c920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 --2- 172.21.15.118:0/790824892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 -- 172.21.15.118:0/790824892 >> 172.21.15.118:0/790824892 conn(0x7fc8480badb0 msgr2=0x7fc8480bb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:41.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 -- 172.21.15.118:0/790824892 shutdown_connections 2024-02-18T10:00:41.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.753+0000 7fc84cb43640 1 -- 172.21.15.118:0/790824892 wait complete. 2024-02-18T10:00:41.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.754+0000 7fc84cb43640 1 Processor -- start 2024-02-18T10:00:41.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.754+0000 7fc84cb43640 1 -- start start 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc84cb43640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc84cb43640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc848072000 0x7fc8480b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc84cb43640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 0x7fc8481d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc84cb43640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8481d4180 con 0x7fc848072000 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc84cb43640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480b5fc0 con 0x7fc84814c490 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc84cb43640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8481d4720 con 0x7fc848071c20 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc848072000 0x7fc8480b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc848072000 0x7fc8480b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35042/0 (socket says 172.21.15.118:35042) 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 -- 172.21.15.118:0/1687665369 learned_addr learned my addr 172.21.15.118:0/1687665369 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc846d9d640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 0x7fc8481d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc84659c640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 -- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 msgr2=0x7fc8480b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 -- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 msgr2=0x7fc8481d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 0x7fc8481d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.755+0000 7fc845d9b640 1 -- 172.21.15.118:0/1687665369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380094d0 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.756+0000 7fc845d9b640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc848072000 0x7fc8480b7660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c400 tx=0x7fc83000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.756+0000 7fc83effd640 1 -- 172.21.15.118:0/1687665369 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300074e0 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.756+0000 7fc83effd640 1 -- 172.21.15.118:0/1687665369 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830007640 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.756+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc840009a70 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.756+0000 7fc83effd640 1 -- 172.21.15.118:0/1687665369 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830004a00 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.756+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8480b5730 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.757+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84806ed30 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.757+0000 7fc83effd640 1 -- 172.21.15.118:0/1687665369 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7fc830004b60 con 0x7fc848072000 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.758+0000 7fc83effd640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc82806bbe0 0x7fc82806e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.758+0000 7fc84659c640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc82806bbe0 0x7fc82806e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.758+0000 7fc83effd640 1 -- 172.21.15.118:0/1687665369 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fc830089bd0 con 0x7fc848072000 2024-02-18T10:00:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.758+0000 7fc84659c640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc82806bbe0 0x7fc82806e0a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc8481e0750 tx=0x7fc838009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.762+0000 7fc83effd640 1 -- 172.21.15.118:0/1687665369 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8300548f0 con 0x7fc848072000 2024-02-18T10:00:41.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.932+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc848074af0 con 0x7fc848072000 2024-02-18T10:00:41.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.933+0000 7fc83effd640 1 -- 172.21.15.118:0/1687665369 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10933 (secure 0 0 0) 0x7fc830057fb0 con 0x7fc848072000 2024-02-18T10:00:41.936 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:41.936 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:41.464642+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc82806bbe0 msgr2=0x7fc82806e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc82806bbe0 0x7fc82806e0a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc8481e0750 tx=0x7fc838009240 comp rx=0 tx=0).stop 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc848072000 msgr2=0x7fc8480b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc848072000 0x7fc8480b7660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c400 tx=0x7fc83000c8c0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 shutdown_connections 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc82806bbe0 0x7fc82806e0a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc84814c490 0x7fc8481d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc848072000 0x7fc8480b7660 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 --2- 172.21.15.118:0/1687665369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc848071c20 0x7fc8480b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 >> 172.21.15.118:0/1687665369 conn(0x7fc8480badb0 msgr2=0x7fc84813f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 shutdown_connections 2024-02-18T10:00:41.938 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:41.935+0000 7fc84cb43640 1 -- 172.21.15.118:0/1687665369 wait complete. 2024-02-18T10:00:41.948 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-02-18T10:00:41.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:00:42.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.045+0000 7fd0ff7e9640 1 Processor -- start 2024-02-18T10:00:42.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.045+0000 7fd0ff7e9640 1 -- start start 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0ff7e9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f814c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0ff7e9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd0f80bf260 0x7fd0f81565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0ff7e9640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f814be60 con 0x7fd0f80bd240 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0ff7e9640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f80bdbb0 con 0x7fd0f80bf260 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0ff7e9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80bf6d0 con 0x7fd0f806bc20 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fd585640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fdd86640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd0f80bf260 0x7fd0f81565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fd585640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:58086/0 (socket says 172.21.15.118:58086) 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fd585640 1 -- 172.21.15.118:0/3606687948 learned_addr learned my addr 172.21.15.118:0/3606687948 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fcd84640 1 --1- 172.21.15.118:0/3606687948 >> v1:172.21.15.164:6789/0 conn(0x7fd0f80bd240 0x7fd0f80bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:43610/0 (socket says 172.21.15.118:43610) 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fd585640 1 -- 172.21.15.118:0/3606687948 >> v2:172.21.15.164:3300/0 conn(0x7fd0f80bf260 msgr2=0x7fd0f81565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fd585640 1 --2- 172.21.15.118:0/3606687948 >> v2:172.21.15.164:3300/0 conn(0x7fd0f80bf260 0x7fd0f81565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fd585640 1 -- 172.21.15.118:0/3606687948 >> v1:172.21.15.164:6789/0 conn(0x7fd0f80bd240 legacy=0x7fd0f80bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fd585640 1 -- 172.21.15.118:0/3606687948 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f814c140 con 0x7fd0f806bc20 2024-02-18T10:00:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.046+0000 7fd0fdd86640 1 --2- 172.21.15.118:0/3606687948 >> v2:172.21.15.164:3300/0 conn(0x7fd0f80bf260 0x7fd0f81565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.047+0000 7fd0fd585640 1 --2- 172.21.15.118:0/3606687948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f814c940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009870 tx=0x7fd0f402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d657e9f1f223e24e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.047+0000 7fd0effff640 1 -- 172.21.15.118:0/3606687948 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4031640 con 0x7fd0f806bc20 2024-02-18T10:00:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.047+0000 7fd0effff640 1 -- 172.21.15.118:0/3606687948 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40317a0 con 0x7fd0f806bc20 2024-02-18T10:00:42.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.047+0000 7fd0effff640 1 -- 172.21.15.118:0/3606687948 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4031b30 con 0x7fd0f806bc20 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/3606687948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 msgr2=0x7fd0f814c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/3606687948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f814c940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009870 tx=0x7fd0f402b8f0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/3606687948 shutdown_connections 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/3606687948 >> v2:172.21.15.164:3300/0 conn(0x7fd0f80bf260 0x7fd0f81565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/3606687948 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f814c940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/3606687948 >> 172.21.15.118:0/3606687948 conn(0x7fd0f80c1850 msgr2=0x7fd0f80c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/3606687948 shutdown_connections 2024-02-18T10:00:42.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.048+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/3606687948 wait complete. 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.049+0000 7fd0ff7e9640 1 Processor -- start 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.049+0000 7fd0ff7e9640 1 -- start start 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.049+0000 7fd0ff7e9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f81e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.049+0000 7fd0ff7e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0f80bd240 0x7fd0f80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.049+0000 7fd0ff7e9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f80bf260 0x7fd0f80b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0ff7e9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80b6ce0 con 0x7fd0f80bd240 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0ff7e9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f81e1c20 con 0x7fd0f80bf260 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0ff7e9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8147230 con 0x7fd0f806bc20 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0f80bd240 0x7fd0f80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0f80bd240 0x7fd0f80b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35050/0 (socket says 172.21.15.118:35050) 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 -- 172.21.15.118:0/1587956011 learned_addr learned my addr 172.21.15.118:0/1587956011 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fd585640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f81e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fdd86640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f80bf260 0x7fd0f80b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 -- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 msgr2=0x7fd0f81e20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f81e20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 -- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f80bf260 msgr2=0x7fd0f80b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f80bf260 0x7fd0f80b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 -- 172.21.15.118:0/1587956011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0009a70 con 0x7fd0f80bd240 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0fcd84640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0f80bd240 0x7fd0f80b67a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8001eb0 tx=0x7fd0e800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0edffb640 1 -- 172.21.15.118:0/1587956011 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80074e0 con 0x7fd0f80bd240 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0edffb640 1 -- 172.21.15.118:0/1587956011 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8007660 con 0x7fd0f80bd240 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f40094d0 con 0x7fd0f80bd240 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.050+0000 7fd0edffb640 1 -- 172.21.15.118:0/1587956011 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8004a20 con 0x7fd0f80bd240 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.051+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f8146f50 con 0x7fd0f80bd240 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.051+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f8074af0 con 0x7fd0f80bd240 2024-02-18T10:00:42.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.052+0000 7fd0edffb640 1 -- 172.21.15.118:0/1587956011 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7fd0e8004b80 con 0x7fd0f80bd240 2024-02-18T10:00:42.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.052+0000 7fd0edffb640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd0dc06bbe0 0x7fd0dc06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:42.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.052+0000 7fd0fd585640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd0dc06bbe0 0x7fd0dc06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:42.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.052+0000 7fd0edffb640 1 -- 172.21.15.118:0/1587956011 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd0e80898e0 con 0x7fd0f80bd240 2024-02-18T10:00:42.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.053+0000 7fd0fd585640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd0dc06bbe0 0x7fd0dc06e0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4036000 tx=0x7fd0f403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:42.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.056+0000 7fd0edffb640 1 -- 172.21.15.118:0/1587956011 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0e8054700 con 0x7fd0f80bd240 2024-02-18T10:00:42.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.263+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0f80bcef0 con 0x7fd0f80bd240 2024-02-18T10:00:42.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.263+0000 7fd0edffb640 1 -- 172.21.15.118:0/1587956011 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fd0e8001120 con 0x7fd0f80bd240 2024-02-18T10:00:42.266 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:42.266 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-18T10:00:42.267 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 2 2024-02-18T10:00:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd0dc06bbe0 msgr2=0x7fd0dc06e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd0dc06bbe0 0x7fd0dc06e0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4036000 tx=0x7fd0f403c040 comp rx=0 tx=0).stop 2024-02-18T10:00:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0f80bd240 msgr2=0x7fd0f80b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0f80bd240 0x7fd0f80b67a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8001eb0 tx=0x7fd0e800c7d0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 shutdown_connections 2024-02-18T10:00:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd0dc06bbe0 0x7fd0dc06e0a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd0f80bf260 0x7fd0f80b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0f80bd240 0x7fd0f80b67a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 --2- 172.21.15.118:0/1587956011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd0f806bc20 0x7fd0f81e20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 >> 172.21.15.118:0/1587956011 conn(0x7fd0f80c1850 msgr2=0x7fd0f80a17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 shutdown_connections 2024-02-18T10:00:42.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:42.265+0000 7fd0ff7e9640 1 -- 172.21.15.118:0/1587956011 wait complete. 2024-02-18T10:00:44.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:00:44.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.386+0000 7f7e16488640 1 Processor -- start 2024-02-18T10:00:44.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.386+0000 7f7e16488640 1 -- start start 2024-02-18T10:00:44.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e16488640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 0x7f7e1014c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e16488640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1014be60 con 0x7f7e100bd240 2024-02-18T10:00:44.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e16488640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1014c140 con 0x7f7e100bf260 2024-02-18T10:00:44.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e16488640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100bdbb0 con 0x7f7e1006bc20 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0f7fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7e100bd240 0x7f7e100bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46538/0 (socket says 172.21.15.118:46538) 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0f7fe640 1 -- 172.21.15.118:0/1191193993 learned_addr learned my addr 172.21.15.118:0/1191193993 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0ffff640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 0x7f7e1014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539063264 0 0) 0x7f7e1014be60 con 0x7f7e100bd240 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df8003520 con 0x7f7e100bd240 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651198534 0 0) 0x7f7e1014c140 con 0x7f7e100bf260 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e1014be60 con 0x7f7e100bf260 2024-02-18T10:00:44.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636859169 0 0) 0x7f7df8003520 con 0x7f7e100bd240 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 msgr2=0x7f7e1014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 0x7f7e1014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 >> v1:172.21.15.164:6789/0 conn(0x7f7e100bf260 legacy=0x7f7e101565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1014c420 con 0x7f7e100bd240 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.387+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f7e04001690 con 0x7f7e100bd240 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 >> v1:172.21.15.118:6789/0 conn(0x7f7e100bd240 legacy=0x7f7e100bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0effd640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8003b30 0x7f7df8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0effd640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 0x7f7df80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0effd640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8004d00 0x7f7df8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100bdbb0 con 0x7f7df8004d00 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df800bb10 con 0x7f7df8003b30 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df800bca0 con 0x7f7e1006bc20 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e14a25640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8004d00 0x7f7df8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0ffff640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8003b30 0x7f7df8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e0f7fe640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 0x7f7df80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e14a25640 1 -- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 msgr2=0x7f7df80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e14a25640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e1006bc20 0x7f7df80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e14a25640 1 -- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8003b30 msgr2=0x7f7df8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e14a25640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8003b30 0x7f7df8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.388+0000 7f7e14a25640 1 -- 172.21.15.118:0/1191193993 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8003520 con 0x7f7df8004d00 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e14a25640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8004d00 0x7f7df8005180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e08002000 tx=0x7f7df80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5716336108b6dcf7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08003b70 con 0x7f7df8004d00 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08003cd0 con 0x7f7df8004d00 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e0effd640 1 -- 172.21.15.118:0/1191193993 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080052f0 con 0x7f7df8004d00 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e16488640 1 -- 172.21.15.118:0/1191193993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8004d00 msgr2=0x7f7df8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e16488640 1 --2- 172.21.15.118:0/1191193993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7df8004d00 0x7f7df8005180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e08002000 tx=0x7f7df80057f0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e14a25640 1 -- 172.21.15.118:0/1191193993 reap_dead start 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e16488640 1 -- 172.21.15.118:0/1191193993 shutdown_connections 2024-02-18T10:00:44.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e16488640 1 -- 172.21.15.118:0/1191193993 >> 172.21.15.118:0/1191193993 conn(0x7f7e100c1850 msgr2=0x7f7e100c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:44.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e16488640 1 -- 172.21.15.118:0/1191193993 shutdown_connections 2024-02-18T10:00:44.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.389+0000 7f7e16488640 1 -- 172.21.15.118:0/1191193993 wait complete. 2024-02-18T10:00:44.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.390+0000 7f7e16488640 1 Processor -- start 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e16488640 1 -- start start 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e16488640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8004d00 0x7f7e100bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e16488640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e100b4f70 0x7f7e100a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e16488640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e101e1bc0 0x7f7e101e5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e16488640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e100a5d20 con 0x7f7e101e1bc0 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e16488640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101e1450 con 0x7f7df8004d00 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e16488640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101e4950 con 0x7f7e100b4f70 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e14a25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e101e1bc0 0x7f7e101e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e14a25640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e101e1bc0 0x7f7e101e5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35072/0 (socket says 172.21.15.118:35072) 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.391+0000 7f7e14a25640 1 -- 172.21.15.118:0/2409364630 learned_addr learned my addr 172.21.15.118:0/2409364630 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e0ffff640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8004d00 0x7f7e100bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e0f7fe640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e100b4f70 0x7f7e100a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e14a25640 1 -- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e100b4f70 msgr2=0x7f7e100a57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e14a25640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e100b4f70 0x7f7e100a57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e14a25640 1 -- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8004d00 msgr2=0x7f7e100bb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e14a25640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8004d00 0x7f7e100bb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e14a25640 1 -- 172.21.15.118:0/2409364630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100a6060 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e0f7fe640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e100b4f70 0x7f7e100a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e14a25640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e101e1bc0 0x7f7e101e5030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e08002000 tx=0x7f7e08001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e0cff9640 1 -- 172.21.15.118:0/2409364630 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08005600 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e0cff9640 1 -- 172.21.15.118:0/2409364630 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08005760 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e100a6340 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e0cff9640 1 -- 172.21.15.118:0/2409364630 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0802c790 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.392+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e100b5ec0 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.393+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e100a64d0 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.393+0000 7f7e0cff9640 1 -- 172.21.15.118:0/2409364630 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7f7e0802c8f0 con 0x7f7e101e1bc0 2024-02-18T10:00:44.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.394+0000 7f7e0cff9640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dfc06bbe0 0x7f7dfc06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.394+0000 7f7e0cff9640 1 -- 172.21.15.118:0/2409364630 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f7e080ab130 con 0x7f7e101e1bc0 2024-02-18T10:00:44.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.394+0000 7f7e0ffff640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dfc06bbe0 0x7f7dfc06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.394+0000 7f7e0ffff640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dfc06bbe0 0x7f7dfc06e0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009b00 tx=0x7f7e00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:44.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.398+0000 7f7e0cff9640 1 -- 172.21.15.118:0/2409364630 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e08075de0 con 0x7f7e101e1bc0 2024-02-18T10:00:44.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.606+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e100a64d0 con 0x7f7e101e1bc0 2024-02-18T10:00:44.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.607+0000 7f7e0cff9640 1 -- 172.21.15.118:0/2409364630 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2913 (secure 0 0 0) 0x7f7e080794a0 con 0x7f7e101e1bc0 2024-02-18T10:00:44.609 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:44.609 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-18T10:00:44.610 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 3 2024-02-18T10:00:44.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dfc06bbe0 msgr2=0x7f7dfc06e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dfc06bbe0 0x7f7dfc06e0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009b00 tx=0x7f7e00008040 comp rx=0 tx=0).stop 2024-02-18T10:00:44.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e101e1bc0 msgr2=0x7f7e101e5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e101e1bc0 0x7f7e101e5030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e08002000 tx=0x7f7e08001650 comp rx=0 tx=0).stop 2024-02-18T10:00:44.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 shutdown_connections 2024-02-18T10:00:44.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dfc06bbe0 0x7f7dfc06e0a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7e101e1bc0 0x7f7e101e5030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7e100b4f70 0x7f7e100a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 --2- 172.21.15.118:0/2409364630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7df8004d00 0x7f7e100bb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 >> 172.21.15.118:0/2409364630 conn(0x7f7e100c1850 msgr2=0x7f7e100a17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:44.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.608+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 shutdown_connections 2024-02-18T10:00:44.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.609+0000 7f7e16488640 1 -- 172.21.15.118:0/2409364630 wait complete. 2024-02-18T10:00:44.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.719+0000 7fa45190c640 1 Processor -- start 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.719+0000 7fa45190c640 1 -- start start 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa45190c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa44c06bc20 0x7fa44c14c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa45190c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa44c0bd240 0x7fa44c0bf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa45190c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c14be60 con 0x7fa44c0bfe60 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa45190c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c0bdbb0 con 0x7fa44c0bd240 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa45190c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c14c140 con 0x7fa44c06bc20 2024-02-18T10:00:44.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa4427fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa44c0bd240 0x7fa44c0bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa4427fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa44c0bd240 0x7fa44c0bf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35074/0 (socket says 172.21.15.118:35074) 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa4427fc640 1 -- 172.21.15.118:0/1065741280 learned_addr learned my addr 172.21.15.118:0/1065741280 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa44affd640 1 --2- 172.21.15.118:0/1065741280 >> v2:172.21.15.164:3300/0 conn(0x7fa44c06bc20 0x7fa44c14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa4427fc640 1 -- 172.21.15.118:0/1065741280 >> v2:172.21.15.164:3300/0 conn(0x7fa44c06bc20 msgr2=0x7fa44c14c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa4427fc640 1 --2- 172.21.15.118:0/1065741280 >> v2:172.21.15.164:3300/0 conn(0x7fa44c06bc20 0x7fa44c14c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa4427fc640 1 -- 172.21.15.118:0/1065741280 >> v1:172.21.15.164:6789/0 conn(0x7fa44c0bfe60 legacy=0x7fa44c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa4427fc640 1 -- 172.21.15.118:0/1065741280 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c14c420 con 0x7fa44c0bd240 2024-02-18T10:00:44.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.720+0000 7fa44affd640 1 --2- 172.21.15.118:0/1065741280 >> v2:172.21.15.164:3300/0 conn(0x7fa44c06bc20 0x7fa44c14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:44.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.721+0000 7fa4427fc640 1 --2- 172.21.15.118:0/1065741280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c0bd240 0x7fa44c0bf260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa44c075150 tx=0x7fa43402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c4d7bc5b4e468b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:44.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.721+0000 7fa44a7fc640 1 -- 172.21.15.118:0/1065741280 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340317c0 con 0x7fa44c0bd240 2024-02-18T10:00:44.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.721+0000 7fa44a7fc640 1 -- 172.21.15.118:0/1065741280 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434031920 con 0x7fa44c0bd240 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.721+0000 7fa44a7fc640 1 -- 172.21.15.118:0/1065741280 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434031cb0 con 0x7fa44c0bd240 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 -- 172.21.15.118:0/1065741280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c0bd240 msgr2=0x7fa44c0bf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 --2- 172.21.15.118:0/1065741280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c0bd240 0x7fa44c0bf260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa44c075150 tx=0x7fa43402b860 comp rx=0 tx=0).stop 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 -- 172.21.15.118:0/1065741280 shutdown_connections 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 --2- 172.21.15.118:0/1065741280 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c0bd240 0x7fa44c0bf260 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 --2- 172.21.15.118:0/1065741280 >> v2:172.21.15.164:3300/0 conn(0x7fa44c06bc20 0x7fa44c14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 -- 172.21.15.118:0/1065741280 >> 172.21.15.118:0/1065741280 conn(0x7fa44c0c1850 msgr2=0x7fa44c0c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 -- 172.21.15.118:0/1065741280 shutdown_connections 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.722+0000 7fa45190c640 1 -- 172.21.15.118:0/1065741280 wait complete. 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 Processor -- start 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 -- start start 2024-02-18T10:00:44.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c06bc20 0x7fa44c0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa44c0bd240 0x7fa44c0b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa44c0bfe60 0x7fa44c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c1e59f0 con 0x7fa44c06bc20 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0b7590 con 0x7fa44c0bfe60 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.723+0000 7fa45190c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c1e4e00 con 0x7fa44c0bd240 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c06bc20 0x7fa44c0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c06bc20 0x7fa44c0b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35084/0 (socket says 172.21.15.118:35084) 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 -- 172.21.15.118:0/2017106874 learned_addr learned my addr 172.21.15.118:0/2017106874 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44b7fe640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa44c0bfe60 0x7fa44c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa4427fc640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa44c0bd240 0x7fa44c0b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 -- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa44c0bd240 msgr2=0x7fa44c0b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa44c0bd240 0x7fa44c0b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 -- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa44c0bfe60 msgr2=0x7fa44c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa44c0bfe60 0x7fa44c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 -- 172.21.15.118:0/2017106874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340094d0 con 0x7fa44c06bc20 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa4427fc640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa44c0bd240 0x7fa44c0b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa44affd640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c06bc20 0x7fa44c0b7050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c820 tx=0x7fa43c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa448ff9640 1 -- 172.21.15.118:0/2017106874 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c007a30 con 0x7fa44c06bc20 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa448ff9640 1 -- 172.21.15.118:0/2017106874 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c007b90 con 0x7fa44c06bc20 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c0b8be0 con 0x7fa44c06bc20 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa448ff9640 1 -- 172.21.15.118:0/2017106874 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00ce10 con 0x7fa44c06bc20 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.724+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c1e5330 con 0x7fa44c06bc20 2024-02-18T10:00:44.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.725+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c0a6b70 con 0x7fa44c06bc20 2024-02-18T10:00:44.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.726+0000 7fa448ff9640 1 -- 172.21.15.118:0/2017106874 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7fa43c0113f0 con 0x7fa44c06bc20 2024-02-18T10:00:44.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.726+0000 7fa448ff9640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42c06bbe0 0x7fa42c06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:44.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.726+0000 7fa448ff9640 1 -- 172.21.15.118:0/2017106874 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa43c08a2a0 con 0x7fa44c06bc20 2024-02-18T10:00:44.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.726+0000 7fa4427fc640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42c06bbe0 0x7fa42c06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:44.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.727+0000 7fa4427fc640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42c06bbe0 0x7fa42c06e0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa434036000 tx=0x7fa43403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:44.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.730+0000 7fa448ff9640 1 -- 172.21.15.118:0/2017106874 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa43c054ff0 con 0x7fa44c06bc20 2024-02-18T10:00:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.901+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44c0bcef0 con 0x7fa44c06bc20 2024-02-18T10:00:44.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.902+0000 7fa448ff9640 1 -- 172.21.15.118:0/2017106874 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12921 (secure 0 0 0) 0x7fa43c0586b0 con 0x7fa44c06bc20 2024-02-18T10:00:44.905 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:44.905 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":16,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:44.487215+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:44.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42c06bbe0 msgr2=0x7fa42c06e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42c06bbe0 0x7fa42c06e0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa434036000 tx=0x7fa43403d040 comp rx=0 tx=0).stop 2024-02-18T10:00:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c06bc20 msgr2=0x7fa44c0b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c06bc20 0x7fa44c0b7050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c820 tx=0x7fa43c00cce0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 shutdown_connections 2024-02-18T10:00:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42c06bbe0 0x7fa42c06e0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa44c0bfe60 0x7fa44c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa44c0bd240 0x7fa44c0b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 --2- 172.21.15.118:0/2017106874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa44c06bc20 0x7fa44c0b7050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 >> 172.21.15.118:0/2017106874 conn(0x7fa44c0c1850 msgr2=0x7fa44c0a1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 shutdown_connections 2024-02-18T10:00:44.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:44.904+0000 7fa45190c640 1 -- 172.21.15.118:0/2017106874 wait complete. 2024-02-18T10:00:44.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:00:44.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:00:45.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.021+0000 7f5e02415640 1 Processor -- start 2024-02-18T10:00:45.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.021+0000 7f5e02415640 1 -- start start 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.021+0000 7f5e02415640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.021+0000 7f5e02415640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5dfc06fdb0 0x7f5dfc154280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.021+0000 7f5e02415640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc0b9960 con 0x7f5dfc072a70 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.021+0000 7f5e02415640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc06b8b0 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.021+0000 7f5e02415640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc06b2f0 con 0x7f5dfc143e40 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5e009b2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5dfc06fdb0 0x7f5dfc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5dfb7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5dfc072a70 0x7f5dfc14a0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:43630/0 (socket says 172.21.15.118:43630) 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5dfb7fe640 1 -- 172.21.15.118:0/3311329739 learned_addr learned my addr 172.21.15.118:0/3311329739 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:45.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5e009b2640 1 -- 172.21.15.118:0/3311329739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 msgr2=0x7f5dfc070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:45.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5e009b2640 1 --2- 172.21.15.118:0/3311329739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5e009b2640 1 -- 172.21.15.118:0/3311329739 >> v1:172.21.15.164:6789/0 conn(0x7f5dfc072a70 legacy=0x7f5dfc14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.022+0000 7f5e009b2640 1 -- 172.21.15.118:0/3311329739 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc06b5d0 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5e009b2640 1 --2- 172.21.15.118:0/3311329739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc154280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009d90 tx=0x7f5df402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f315783043fa46 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5dfaffd640 1 -- 172.21.15.118:0/3311329739 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df402cce0 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5dfaffd640 1 -- 172.21.15.118:0/3311329739 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df402ce40 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5dfaffd640 1 -- 172.21.15.118:0/3311329739 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4034660 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5e02415640 1 -- 172.21.15.118:0/3311329739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc06fdb0 msgr2=0x7f5dfc154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5e02415640 1 --2- 172.21.15.118:0/3311329739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc154280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009d90 tx=0x7f5df402bf30 comp rx=0 tx=0).stop 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5e02415640 1 -- 172.21.15.118:0/3311329739 shutdown_connections 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5e02415640 1 --2- 172.21.15.118:0/3311329739 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc154280 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.023+0000 7f5e02415640 1 --2- 172.21.15.118:0/3311329739 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.024+0000 7f5e02415640 1 -- 172.21.15.118:0/3311329739 >> 172.21.15.118:0/3311329739 conn(0x7f5dfc0ba410 msgr2=0x7f5dfc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.024+0000 7f5e02415640 1 -- 172.21.15.118:0/3311329739 shutdown_connections 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.024+0000 7f5e02415640 1 -- 172.21.15.118:0/3311329739 wait complete. 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.024+0000 7f5e02415640 1 Processor -- start 2024-02-18T10:00:45.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e02415640 1 -- start start 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e02415640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc1d69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e02415640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc072a70 0x7f5dfc1448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e02415640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc1defb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e02415640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc1d6f10 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e02415640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc145f50 con 0x7f5dfc072a70 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e02415640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc1465e0 con 0x7f5dfc143e40 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc1d69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc1d69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35096/0 (socket says 172.21.15.118:35096) 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5dfbfff640 1 -- 172.21.15.118:0/2141063640 learned_addr learned my addr 172.21.15.118:0/2141063640 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5dfb7fe640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc072a70 0x7f5dfc1448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.025+0000 7f5e009b2640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc1defb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5dfbfff640 1 -- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 msgr2=0x7f5dfc1defb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5dfbfff640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc1defb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5dfbfff640 1 -- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc072a70 msgr2=0x7f5dfc1448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5dfbfff640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc072a70 0x7f5dfc1448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5dfbfff640 1 -- 172.21.15.118:0/2141063640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009a70 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5dfbfff640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc1d69d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9e0 tx=0x7f5dec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5df8ff9640 1 -- 172.21.15.118:0/2141063640 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec009670 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5df8ff9640 1 -- 172.21.15.118:0/2141063640 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00c9d0 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc145190 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5df8ff9640 1 -- 172.21.15.118:0/2141063640 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00cd80 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.026+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc146b60 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.027+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc06b9f0 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.027+0000 7f5df8ff9640 1 -- 172.21.15.118:0/2141063640 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7f5dec013470 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.028+0000 7f5df8ff9640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5de806bc10 0x7f5de806e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.028+0000 7f5dfb7fe640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5de806bc10 0x7f5de806e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.028+0000 7f5df8ff9640 1 -- 172.21.15.118:0/2141063640 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5dec08a450 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.028+0000 7f5dfb7fe640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5de806bc10 0x7f5de806e0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc142100 tx=0x7f5df0007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.032+0000 7f5df8ff9640 1 -- 172.21.15.118:0/2141063640 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5dec055110 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.222+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5dfc075150 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.223+0000 7f5df8ff9640 1 -- 172.21.15.118:0/2141063640 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5dec0587d0 con 0x7f5dfc06fdb0 2024-02-18T10:00:45.225 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:00:45.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.224+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5de806bc10 msgr2=0x7f5de806e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.224+0000 7f5e02415640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5de806bc10 0x7f5de806e0d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc142100 tx=0x7f5df0007e80 comp rx=0 tx=0).stop 2024-02-18T10:00:45.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.224+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dfc06fdb0 msgr2=0x7f5dfc1d69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.224+0000 7f5e02415640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc1d69d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9e0 tx=0x7f5dec00eea0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 shutdown_connections 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5de806bc10 0x7f5de806e0d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5dfc143e40 0x7f5dfc1defb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5dfc072a70 0x7f5dfc1448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 --2- 172.21.15.118:0/2141063640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dfc06fdb0 0x7f5dfc1d69d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 >> 172.21.15.118:0/2141063640 conn(0x7f5dfc0ba410 msgr2=0x7f5dfc0b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 shutdown_connections 2024-02-18T10:00:45.228 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.225+0000 7f5e02415640 1 -- 172.21.15.118:0/2141063640 wait complete. 2024-02-18T10:00:45.238 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-18T10:00:45.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.338+0000 7f2dc0fbc640 1 Processor -- start 2024-02-18T10:00:45.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.338+0000 7f2dc0fbc640 1 -- start start 2024-02-18T10:00:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dc0fbc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2dbc145c50 0x7f2dbc146090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dc0fbc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dbc070fe0 con 0x7f2dbc0ba1a0 2024-02-18T10:00:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dc0fbc640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dbc072e50 con 0x7f2dbc071f80 2024-02-18T10:00:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dc0fbc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dbc06e0b0 con 0x7f2dbc145c50 2024-02-18T10:00:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dbad9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2dbc145c50 0x7f2dbc146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dbad9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2dbc145c50 0x7f2dbc146090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35130/0 (socket says 172.21.15.118:35130) 2024-02-18T10:00:45.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2db1d9b640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2dbc0ba1a0 0x7f2dbc06eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46542/0 (socket says 172.21.15.118:46542) 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dbad9d640 1 -- 172.21.15.118:0/3338110434 learned_addr learned my addr 172.21.15.118:0/3338110434 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dbad9d640 1 -- 172.21.15.118:0/3338110434 >> v1:172.21.15.164:6789/0 conn(0x7f2dbc071f80 legacy=0x7f2dbc072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dbad9d640 1 -- 172.21.15.118:0/3338110434 >> v1:172.21.15.118:6789/0 conn(0x7f2dbc0ba1a0 legacy=0x7f2dbc06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.339+0000 7f2dbad9d640 1 -- 172.21.15.118:0/3338110434 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc071280 con 0x7f2dbc145c50 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dbad9d640 1 --2- 172.21.15.118:0/3338110434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc145c50 0x7f2dbc146090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009e50 tx=0x7f2db402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15436c15a60a21d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2db9d9b640 1 -- 172.21.15.118:0/3338110434 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db402c960 con 0x7f2dbc145c50 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2db9d9b640 1 -- 172.21.15.118:0/3338110434 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db402cac0 con 0x7f2dbc145c50 2024-02-18T10:00:45.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2db9d9b640 1 -- 172.21.15.118:0/3338110434 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db402ce50 con 0x7f2dbc145c50 2024-02-18T10:00:45.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/3338110434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc145c50 msgr2=0x7f2dbc146090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/3338110434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc145c50 0x7f2dbc146090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009e50 tx=0x7f2db402be40 comp rx=0 tx=0).stop 2024-02-18T10:00:45.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/3338110434 shutdown_connections 2024-02-18T10:00:45.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/3338110434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc145c50 0x7f2dbc146090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/3338110434 >> 172.21.15.118:0/3338110434 conn(0x7f2dbc06bcf0 msgr2=0x7f2dbc06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:45.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/3338110434 shutdown_connections 2024-02-18T10:00:45.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.340+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/3338110434 wait complete. 2024-02-18T10:00:45.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 Processor -- start 2024-02-18T10:00:45.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 -- start start 2024-02-18T10:00:45.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc071f80 0x7f2dbc0b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dbc0ba1a0 0x7f2dbc14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dbc145c50 0x7f2dbc14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc1e1cc0 con 0x7f2dbc071f80 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc1e1fa0 con 0x7f2dbc0ba1a0 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dc0fbc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc1e2280 con 0x7f2dbc145c50 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dba59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc071f80 0x7f2dbc0b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dba59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc071f80 0x7f2dbc0b8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35144/0 (socket says 172.21.15.118:35144) 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.342+0000 7f2dba59c640 1 -- 172.21.15.118:0/1012625011 learned_addr learned my addr 172.21.15.118:0/1012625011 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2db1d9b640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dbc0ba1a0 0x7f2dbc14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dbad9d640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dbc145c50 0x7f2dbc14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dba59c640 1 -- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dbc145c50 msgr2=0x7f2dbc14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dba59c640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dbc145c50 0x7f2dbc14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dba59c640 1 -- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dbc0ba1a0 msgr2=0x7f2dbc14f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dba59c640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dbc0ba1a0 0x7f2dbc14f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dba59c640 1 -- 172.21.15.118:0/1012625011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4009b30 con 0x7f2dbc071f80 2024-02-18T10:00:45.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dbad9d640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dbc145c50 0x7f2dbc14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dba59c640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc071f80 0x7f2dbc0b8c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c410 tx=0x7f2dac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2db37fe640 1 -- 172.21.15.118:0/1012625011 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0035f0 con 0x7f2dbc071f80 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2db37fe640 1 -- 172.21.15.118:0/1012625011 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac003750 con 0x7f2dbc071f80 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc1e2560 con 0x7f2dbc071f80 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2db37fe640 1 -- 172.21.15.118:0/1012625011 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac003b40 con 0x7f2dbc071f80 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.343+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dbc14d1c0 con 0x7f2dbc071f80 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.344+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dbc074af0 con 0x7f2dbc071f80 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.345+0000 7f2db37fe640 1 -- 172.21.15.118:0/1012625011 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7f2dac003ca0 con 0x7f2dbc071f80 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.345+0000 7f2db37fe640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d9c06bbe0 0x7f2d9c06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.345+0000 7f2db1d9b640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d9c06bbe0 0x7f2d9c06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.345+0000 7f2db37fe640 1 -- 172.21.15.118:0/1012625011 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2dac0899c0 con 0x7f2dbc071f80 2024-02-18T10:00:45.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.345+0000 7f2db1d9b640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d9c06bbe0 0x7f2d9c06e0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc14d6a0 tx=0x7f2da4007c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.350+0000 7f2db37fe640 1 -- 172.21.15.118:0/1012625011 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2dac0545d0 con 0x7f2dbc071f80 2024-02-18T10:00:45.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.532+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2dbc1e1e00 con 0x7f2dbc071f80 2024-02-18T10:00:45.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.533+0000 7f2db37fe640 1 -- 172.21.15.118:0/1012625011 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2dbc1e1e00 con 0x7f2dbc071f80 2024-02-18T10:00:45.535 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:45.536 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-02-18T10:00:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:00:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-02-18T10:00:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-02-18T10:00:45.536 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:00:45.536 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-02-18T10:00:45.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d9c06bbe0 msgr2=0x7f2d9c06e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d9c06bbe0 0x7f2d9c06e0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc14d6a0 tx=0x7f2da4007c80 comp rx=0 tx=0).stop 2024-02-18T10:00:45.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc071f80 msgr2=0x7f2dbc0b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc071f80 0x7f2dbc0b8c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c410 tx=0x7f2dac00c8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 shutdown_connections 2024-02-18T10:00:45.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d9c06bbe0 0x7f2d9c06e0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dbc145c50 0x7f2dbc14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dbc0ba1a0 0x7f2dbc14f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 --2- 172.21.15.118:0/1012625011 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dbc071f80 0x7f2dbc0b8c80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.534+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 >> 172.21.15.118:0/1012625011 conn(0x7f2dbc06bcf0 msgr2=0x7f2dbc1434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:45.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.535+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 shutdown_connections 2024-02-18T10:00:45.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.535+0000 7f2dc0fbc640 1 -- 172.21.15.118:0/1012625011 wait complete. 2024-02-18T10:00:45.547 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-18T10:00:45.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-18T10:00:45.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.649+0000 7f9cccbd0640 1 Processor -- start 2024-02-18T10:00:45.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.650+0000 7f9cccbd0640 1 -- start start 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.650+0000 7f9cccbd0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc80ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.650+0000 7f9cccbd0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cc8145dc0 0x7f9cc814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.650+0000 7f9cccbd0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc814be60 con 0x7f9cc8146200 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.650+0000 7f9cccbd0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80bab00 con 0x7f9cc8145dc0 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.650+0000 7f9cccbd0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80bacf0 con 0x7f9cc809e0e0 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cc8145dc0 0x7f9cc814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cc8145dc0 0x7f9cc814c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35158/0 (socket says 172.21.15.118:35158) 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2031088958 learned_addr learned my addr 172.21.15.118:0/2031088958 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc6d9d640 1 --1- 172.21.15.118:0/2031088958 >> v1:172.21.15.118:6789/0 conn(0x7f9cc8146200 0x7f9cc814f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46552/0 (socket says 172.21.15.118:46552) 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc659c640 1 --2- 172.21.15.118:0/2031088958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc80ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2031088958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 msgr2=0x7f9cc80ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc5d9b640 1 --2- 172.21.15.118:0/2031088958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc80ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2031088958 >> v1:172.21.15.118:6789/0 conn(0x7f9cc8146200 legacy=0x7f9cc814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2031088958 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80bafd0 con 0x7f9cc8145dc0 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc559a640 1 -- 172.21.15.118:0/2031088958 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456804932 0 0) 0x7f9cc814be60 con 0x7f9cc8146200 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.651+0000 7f9cc659c640 1 --2- 172.21.15.118:0/2031088958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc80ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cc5d9b640 1 --2- 172.21.15.118:0/2031088958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc814c2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009870 tx=0x7f9cbc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824b0ca4112be499 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cc559a640 1 -- 172.21.15.118:0/2031088958 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc030840 con 0x7f9cc8145dc0 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cc559a640 1 -- 172.21.15.118:0/2031088958 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc0309a0 con 0x7f9cc8145dc0 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cc559a640 1 -- 172.21.15.118:0/2031088958 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc030d30 con 0x7f9cc8145dc0 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2031088958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 msgr2=0x7f9cc814c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2031088958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc814c2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009870 tx=0x7f9cbc02b980 comp rx=0 tx=0).stop 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2031088958 shutdown_connections 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2031088958 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc814c2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2031088958 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc80ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2031088958 >> 172.21.15.118:0/2031088958 conn(0x7f9cc80bbfa0 msgr2=0x7f9cc80bc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:45.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2031088958 shutdown_connections 2024-02-18T10:00:45.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.652+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2031088958 wait complete. 2024-02-18T10:00:45.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.653+0000 7f9cccbd0640 1 Processor -- start 2024-02-18T10:00:45.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.653+0000 7f9cccbd0640 1 -- start start 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cccbd0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc814ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cccbd0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc81476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cccbd0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc8146200 0x7f9cc80a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cccbd0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc814b290 con 0x7f9cc8145dc0 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cccbd0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8146770 con 0x7f9cc8146200 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cccbd0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8147c00 con 0x7f9cc809e0e0 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc81476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc81476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35162/0 (socket says 172.21.15.118:35162) 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2635235293 learned_addr learned my addr 172.21.15.118:0/2635235293 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc659c640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc814ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc6d9d640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc8146200 0x7f9cc80a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 msgr2=0x7f9cc814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc814ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc8146200 msgr2=0x7f9cc80a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc8146200 0x7f9cc80a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.654+0000 7f9cc5d9b640 1 -- 172.21.15.118:0/2635235293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc0094d0 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.655+0000 7f9cc5d9b640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc81476c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c00 tx=0x7f9cbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.655+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc039c90 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.655+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc039df0 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.655+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc043640 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.655+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc8146a10 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.655+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc80b98e0 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.656+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc80a0670 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.656+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90050+0+0 (secure 0 0 0) 0x7f9cbc0437a0 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.657+0000 7f9cb6ffd640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ca806bbe0 0x7f9ca806e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.657+0000 7f9cc659c640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ca806bbe0 0x7f9ca806e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.657+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9cbc03e070 con 0x7f9cc8145dc0 2024-02-18T10:00:45.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.657+0000 7f9cc659c640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ca806bbe0 0x7f9ca806e0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006e80 tx=0x7f9cb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:45.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.661+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9cc80a0670 con 0x7f9cc8145dc0 2024-02-18T10:00:45.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:45.836+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9cc80a0670 con 0x7f9cc8145dc0 2024-02-18T10:00:46.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.312+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9cbc078330 con 0x7f9cc8145dc0 2024-02-18T10:00:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.726+0000 7f9cb6ffd640 1 -- 172.21.15.118:0/2635235293 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9cbc0913e0 con 0x7f9cc8145dc0 2024-02-18T10:00:46.729 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-02-18T10:00:46.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.729+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ca806bbe0 msgr2=0x7f9ca806e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:46.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.729+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ca806bbe0 0x7f9ca806e0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006e80 tx=0x7f9cb8008040 comp rx=0 tx=0).stop 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.729+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 msgr2=0x7f9cc81476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.729+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc81476c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c00 tx=0x7f9cbc004730 comp rx=0 tx=0).stop 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.729+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 shutdown_connections 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.729+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ca806bbe0 0x7f9ca806e0a0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006e80 tx=0x7f9cb8008040 comp rx=0 tx=0).stop 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.730+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cc8146200 0x7f9cc80a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.730+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cc8145dc0 0x7f9cc81476c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.730+0000 7f9cccbd0640 1 --2- 172.21.15.118:0/2635235293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cc809e0e0 0x7f9cc814ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.730+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 >> 172.21.15.118:0/2635235293 conn(0x7f9cc80bbfa0 msgr2=0x7f9cc80b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.730+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 shutdown_connections 2024-02-18T10:00:46.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.730+0000 7f9cccbd0640 1 -- 172.21.15.118:0/2635235293 wait complete. 2024-02-18T10:00:46.746 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-18T10:00:46.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f0036de2640 1 Processor -- start 2024-02-18T10:00:46.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f0036de2640 1 -- start start 2024-02-18T10:00:46.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f0036de2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f003014c870 0x7f003006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:46.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f0036de2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f003006b700 0x7f00300bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:46.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f0036de2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003006d130 con 0x7f003006bb40 2024-02-18T10:00:46.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f0036de2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00300bda50 con 0x7f003006b700 2024-02-18T10:00:46.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f0036de2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003006cf20 con 0x7f003014c870 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.851+0000 7f002ffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f003006b700 0x7f00300bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.852+0000 7f002ffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f003006b700 0x7f00300bfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35170/0 (socket says 172.21.15.118:35170) 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.852+0000 7f002ffff640 1 -- 172.21.15.118:0/1232613514 learned_addr learned my addr 172.21.15.118:0/1232613514 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.852+0000 7f002ffff640 1 -- 172.21.15.118:0/1232613514 >> v2:172.21.15.164:3300/0 conn(0x7f003014c870 msgr2=0x7f003006c9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.852+0000 7f002ffff640 1 --2- 172.21.15.118:0/1232613514 >> v2:172.21.15.164:3300/0 conn(0x7f003014c870 0x7f003006c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.852+0000 7f002ffff640 1 -- 172.21.15.118:0/1232613514 >> v1:172.21.15.164:6789/0 conn(0x7f003006bb40 legacy=0x7f003014f160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.852+0000 7f002ffff640 1 -- 172.21.15.118:0/1232613514 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300bdc30 con 0x7f003006b700 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f002ffff640 1 --2- 172.21.15.118:0/1232613514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300bfb10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00300bd790 tx=0x7f001c02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a46fc8a6bc03c24 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f002f7fe640 1 -- 172.21.15.118:0/1232613514 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c030880 con 0x7f003006b700 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f002f7fe640 1 -- 172.21.15.118:0/1232613514 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c0309e0 con 0x7f003006b700 2024-02-18T10:00:46.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f002f7fe640 1 -- 172.21.15.118:0/1232613514 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c030d70 con 0x7f003006b700 2024-02-18T10:00:46.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 -- 172.21.15.118:0/1232613514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 msgr2=0x7f00300bfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 --2- 172.21.15.118:0/1232613514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300bfb10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00300bd790 tx=0x7f001c02b9c0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 -- 172.21.15.118:0/1232613514 shutdown_connections 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 --2- 172.21.15.118:0/1232613514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300bfb10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 --2- 172.21.15.118:0/1232613514 >> v2:172.21.15.164:3300/0 conn(0x7f003014c870 0x7f003006c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 -- 172.21.15.118:0/1232613514 >> 172.21.15.118:0/1232613514 conn(0x7f00300c1650 msgr2=0x7f00300c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 -- 172.21.15.118:0/1232613514 shutdown_connections 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.853+0000 7f0036de2640 1 -- 172.21.15.118:0/1232613514 wait complete. 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.854+0000 7f0036de2640 1 Processor -- start 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.854+0000 7f0036de2640 1 -- start start 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0036de2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300baf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0036de2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f003006bb40 0x7f00300b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0036de2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003014c870 0x7f00300b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:46.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0036de2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00301e25b0 con 0x7f003006b700 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0036de2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00301e2120 con 0x7f003014c870 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0036de2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00301e1830 con 0x7f003006bb40 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300baf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35176/0 (socket says 172.21.15.118:35176) 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 -- 172.21.15.118:0/3982057823 learned_addr learned my addr 172.21.15.118:0/3982057823 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 -- 172.21.15.118:0/3982057823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f003006bb40 msgr2=0x7f00300b9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f003006bb40 0x7f00300b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 -- 172.21.15.118:0/3982057823 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003014c870 msgr2=0x7f00300b9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003014c870 0x7f00300b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.855+0000 7f0034b7e640 1 -- 172.21.15.118:0/3982057823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0094d0 con 0x7f003006b700 2024-02-18T10:00:46.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.856+0000 7f0034b7e640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300baf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f002400b410 tx=0x7f002400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.856+0000 7f002d7fa640 1 -- 172.21.15.118:0/3982057823 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024011830 con 0x7f003006b700 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.856+0000 7f002d7fa640 1 -- 172.21.15.118:0/3982057823 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024011990 con 0x7f003006b700 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.856+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00301e1ad0 con 0x7f003006b700 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.856+0000 7f002d7fa640 1 -- 172.21.15.118:0/3982057823 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024011d40 con 0x7f003006b700 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.856+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00301d2c70 con 0x7f003006b700 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.857+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0030075150 con 0x7f003006b700 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.857+0000 7f002d7fa640 1 -- 172.21.15.118:0/3982057823 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f002401a400 con 0x7f003006b700 2024-02-18T10:00:46.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.857+0000 7f002d7fa640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f001406bc70 0x7f001406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:46.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.857+0000 7f002ffff640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f001406bc70 0x7f001406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:46.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.857+0000 7f002d7fa640 1 -- 172.21.15.118:0/3982057823 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f002408a690 con 0x7f003006b700 2024-02-18T10:00:46.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.858+0000 7f002ffff640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f001406bc70 0x7f001406e130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f001c036000 tx=0x7f001c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:46.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:46.862+0000 7f002d7fa640 1 -- 172.21.15.118:0/3982057823 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0024055050 con 0x7f003006b700 2024-02-18T10:00:47.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.033+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0030074af0 con 0x7f003006b700 2024-02-18T10:00:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.730+0000 7f002d7fa640 1 -- 172.21.15.118:0/3982057823 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0024058710 con 0x7f003006b700 2024-02-18T10:00:47.733 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-02-18T10:00:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.733+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f001406bc70 msgr2=0x7f001406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.733+0000 7f0036de2640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f001406bc70 0x7f001406e130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f001c036000 tx=0x7f001c03b040 comp rx=0 tx=0).stop 2024-02-18T10:00:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.733+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 msgr2=0x7f00300baf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:47.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.733+0000 7f0036de2640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300baf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f002400b410 tx=0x7f002400b8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.734+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 shutdown_connections 2024-02-18T10:00:47.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.734+0000 7f0036de2640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f001406bc70 0x7f001406e130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.734+0000 7f0036de2640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f003014c870 0x7f00300b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.734+0000 7f0036de2640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f003006bb40 0x7f00300b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.734+0000 7f0036de2640 1 --2- 172.21.15.118:0/3982057823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f003006b700 0x7f00300baf80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.734+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 >> 172.21.15.118:0/3982057823 conn(0x7f00300c1650 msgr2=0x7f00300bb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:47.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.738+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 shutdown_connections 2024-02-18T10:00:47.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.740+0000 7f0036de2640 1 -- 172.21.15.118:0/3982057823 wait complete. 2024-02-18T10:00:47.761 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-18T10:00:47.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda20ac3640 1 Processor -- start 2024-02-18T10:00:47.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda20ac3640 1 -- start start 2024-02-18T10:00:47.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda20ac3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fda1c149440 0x7fda1c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:47.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda20ac3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda1c0bb600 0x7fda1c0ba500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:47.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda20ac3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c06c450 con 0x7fda1c0bf550 2024-02-18T10:00:47.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda20ac3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0bbb90 con 0x7fda1c0bb600 2024-02-18T10:00:47.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda20ac3640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c149820 con 0x7fda1c149440 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.861+0000 7fda19d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda1c0bb600 0x7fda1c0ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda1ad9d640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fda1c0bf550 0x7fda1c06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46562/0 (socket says 172.21.15.118:46562) 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda19d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda1c0bb600 0x7fda1c0ba500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35192/0 (socket says 172.21.15.118:35192) 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda1ad9d640 1 -- 172.21.15.118:0/1414491119 learned_addr learned my addr 172.21.15.118:0/1414491119 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda19d9b640 1 -- 172.21.15.118:0/1414491119 >> v2:172.21.15.164:3300/0 conn(0x7fda1c149440 msgr2=0x7fda1c06d8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda19d9b640 1 --2- 172.21.15.118:0/1414491119 >> v2:172.21.15.164:3300/0 conn(0x7fda1c149440 0x7fda1c06d8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda19d9b640 1 -- 172.21.15.118:0/1414491119 >> v1:172.21.15.118:6789/0 conn(0x7fda1c0bf550 legacy=0x7fda1c06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:47.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda19d9b640 1 -- 172.21.15.118:0/1414491119 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c06be90 con 0x7fda1c0bb600 2024-02-18T10:00:47.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.862+0000 7fda1959a640 1 -- 172.21.15.118:0/1414491119 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172120665 0 0) 0x7fda1c06c450 con 0x7fda1c0bf550 2024-02-18T10:00:47.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda19d9b640 1 --2- 172.21.15.118:0/1414491119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c0bb600 0x7fda1c0ba500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0bff80 tx=0x7fda1002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54647b515027b739 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:47.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda1959a640 1 -- 172.21.15.118:0/1414491119 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1002cc90 con 0x7fda1c0bb600 2024-02-18T10:00:47.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda1959a640 1 -- 172.21.15.118:0/1414491119 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1002cdf0 con 0x7fda1c0bb600 2024-02-18T10:00:47.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda1959a640 1 -- 172.21.15.118:0/1414491119 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10034660 con 0x7fda1c0bb600 2024-02-18T10:00:47.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 -- 172.21.15.118:0/1414491119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c0bb600 msgr2=0x7fda1c0ba500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:47.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 --2- 172.21.15.118:0/1414491119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c0bb600 0x7fda1c0ba500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0bff80 tx=0x7fda1002bee0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 -- 172.21.15.118:0/1414491119 shutdown_connections 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 --2- 172.21.15.118:0/1414491119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c0bb600 0x7fda1c0ba500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 --2- 172.21.15.118:0/1414491119 >> v2:172.21.15.164:3300/0 conn(0x7fda1c149440 0x7fda1c06d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 -- 172.21.15.118:0/1414491119 >> 172.21.15.118:0/1414491119 conn(0x7fda1c06adc0 msgr2=0x7fda1c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 -- 172.21.15.118:0/1414491119 shutdown_connections 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.863+0000 7fda20ac3640 1 -- 172.21.15.118:0/1414491119 wait complete. 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.864+0000 7fda20ac3640 1 Processor -- start 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.864+0000 7fda20ac3640 1 -- start start 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda20ac3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c0bb600 0x7fda1c1e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda20ac3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda1c0bf550 0x7fda1c0b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda20ac3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c149440 0x7fda1c0b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda20ac3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c1e4f90 con 0x7fda1c149440 2024-02-18T10:00:47.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda20ac3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0b4e00 con 0x7fda1c0bb600 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda20ac3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0b6960 con 0x7fda1c0bf550 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c149440 0x7fda1c0b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c149440 0x7fda1c0b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35206/0 (socket says 172.21.15.118:35206) 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 -- 172.21.15.118:0/4061189859 learned_addr learned my addr 172.21.15.118:0/4061189859 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 -- 172.21.15.118:0/4061189859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda1c0bf550 msgr2=0x7fda1c0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda1c0bf550 0x7fda1c0b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 -- 172.21.15.118:0/4061189859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c0bb600 msgr2=0x7fda1c1e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c0bb600 0x7fda1c1e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.865+0000 7fda1ad9d640 1 -- 172.21.15.118:0/4061189859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda10009a70 con 0x7fda1c149440 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.866+0000 7fda1ad9d640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c149440 0x7fda1c0b48c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00c450 tx=0x7fda0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.866+0000 7fda0affd640 1 -- 172.21.15.118:0/4061189859 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0074e0 con 0x7fda1c149440 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.866+0000 7fda0affd640 1 -- 172.21.15.118:0/4061189859 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c007660 con 0x7fda1c149440 2024-02-18T10:00:47.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.866+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c0b6bb0 con 0x7fda1c149440 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.866+0000 7fda0affd640 1 -- 172.21.15.118:0/4061189859 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c004a20 con 0x7fda1c149440 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.866+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c0b3f10 con 0x7fda1c149440 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.867+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c075150 con 0x7fda1c149440 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.867+0000 7fda0affd640 1 -- 172.21.15.118:0/4061189859 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fda0c004b80 con 0x7fda1c149440 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.868+0000 7fda0affd640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd9fc06bc70 0x7fd9fc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.868+0000 7fda1a59c640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd9fc06bc70 0x7fd9fc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.868+0000 7fda0affd640 1 -- 172.21.15.118:0/4061189859 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fda0c089be0 con 0x7fda1c149440 2024-02-18T10:00:47.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.868+0000 7fda1a59c640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd9fc06bc70 0x7fd9fc06e130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fda14009650 tx=0x7fda14006ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:47.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:47.872+0000 7fda0affd640 1 -- 172.21.15.118:0/4061189859 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda0c054420 con 0x7fda1c149440 2024-02-18T10:00:48.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.078+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fda1c0b27a0 con 0x7fda1c149440 2024-02-18T10:00:48.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.732+0000 7fda0affd640 1 -- 172.21.15.118:0/4061189859 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fda0c018020 con 0x7fda1c149440 2024-02-18T10:00:48.735 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 2 and data pool 3 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd9fc06bc70 msgr2=0x7fd9fc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd9fc06bc70 0x7fd9fc06e130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fda14009650 tx=0x7fda14006ba0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c149440 msgr2=0x7fda1c0b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c149440 0x7fda1c0b48c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00c450 tx=0x7fda0c00c910 comp rx=0 tx=0).stop 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 shutdown_connections 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd9fc06bc70 0x7fd9fc06e130 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fda14009650 tx=0x7fda14006ba0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda1c149440 0x7fda1c0b48c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fda1c0bf550 0x7fda1c0b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 --2- 172.21.15.118:0/4061189859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda1c0bb600 0x7fda1c1e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.735+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 >> 172.21.15.118:0/4061189859 conn(0x7fda1c06adc0 msgr2=0x7fda1c146a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:48.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.736+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 shutdown_connections 2024-02-18T10:00:48.739 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.736+0000 7fda20ac3640 1 -- 172.21.15.118:0/4061189859 wait complete. 2024-02-18T10:00:48.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.864+0000 7f6de9eb5640 1 Processor -- start 2024-02-18T10:00:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.864+0000 7f6de9eb5640 1 -- start start 2024-02-18T10:00:48.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.864+0000 7f6de9eb5640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6de40b9f30 0x7f6de4142860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.864+0000 7f6de9eb5640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de4149760 con 0x7f6de406e060 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.864+0000 7f6de9eb5640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40bab50 con 0x7f6de40b5240 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.864+0000 7f6de9eb5640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de406ec00 con 0x7f6de40b9f30 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de37fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6de40b9f30 0x7f6de4142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de3fff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6de406e060 0x7f6de4153280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46918/0 (socket says 172.21.15.118:46918) 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de37fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6de40b9f30 0x7f6de4142860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57256/0 (socket says 172.21.15.118:57256) 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de3fff640 1 -- 172.21.15.118:0/3856861520 learned_addr learned my addr 172.21.15.118:0/3856861520 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de37fe640 1 -- 172.21.15.118:0/3856861520 >> v1:172.21.15.164:6789/0 conn(0x7f6de40b5240 legacy=0x7f6de406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de37fe640 1 -- 172.21.15.118:0/3856861520 >> v1:172.21.15.118:6789/0 conn(0x7f6de406e060 legacy=0x7f6de4153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de37fe640 1 -- 172.21.15.118:0/3856861520 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4148e30 con 0x7f6de40b9f30 2024-02-18T10:00:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.865+0000 7f6de2ffd640 1 -- 172.21.15.118:0/3856861520 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604620080 0 0) 0x7f6de4149760 con 0x7f6de406e060 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de37fe640 1 --2- 172.21.15.118:0/3856861520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b9f30 0x7f6de4142860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40097a0 tx=0x7f6dd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbbfd98f71e6064 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de2ffd640 1 -- 172.21.15.118:0/3856861520 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4031830 con 0x7f6de40b9f30 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de2ffd640 1 -- 172.21.15.118:0/3856861520 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd4031990 con 0x7f6de40b9f30 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de2ffd640 1 -- 172.21.15.118:0/3856861520 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4031d20 con 0x7f6de40b9f30 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de9eb5640 1 -- 172.21.15.118:0/3856861520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b9f30 msgr2=0x7f6de4142860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/3856861520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b9f30 0x7f6de4142860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40097a0 tx=0x7f6dd402b8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de9eb5640 1 -- 172.21.15.118:0/3856861520 shutdown_connections 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/3856861520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b9f30 0x7f6de4142860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de9eb5640 1 -- 172.21.15.118:0/3856861520 >> 172.21.15.118:0/3856861520 conn(0x7f6de406bcf0 msgr2=0x7f6de406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de9eb5640 1 -- 172.21.15.118:0/3856861520 shutdown_connections 2024-02-18T10:00:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.866+0000 7f6de9eb5640 1 -- 172.21.15.118:0/3856861520 wait complete. 2024-02-18T10:00:48.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.867+0000 7f6de9eb5640 1 Processor -- start 2024-02-18T10:00:48.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.867+0000 7f6de9eb5640 1 -- start start 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de9eb5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de406e060 0x7f6de413dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de9eb5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b5240 0x7f6de413e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de9eb5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de40b9f30 0x7f6de41e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de9eb5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de413e250 con 0x7f6de40b5240 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de9eb5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de413c220 con 0x7f6de40b9f30 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de9eb5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de413f3a0 con 0x7f6de406e060 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b5240 0x7f6de413e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b5240 0x7f6de413e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57266/0 (socket says 172.21.15.118:57266) 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 -- 172.21.15.118:0/412291817 learned_addr learned my addr 172.21.15.118:0/412291817 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de3fff640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de40b9f30 0x7f6de41e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6de37fe640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de406e060 0x7f6de413dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 -- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de406e060 msgr2=0x7f6de413dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de406e060 0x7f6de413dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 -- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de40b9f30 msgr2=0x7f6de41e01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de40b9f30 0x7f6de41e01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 -- 172.21.15.118:0/412291817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4009400 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.868+0000 7f6ddbfff640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b5240 0x7f6de413e900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c430 tx=0x7f6dcc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.869+0000 7f6de0ff9640 1 -- 172.21.15.118:0/412291817 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc011790 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.869+0000 7f6de0ff9640 1 -- 172.21.15.118:0/412291817 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc0118f0 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.869+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de4072f30 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.869+0000 7f6de0ff9640 1 -- 172.21.15.118:0/412291817 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc011ca0 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.869+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de40723b0 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.870+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de4074af0 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.870+0000 7f6de0ff9640 1 -- 172.21.15.118:0/412291817 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f6dcc01c460 con 0x7f6de40b5240 2024-02-18T10:00:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.870+0000 7f6de0ff9640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dc406bc70 0x7f6dc406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:48.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.870+0000 7f6de37fe640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dc406bc70 0x7f6dc406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:48.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.870+0000 7f6de0ff9640 1 -- 172.21.15.118:0/412291817 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dcc08a650 con 0x7f6de40b5240 2024-02-18T10:00:48.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.871+0000 7f6de37fe640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dc406bc70 0x7f6dc406e130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4036000 tx=0x7f6dd4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:48.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:48.875+0000 7f6de0ff9640 1 -- 172.21.15.118:0/412291817 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6dcc054ec0 con 0x7f6de40b5240 2024-02-18T10:00:49.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.049+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6de406d1f0 con 0x7f6de40b5240 2024-02-18T10:00:49.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.050+0000 7f6de0ff9640 1 -- 172.21.15.118:0/412291817 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16642 (secure 0 0 0) 0x7f6dcc058580 con 0x7f6de40b5240 2024-02-18T10:00:49.053 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:49.053 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:48.080248+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dc406bc70 msgr2=0x7f6dc406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dc406bc70 0x7f6dc406e130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4036000 tx=0x7f6dd4008030 comp rx=0 tx=0).stop 2024-02-18T10:00:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b5240 msgr2=0x7f6de413e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b5240 0x7f6de413e900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c430 tx=0x7f6dcc00c8f0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 shutdown_connections 2024-02-18T10:00:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dc406bc70 0x7f6dc406e130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de40b9f30 0x7f6de41e01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40b5240 0x7f6de413e900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 --2- 172.21.15.118:0/412291817 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de406e060 0x7f6de413dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 >> 172.21.15.118:0/412291817 conn(0x7f6de406bcf0 msgr2=0x7f6de40b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 shutdown_connections 2024-02-18T10:00:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.052+0000 7f6de9eb5640 1 -- 172.21.15.118:0/412291817 wait complete. 2024-02-18T10:00:49.066 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:49.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.162+0000 7f91331c2640 1 Processor -- start 2024-02-18T10:00:49.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.162+0000 7f91331c2640 1 -- start start 2024-02-18T10:00:49.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f91331c2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f912c1460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f91331c2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c070fe0 con 0x7f912c071f80 2024-02-18T10:00:49.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f91331c2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c072e50 con 0x7f912c0ba1a0 2024-02-18T10:00:49.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f91331c2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c06e0b0 con 0x7f912c145c50 2024-02-18T10:00:49.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f9130f5e640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f912c071f80 0x7f912c072690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46930/0 (socket says 172.21.15.118:46930) 2024-02-18T10:00:49.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f9130f5e640 1 -- 172.21.15.118:0/1043818846 learned_addr learned my addr 172.21.15.118:0/1043818846 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:49.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335264222 0 0) 0x7f912c070fe0 con 0x7f912c071f80 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9114003520 con 0x7f912c071f80 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.163+0000 7f913175f640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f912c1460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979767590 0 0) 0x7f9114003520 con 0x7f912c071f80 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 msgr2=0x7f912c1460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f912c1460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 >> v1:172.21.15.164:6789/0 conn(0x7f912c0ba1a0 legacy=0x7f912c06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c071280 con 0x7f912c071f80 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f911c001670 con 0x7f912c071f80 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f913175f640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f912c1460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 >> v1:172.21.15.118:6789/0 conn(0x7f912c071f80 legacy=0x7f912c072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91140039a0 0x7f9114003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f91140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9114004d00 0x7f9114005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911400baf0 con 0x7f91140039a0 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911400bc60 con 0x7f9114004d00 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911400be20 con 0x7f912c145c50 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f9130f5e640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91140039a0 0x7f9114003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912bfff640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f91140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f913175f640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9114004d00 0x7f9114005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f9130f5e640 1 -- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 msgr2=0x7f91140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f9130f5e640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f91140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f9130f5e640 1 -- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9114004d00 msgr2=0x7f9114005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f9130f5e640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9114004d00 0x7f9114005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f9130f5e640 1 -- 172.21.15.118:0/1043818846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114003520 con 0x7f91140039a0 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f913175f640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9114004d00 0x7f9114005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.164+0000 7f912bfff640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f912c145c50 0x7f91140047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f9130f5e640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91140039a0 0x7f9114003dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c210 tx=0x7f91140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa8cd8675f88f8f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c005ad0 con 0x7f91140039a0 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c005c30 con 0x7f91140039a0 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f912b7fe640 1 -- 172.21.15.118:0/1043818846 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c02c7c0 con 0x7f91140039a0 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f91331c2640 1 -- 172.21.15.118:0/1043818846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91140039a0 msgr2=0x7f9114003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f91331c2640 1 --2- 172.21.15.118:0/1043818846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91140039a0 0x7f9114003dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c210 tx=0x7f91140057f0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f913175f640 1 -- 172.21.15.118:0/1043818846 reap_dead start 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f91331c2640 1 -- 172.21.15.118:0/1043818846 shutdown_connections 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f91331c2640 1 -- 172.21.15.118:0/1043818846 >> 172.21.15.118:0/1043818846 conn(0x7f912c06bcf0 msgr2=0x7f912c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.165+0000 7f91331c2640 1 -- 172.21.15.118:0/1043818846 shutdown_connections 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.166+0000 7f91331c2640 1 -- 172.21.15.118:0/1043818846 wait complete. 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.166+0000 7f91331c2640 1 Processor -- start 2024-02-18T10:00:49.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f91331c2640 1 -- start start 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f91331c2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91140039a0 0x7f912c1e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f91331c2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f912c13dc80 0x7f912c13cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f91331c2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f912c13d1a0 0x7f912c1e1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f91331c2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c13c7d0 con 0x7f912c13d1a0 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f91331c2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c09e240 con 0x7f912c13dc80 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f91331c2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c1e5530 con 0x7f91140039a0 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f913175f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f912c13d1a0 0x7f912c1e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f913175f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f912c13d1a0 0x7f912c1e1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57272/0 (socket says 172.21.15.118:57272) 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f913175f640 1 -- 172.21.15.118:0/334664959 learned_addr learned my addr 172.21.15.118:0/334664959 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f9130f5e640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91140039a0 0x7f912c1e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.167+0000 7f912bfff640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f912c13dc80 0x7f912c13cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f913175f640 1 -- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91140039a0 msgr2=0x7f912c1e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f913175f640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91140039a0 0x7f912c1e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f913175f640 1 -- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f912c13dc80 msgr2=0x7f912c13cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f913175f640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f912c13dc80 0x7f912c13cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f913175f640 1 -- 172.21.15.118:0/334664959 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c1e5810 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f912bfff640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f912c13dc80 0x7f912c13cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f913175f640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f912c13d1a0 0x7f912c1e1460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f912c146030 tx=0x7f9124004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f91297fa640 1 -- 172.21.15.118:0/334664959 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124007c70 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f91297fa640 1 -- 172.21.15.118:0/334664959 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912400f050 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f91297fa640 1 -- 172.21.15.118:0/334664959 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124014410 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912c13c460 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.168+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c13b270 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.169+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c13c980 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.169+0000 7f91297fa640 1 -- 172.21.15.118:0/334664959 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9124014570 con 0x7f912c13d1a0 2024-02-18T10:00:49.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.170+0000 7f91297fa640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f911806bc70 0x7f911806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.170+0000 7f9130f5e640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f911806bc70 0x7f911806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.170+0000 7f91297fa640 1 -- 172.21.15.118:0/334664959 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f912408abd0 con 0x7f912c13d1a0 2024-02-18T10:00:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.170+0000 7f9130f5e640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f911806bc70 0x7f911806e130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f911c034000 tx=0x7f911c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.174+0000 7f91297fa640 1 -- 172.21.15.118:0/334664959 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f912c13c980 con 0x7f912c13d1a0 2024-02-18T10:00:49.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.345+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f912c13b400 con 0x7f912c13d1a0 2024-02-18T10:00:49.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.346+0000 7f91297fa640 1 -- 172.21.15.118:0/334664959 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16642 (secure 0 0 0) 0x7f9124055320 con 0x7f912c13d1a0 2024-02-18T10:00:49.349 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:49.349 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:48.080248+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:49.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f911806bc70 msgr2=0x7f911806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f911806bc70 0x7f911806e130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f911c034000 tx=0x7f911c009030 comp rx=0 tx=0).stop 2024-02-18T10:00:49.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f912c13d1a0 msgr2=0x7f912c1e1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f912c13d1a0 0x7f912c1e1460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f912c146030 tx=0x7f9124004770 comp rx=0 tx=0).stop 2024-02-18T10:00:49.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 shutdown_connections 2024-02-18T10:00:49.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f911806bc70 0x7f911806e130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f912c13d1a0 0x7f912c1e1460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f912c13dc80 0x7f912c13cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 --2- 172.21.15.118:0/334664959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f91140039a0 0x7f912c1e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 >> 172.21.15.118:0/334664959 conn(0x7f912c06bcf0 msgr2=0x7f912c0a1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:49.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 shutdown_connections 2024-02-18T10:00:49.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.348+0000 7f91331c2640 1 -- 172.21.15.118:0/334664959 wait complete. 2024-02-18T10:00:49.362 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-18T10:00:49.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.463+0000 7f73d809a640 1 Processor -- start 2024-02-18T10:00:49.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.463+0000 7f73d809a640 1 -- start start 2024-02-18T10:00:49.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d809a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f73d0143e10 0x7f73d00bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d809a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d006f930 0x7f73d0149c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d809a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d014d460 con 0x7f73d014cf80 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d809a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d014d740 con 0x7f73d0143e10 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d809a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d014da20 con 0x7f73d006f930 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5e36640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f73d0143e10 0x7f73d00bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5e36640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f73d0143e10 0x7f73d00bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57276/0 (socket says 172.21.15.118:57276) 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5e36640 1 -- 172.21.15.118:0/108925077 learned_addr learned my addr 172.21.15.118:0/108925077 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5635640 1 --2- 172.21.15.118:0/108925077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d006f930 0x7f73d0149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5e36640 1 -- 172.21.15.118:0/108925077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d006f930 msgr2=0x7f73d0149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5e36640 1 --2- 172.21.15.118:0/108925077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d006f930 0x7f73d0149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5e36640 1 -- 172.21.15.118:0/108925077 >> v1:172.21.15.164:6789/0 conn(0x7f73d014cf80 legacy=0x7f73d006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.464+0000 7f73d5e36640 1 -- 172.21.15.118:0/108925077 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d014dd00 con 0x7f73d0143e10 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.465+0000 7f73d5e36640 1 --2- 172.21.15.118:0/108925077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d00bf600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009870 tx=0x7f73cc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3211a5ce00f30e34 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.465+0000 7f73d4e34640 1 -- 172.21.15.118:0/108925077 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc02f840 con 0x7f73d0143e10 2024-02-18T10:00:49.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.465+0000 7f73d4e34640 1 -- 172.21.15.118:0/108925077 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc02f9a0 con 0x7f73d0143e10 2024-02-18T10:00:49.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.465+0000 7f73d4e34640 1 -- 172.21.15.118:0/108925077 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc02fd30 con 0x7f73d0143e10 2024-02-18T10:00:49.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.465+0000 7f73d809a640 1 -- 172.21.15.118:0/108925077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 msgr2=0x7f73d00bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.465+0000 7f73d809a640 1 --2- 172.21.15.118:0/108925077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d00bf600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009870 tx=0x7f73cc02ba20 comp rx=0 tx=0).stop 2024-02-18T10:00:49.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.466+0000 7f73d809a640 1 -- 172.21.15.118:0/108925077 shutdown_connections 2024-02-18T10:00:49.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.466+0000 7f73d809a640 1 --2- 172.21.15.118:0/108925077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d006f930 0x7f73d0149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.466+0000 7f73d809a640 1 --2- 172.21.15.118:0/108925077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d00bf600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.466+0000 7f73d809a640 1 -- 172.21.15.118:0/108925077 >> 172.21.15.118:0/108925077 conn(0x7f73d006adc0 msgr2=0x7f73d006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:49.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.466+0000 7f73d809a640 1 -- 172.21.15.118:0/108925077 shutdown_connections 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.466+0000 7f73d809a640 1 -- 172.21.15.118:0/108925077 wait complete. 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 Processor -- start 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 -- start start 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d01d4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d014cf80 0x7f73d0146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d01471c0 0x7f73d01e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d01d5e80 con 0x7f73d0143e10 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d01d6120 con 0x7f73d01471c0 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d809a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d01d4200 con 0x7f73d014cf80 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d5e36640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d01d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d5e36640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d01d4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57290/0 (socket says 172.21.15.118:57290) 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d5e36640 1 -- 172.21.15.118:0/694129625 learned_addr learned my addr 172.21.15.118:0/694129625 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d6637640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d01471c0 0x7f73d01e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.467+0000 7f73d5e36640 1 -- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d014cf80 msgr2=0x7f73d0146c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d5e36640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d014cf80 0x7f73d0146c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d5e36640 1 -- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d01471c0 msgr2=0x7f73d01e2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d5e36640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d01471c0 0x7f73d01e2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d5e36640 1 -- 172.21.15.118:0/694129625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc0094d0 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d6637640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d01471c0 0x7f73d01e2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d5e36640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d01d4720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000c00 tx=0x7f73cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73c67fc640 1 -- 172.21.15.118:0/694129625 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc037c40 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73c67fc640 1 -- 172.21.15.118:0/694129625 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc037da0 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d00b3790 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73c67fc640 1 -- 172.21.15.118:0/694129625 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc041640 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.468+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d01df510 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.469+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d0075150 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.469+0000 7f73c67fc640 1 -- 172.21.15.118:0/694129625 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f73cc0417a0 con 0x7f73d0143e10 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.470+0000 7f73c67fc640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f73b406bc70 0x7f73b406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.470+0000 7f73c67fc640 1 -- 172.21.15.118:0/694129625 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73cc03c070 con 0x7f73d0143e10 2024-02-18T10:00:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.470+0000 7f73d5635640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f73b406bc70 0x7f73b406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.470+0000 7f73d5635640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f73b406bc70 0x7f73b406e130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f73d0148b00 tx=0x7f73c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.474+0000 7f73c67fc640 1 -- 172.21.15.118:0/694129625 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f73cc077dd0 con 0x7f73d0143e10 2024-02-18T10:00:49.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.682+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f73d0074af0 con 0x7f73d0143e10 2024-02-18T10:00:49.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.753+0000 7f73c67fc640 1 -- 172.21.15.118:0/694129625 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f73cc07b490 con 0x7f73d0143e10 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f73b406bc70 msgr2=0x7f73b406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f73b406bc70 0x7f73b406e130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f73d0148b00 tx=0x7f73c0008040 comp rx=0 tx=0).stop 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 msgr2=0x7f73d01d4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d01d4720 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73cc000c00 tx=0x7f73cc004730 comp rx=0 tx=0).stop 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 shutdown_connections 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f73b406bc70 0x7f73b406e130 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d01471c0 0x7f73d01e2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d014cf80 0x7f73d0146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 --2- 172.21.15.118:0/694129625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73d0143e10 0x7f73d01d4720 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 >> 172.21.15.118:0/694129625 conn(0x7f73d006adc0 msgr2=0x7f73d00ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:49.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 shutdown_connections 2024-02-18T10:00:49.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.756+0000 7f73d809a640 1 -- 172.21.15.118:0/694129625 wait complete. 2024-02-18T10:00:49.769 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-18T10:00:49.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-18T10:00:49.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe105839640 1 Processor -- start 2024-02-18T10:00:49.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe105839640 1 -- start start 2024-02-18T10:00:49.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe105839640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1000c0220 0x7fe1001574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe105839640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10006d130 con 0x7fe10006c9e0 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe105839640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10006be10 con 0x7fe10014c870 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe105839640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1000bda50 con 0x7fe1000c0220 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe0ff7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1000c0220 0x7fe1001574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe0ff7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1000c0220 0x7fe1001574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57292/0 (socket says 172.21.15.118:57292) 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe0ff7fe640 1 -- 172.21.15.118:0/2717332864 learned_addr learned my addr 172.21.15.118:0/2717332864 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.869+0000 7fe0fe7fc640 1 --1- 172.21.15.118:0/2717332864 >> v1:172.21.15.118:6789/0 conn(0x7fe10006c9e0 0x7fe1000bfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46936/0 (socket says 172.21.15.118:46936) 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.870+0000 7fe0ff7fe640 1 -- 172.21.15.118:0/2717332864 >> v1:172.21.15.164:6789/0 conn(0x7fe10014c870 legacy=0x7fe10006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.870+0000 7fe0ff7fe640 1 -- 172.21.15.118:0/2717332864 >> v1:172.21.15.118:6789/0 conn(0x7fe10006c9e0 legacy=0x7fe1000bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.870+0000 7fe0ff7fe640 1 -- 172.21.15.118:0/2717332864 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1000bdc30 con 0x7fe1000c0220 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.870+0000 7fe0ff7fe640 1 --2- 172.21.15.118:0/2717332864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1001574a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0009870 tx=0x7fe0f002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbd5f3cd47d9718 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.870+0000 7fe0fdffb640 1 -- 172.21.15.118:0/2717332864 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f002f840 con 0x7fe1000c0220 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.870+0000 7fe0fdffb640 1 -- 172.21.15.118:0/2717332864 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f002f9a0 con 0x7fe1000c0220 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.870+0000 7fe0fdffb640 1 -- 172.21.15.118:0/2717332864 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f002fd30 con 0x7fe1000c0220 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.871+0000 7fe105839640 1 -- 172.21.15.118:0/2717332864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 msgr2=0x7fe1001574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.871+0000 7fe105839640 1 --2- 172.21.15.118:0/2717332864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1001574a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0009870 tx=0x7fe0f002ba20 comp rx=0 tx=0).stop 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.871+0000 7fe105839640 1 -- 172.21.15.118:0/2717332864 shutdown_connections 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.871+0000 7fe105839640 1 --2- 172.21.15.118:0/2717332864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1001574a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.871+0000 7fe105839640 1 -- 172.21.15.118:0/2717332864 >> 172.21.15.118:0/2717332864 conn(0x7fe1000c1650 msgr2=0x7fe1000c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:49.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.871+0000 7fe105839640 1 -- 172.21.15.118:0/2717332864 shutdown_connections 2024-02-18T10:00:49.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.871+0000 7fe105839640 1 -- 172.21.15.118:0/2717332864 wait complete. 2024-02-18T10:00:49.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.872+0000 7fe105839640 1 Processor -- start 2024-02-18T10:00:49.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.872+0000 7fe105839640 1 -- start start 2024-02-18T10:00:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe105839640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe10006c9e0 0x7fe1000ba730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe105839640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1000bb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe105839640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe10014c870 0x7fe1001e1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe105839640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000bac70 con 0x7fe1000c0220 2024-02-18T10:00:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe105839640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000baf40 con 0x7fe10014c870 2024-02-18T10:00:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe105839640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1000b67d0 con 0x7fe10006c9e0 2024-02-18T10:00:49.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1000bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1000bb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57302/0 (socket says 172.21.15.118:57302) 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 -- 172.21.15.118:0/2033788226 learned_addr learned my addr 172.21.15.118:0/2033788226 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0ff7fe640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe10014c870 0x7fe1001e1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0feffd640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe10006c9e0 0x7fe1000ba730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 -- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe10006c9e0 msgr2=0x7fe1000ba730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe10006c9e0 0x7fe1000ba730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 -- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe10014c870 msgr2=0x7fe1001e1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe10014c870 0x7fe1001e1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 -- 172.21.15.118:0/2033788226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f00094d0 con 0x7fe1000c0220 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0ff7fe640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe10014c870 0x7fe1001e1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0fe7fc640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1000bb6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c450 tx=0x7fe0f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0e7fff640 1 -- 172.21.15.118:0/2033788226 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4007480 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0e7fff640 1 -- 172.21.15.118:0/2033788226 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4007600 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe0e7fff640 1 -- 172.21.15.118:0/2033788226 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4004a20 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.873+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1000b7460 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.874+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1000b7a20 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.875+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe100075150 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.875+0000 7fe0e7fff640 1 -- 172.21.15.118:0/2033788226 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe0f4004b80 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.875+0000 7fe0e7fff640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe0ec06bca0 0x7fe0ec06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.875+0000 7fe0e7fff640 1 -- 172.21.15.118:0/2033788226 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0f4089b30 con 0x7fe1000c0220 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.875+0000 7fe0feffd640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe0ec06bca0 0x7fe0ec06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:49.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.876+0000 7fe0feffd640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe0ec06bca0 0x7fe0ec06e160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009f20 tx=0x7fe0f80094d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:49.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:49.879+0000 7fe0e7fff640 1 -- 172.21.15.118:0/2033788226 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe0f40543a0 con 0x7fe1000c0220 2024-02-18T10:00:50.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.086+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe100074af0 con 0x7fe1000c0220 2024-02-18T10:00:50.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.754+0000 7fe0e7fff640 1 -- 172.21.15.118:0/2033788226 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe0f40180c0 con 0x7fe1000c0220 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe0ec06bca0 msgr2=0x7fe0ec06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe0ec06bca0 0x7fe0ec06e160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009f20 tx=0x7fe0f80094d0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 msgr2=0x7fe1000bb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1000bb6b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c450 tx=0x7fe0f400c910 comp rx=0 tx=0).stop 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 shutdown_connections 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe0ec06bca0 0x7fe0ec06e160 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe10014c870 0x7fe1001e1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1000c0220 0x7fe1000bb6b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 --2- 172.21.15.118:0/2033788226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe10006c9e0 0x7fe1000ba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 >> 172.21.15.118:0/2033788226 conn(0x7fe1000c1650 msgr2=0x7fe1000a0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:50.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 shutdown_connections 2024-02-18T10:00:50.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.757+0000 7fe105839640 1 -- 172.21.15.118:0/2033788226 wait complete. 2024-02-18T10:00:50.773 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-18T10:00:50.773 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:00:50.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.875+0000 7f10955c9640 1 Processor -- start 2024-02-18T10:00:50.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.875+0000 7f10955c9640 1 -- start start 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f10955c9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f109006bc20 0x7f109014c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f10955c9640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900bf6b0 con 0x7f10900bd240 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f10955c9640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109014be60 con 0x7f10900bf260 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f10955c9640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900bdbb0 con 0x7f109006bc20 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f108effd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f109006bc20 0x7f109014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f108effd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f109006bc20 0x7f109014c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57310/0 (socket says 172.21.15.118:57310) 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f108effd640 1 -- 172.21.15.118:0/337781231 learned_addr learned my addr 172.21.15.118:0/337781231 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f1087fff640 1 --1- 172.21.15.118:0/337781231 >> v1:172.21.15.118:6789/0 conn(0x7f10900bd240 0x7f10900bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46952/0 (socket says 172.21.15.118:46952) 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f108effd640 1 -- 172.21.15.118:0/337781231 >> v1:172.21.15.164:6789/0 conn(0x7f10900bf260 legacy=0x7f10901565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f108effd640 1 -- 172.21.15.118:0/337781231 >> v1:172.21.15.118:6789/0 conn(0x7f10900bd240 legacy=0x7f10900bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f108e7fc640 1 -- 172.21.15.118:0/337781231 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906881355 0 0) 0x7f1078001110 con 0x7f10900bd240 2024-02-18T10:00:50.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.876+0000 7f108effd640 1 -- 172.21.15.118:0/337781231 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109014c140 con 0x7f109006bc20 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f108effd640 1 --2- 172.21.15.118:0/337781231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109006bc20 0x7f109014c940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1080009870 tx=0x7f108002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f93df6bec138d52 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f108e7fc640 1 -- 172.21.15.118:0/337781231 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080031870 con 0x7f109006bc20 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f108e7fc640 1 -- 172.21.15.118:0/337781231 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800319d0 con 0x7f109006bc20 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f108e7fc640 1 -- 172.21.15.118:0/337781231 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080031d60 con 0x7f109006bc20 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f10955c9640 1 -- 172.21.15.118:0/337781231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109006bc20 msgr2=0x7f109014c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f10955c9640 1 --2- 172.21.15.118:0/337781231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109006bc20 0x7f109014c940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1080009870 tx=0x7f108002b910 comp rx=0 tx=0).stop 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f10955c9640 1 -- 172.21.15.118:0/337781231 shutdown_connections 2024-02-18T10:00:50.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f10955c9640 1 --2- 172.21.15.118:0/337781231 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109006bc20 0x7f109014c940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f10955c9640 1 -- 172.21.15.118:0/337781231 >> 172.21.15.118:0/337781231 conn(0x7f10900c1850 msgr2=0x7f10900c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:50.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f10955c9640 1 -- 172.21.15.118:0/337781231 shutdown_connections 2024-02-18T10:00:50.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.877+0000 7f10955c9640 1 -- 172.21.15.118:0/337781231 wait complete. 2024-02-18T10:00:50.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.878+0000 7f10955c9640 1 Processor -- start 2024-02-18T10:00:50.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.878+0000 7f10955c9640 1 -- start start 2024-02-18T10:00:50.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f10955c9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f109006bc20 0x7f10900b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:50.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f10955c9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10900bd240 0x7f10900b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f10955c9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10900bf260 0x7f10900b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f10955c9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900b80d0 con 0x7f10900bd240 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f10955c9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10901e29a0 con 0x7f109006bc20 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f10955c9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900b5610 con 0x7f10900bf260 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10900bd240 0x7f10900b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10900bd240 0x7f10900b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57326/0 (socket says 172.21.15.118:57326) 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 -- 172.21.15.118:0/3209729226 learned_addr learned my addr 172.21.15.118:0/3209729226 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f108effd640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f109006bc20 0x7f10900b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f108f7fe640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10900bf260 0x7f10900b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 -- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10900bf260 msgr2=0x7f10900b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10900bf260 0x7f10900b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 -- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f109006bc20 msgr2=0x7f10900b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f109006bc20 0x7f10900b7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f1087fff640 1 -- 172.21.15.118:0/3209729226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800094d0 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.879+0000 7f108effd640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f109006bc20 0x7f10900b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.880+0000 7f1087fff640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10900bd240 0x7f10900b6960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f107800c780 tx=0x7f107800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.880+0000 7f10877fe640 1 -- 172.21.15.118:0/3209729226 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780072d0 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.880+0000 7f10877fe640 1 -- 172.21.15.118:0/3209729226 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1078007430 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.880+0000 7f10877fe640 1 -- 172.21.15.118:0/3209729226 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078001d10 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.880+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10900b7400 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.880+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1090067cc0 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.881+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090074af0 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.881+0000 7f10877fe640 1 -- 172.21.15.118:0/3209729226 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f10780047e0 con 0x7f10900bd240 2024-02-18T10:00:50.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.882+0000 7f10877fe640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f107006bc70 0x7f107006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:50.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.882+0000 7f10877fe640 1 -- 172.21.15.118:0/3209729226 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1078089a60 con 0x7f10900bd240 2024-02-18T10:00:50.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.882+0000 7f108effd640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f107006bc70 0x7f107006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:50.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.882+0000 7f108effd640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f107006bc70 0x7f107006e130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1080036000 tx=0x7f108003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:50.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:50.886+0000 7f10877fe640 1 -- 172.21.15.118:0/3209729226 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10780542d0 con 0x7f10900bd240 2024-02-18T10:00:51.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.093+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10900bf6b0 con 0x7f10900bd240 2024-02-18T10:00:51.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.093+0000 7f10877fe640 1 -- 172.21.15.118:0/3209729226 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7f10900bf6b0 con 0x7f10900bd240 2024-02-18T10:00:51.096 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:51.096 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:00:51.096 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f107006bc70 msgr2=0x7f107006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f107006bc70 0x7f107006e130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1080036000 tx=0x7f108003c040 comp rx=0 tx=0).stop 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10900bd240 msgr2=0x7f10900b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10900bd240 0x7f10900b6960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f107800c780 tx=0x7f107800cc40 comp rx=0 tx=0).stop 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 shutdown_connections 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f107006bc70 0x7f107006e130 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10900bf260 0x7f10900b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10900bd240 0x7f10900b6960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 --2- 172.21.15.118:0/3209729226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f109006bc20 0x7f10900b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 >> 172.21.15.118:0/3209729226 conn(0x7f10900c1850 msgr2=0x7f10901d8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:51.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 shutdown_connections 2024-02-18T10:00:51.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.095+0000 7f10955c9640 1 -- 172.21.15.118:0/3209729226 wait complete. 2024-02-18T10:00:51.109 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:51.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.205+0000 7f165513e640 1 Processor -- start 2024-02-18T10:00:51.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.205+0000 7f165513e640 1 -- start start 2024-02-18T10:00:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f165513e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16501423f0 0x7f165014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f165513e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16500b33e0 0x7f16501484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f165513e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1650072e40 con 0x7f16500b3820 2024-02-18T10:00:51.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f165513e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1650070060 con 0x7f16500b33e0 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f165513e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650070cc0 con 0x7f16501423f0 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f164e59c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16500b33e0 0x7f16501484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f164ed9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16501423f0 0x7f165014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f164e59c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f16500b33e0 0x7f16501484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:40872/0 (socket says 172.21.15.118:40872) 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.206+0000 7f164e59c640 1 -- 172.21.15.118:0/4030964151 learned_addr learned my addr 172.21.15.118:0/4030964151 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.207+0000 7f164e59c640 1 -- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16501423f0 msgr2=0x7f165014b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.207+0000 7f164e59c640 1 --2- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16501423f0 0x7f165014b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.207+0000 7f164e59c640 1 -- 172.21.15.118:0/4030964151 >> v1:172.21.15.164:6789/0 conn(0x7f16500b3820 legacy=0x7f16500b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.207+0000 7f164e59c640 1 -- 172.21.15.118:0/4030964151 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165006dbf0 con 0x7f16500b33e0 2024-02-18T10:00:51.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.207+0000 7f164ed9d640 1 --2- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16501423f0 0x7f165014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.207+0000 7f164e59c640 1 --2- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16500b33e0 0x7f16501484c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1640009870 tx=0x7f164002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1254be5ba9e82d67 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f164dd9b640 1 -- 172.21.15.118:0/4030964151 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640030840 con 0x7f16500b33e0 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f164dd9b640 1 -- 172.21.15.118:0/4030964151 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16400309a0 con 0x7f16500b33e0 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f164dd9b640 1 -- 172.21.15.118:0/4030964151 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640030d30 con 0x7f16500b33e0 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 -- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16500b33e0 msgr2=0x7f16501484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 --2- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16500b33e0 0x7f16501484c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1640009870 tx=0x7f164002b980 comp rx=0 tx=0).stop 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 -- 172.21.15.118:0/4030964151 shutdown_connections 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 --2- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16500b33e0 0x7f16501484c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 --2- 172.21.15.118:0/4030964151 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16501423f0 0x7f165014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 -- 172.21.15.118:0/4030964151 >> 172.21.15.118:0/4030964151 conn(0x7f16500b9ca0 msgr2=0x7f16500ba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:51.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 -- 172.21.15.118:0/4030964151 shutdown_connections 2024-02-18T10:00:51.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.208+0000 7f165513e640 1 -- 172.21.15.118:0/4030964151 wait complete. 2024-02-18T10:00:51.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.209+0000 7f165513e640 1 Processor -- start 2024-02-18T10:00:51.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f165513e640 1 -- start start 2024-02-18T10:00:51.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f165513e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16500b33e0 0x7f16500a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f165513e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500b3820 0x7f16501e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f165513e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16501423f0 0x7f16501db490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f165513e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500a12f0 con 0x7f16500b33e0 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f165513e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165009f5b0 con 0x7f16501423f0 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f165513e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500a04c0 con 0x7f16500b3820 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f164ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16500b33e0 0x7f16500a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f164ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16500b33e0 0x7f16500a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57338/0 (socket says 172.21.15.118:57338) 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f164ed9d640 1 -- 172.21.15.118:0/3830566055 learned_addr learned my addr 172.21.15.118:0/3830566055 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f164f59e640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16501423f0 0x7f16501db490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f164ed9d640 1 -- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500b3820 msgr2=0x7f16501e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.210+0000 7f164e59c640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500b3820 0x7f16501e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f164ed9d640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500b3820 0x7f16501e15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f164ed9d640 1 -- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16501423f0 msgr2=0x7f16501db490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f164ed9d640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16501423f0 0x7f16501db490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f164ed9d640 1 -- 172.21.15.118:0/3830566055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009400 con 0x7f16500b33e0 2024-02-18T10:00:51.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f164ed9d640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16500b33e0 0x7f16500a0db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f164400e990 tx=0x7f164400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f16377fe640 1 -- 172.21.15.118:0/3830566055 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400c9e0 con 0x7f16500b33e0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f16377fe640 1 -- 172.21.15.118:0/3830566055 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400cb40 con 0x7f16500b33e0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400094d0 con 0x7f16500b33e0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f16377fe640 1 -- 172.21.15.118:0/3830566055 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164400ced0 con 0x7f16500b33e0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.211+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16501e5190 con 0x7f16500b33e0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.212+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16500686f0 con 0x7f16500b33e0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.212+0000 7f16377fe640 1 -- 172.21.15.118:0/3830566055 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f1644013470 con 0x7f16500b33e0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.213+0000 7f16377fe640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f163c06bc70 0x7f163c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.213+0000 7f164e59c640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f163c06bc70 0x7f163c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.213+0000 7f16377fe640 1 -- 172.21.15.118:0/3830566055 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f164408a980 con 0x7f16500b33e0 2024-02-18T10:00:51.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.213+0000 7f164e59c640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f163c06bc70 0x7f163c06e130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1640036000 tx=0x7f164003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.217+0000 7f16377fe640 1 -- 172.21.15.118:0/3830566055 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f16440551f0 con 0x7f16500b33e0 2024-02-18T10:00:51.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.390+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1650074af0 con 0x7f16500b33e0 2024-02-18T10:00:51.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.391+0000 7f16377fe640 1 -- 172.21.15.118:0/3830566055 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f16440588b0 con 0x7f16500b33e0 2024-02-18T10:00:51.394 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:51.394 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:51.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f163c06bc70 msgr2=0x7f163c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f163c06bc70 0x7f163c06e130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1640036000 tx=0x7f164003b040 comp rx=0 tx=0).stop 2024-02-18T10:00:51.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16500b33e0 msgr2=0x7f16500a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16500b33e0 0x7f16500a0db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f164400e990 tx=0x7f164400ee50 comp rx=0 tx=0).stop 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 shutdown_connections 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f163c06bc70 0x7f163c06e130 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16501423f0 0x7f16501db490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500b3820 0x7f16501e15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 --2- 172.21.15.118:0/3830566055 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16500b33e0 0x7f16500a0db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.393+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 >> 172.21.15.118:0/3830566055 conn(0x7f16500b9ca0 msgr2=0x7f1650148310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.394+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 shutdown_connections 2024-02-18T10:00:51.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.394+0000 7f165513e640 1 -- 172.21.15.118:0/3830566055 wait complete. 2024-02-18T10:00:51.407 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-18T10:00:51.408 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:00:51.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.505+0000 7f5a7b16c640 1 Processor -- start 2024-02-18T10:00:51.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.505+0000 7f5a7b16c640 1 -- start start 2024-02-18T10:00:51.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a7b16c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5a740bc6c0 0x7f5a74066b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a7b16c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a7406b750 0x7f5a7406bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a7b16c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a74073050 con 0x7f5a7406abe0 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a7b16c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740bb730 con 0x7f5a7406b750 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a7b16c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7406e330 con 0x7f5a740bc6c0 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a79709640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a7406b750 0x7f5a7406bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a73fff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5a7406abe0 0x7f5a7406b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46958/0 (socket says 172.21.15.118:46958) 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a73fff640 1 -- 172.21.15.118:0/86909374 learned_addr learned my addr 172.21.15.118:0/86909374 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.506+0000 7f5a78f08640 1 --2- 172.21.15.118:0/86909374 >> v2:172.21.15.164:3300/0 conn(0x7f5a740bc6c0 0x7f5a74066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a79709640 1 -- 172.21.15.118:0/86909374 >> v2:172.21.15.164:3300/0 conn(0x7f5a740bc6c0 msgr2=0x7f5a74066b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a79709640 1 --2- 172.21.15.118:0/86909374 >> v2:172.21.15.164:3300/0 conn(0x7f5a740bc6c0 0x7f5a74066b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a79709640 1 -- 172.21.15.118:0/86909374 >> v1:172.21.15.118:6789/0 conn(0x7f5a7406abe0 legacy=0x7f5a7406b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a737fe640 1 -- 172.21.15.118:0/86909374 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351234198 0 0) 0x7f5a74073050 con 0x7f5a7406abe0 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a79709640 1 -- 172.21.15.118:0/86909374 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740b8790 con 0x7f5a7406b750 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a79709640 1 --2- 172.21.15.118:0/86909374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a7406b750 0x7f5a7406bb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a740bb4f0 tx=0x7f5a6c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3409cc4e0e9eb99 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a737fe640 1 -- 172.21.15.118:0/86909374 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c02cd00 con 0x7f5a7406b750 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.507+0000 7f5a737fe640 1 -- 172.21.15.118:0/86909374 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c02ce60 con 0x7f5a7406b750 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a737fe640 1 -- 172.21.15.118:0/86909374 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c034660 con 0x7f5a7406b750 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 -- 172.21.15.118:0/86909374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a7406b750 msgr2=0x7f5a7406bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/86909374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a7406b750 0x7f5a7406bb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a740bb4f0 tx=0x7f5a6c02bf50 comp rx=0 tx=0).stop 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 -- 172.21.15.118:0/86909374 shutdown_connections 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/86909374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a7406b750 0x7f5a7406bb80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/86909374 >> v2:172.21.15.164:3300/0 conn(0x7f5a740bc6c0 0x7f5a74066b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 -- 172.21.15.118:0/86909374 >> 172.21.15.118:0/86909374 conn(0x7f5a740ba430 msgr2=0x7f5a740ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 -- 172.21.15.118:0/86909374 shutdown_connections 2024-02-18T10:00:51.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.508+0000 7f5a7b16c640 1 -- 172.21.15.118:0/86909374 wait complete. 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.509+0000 7f5a7b16c640 1 Processor -- start 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.509+0000 7f5a7b16c640 1 -- start start 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a7b16c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a7406abe0 0x7f5a741d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a7b16c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a7406b750 0x7f5a741df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a7b16c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a740bc6c0 0x7f5a7409bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a7b16c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741d2ef0 con 0x7f5a740bc6c0 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a7b16c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741d2590 con 0x7f5a7406abe0 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a7b16c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741d27e0 con 0x7f5a7406b750 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a740bc6c0 0x7f5a7409bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a740bc6c0 0x7f5a7409bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57354/0 (socket says 172.21.15.118:57354) 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 -- 172.21.15.118:0/2215833770 learned_addr learned my addr 172.21.15.118:0/2215833770 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a73fff640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a7406b750 0x7f5a741df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a78f08640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a7406abe0 0x7f5a741d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 -- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a7406b750 msgr2=0x7f5a741df0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a7406b750 0x7f5a741df0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 -- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a7406abe0 msgr2=0x7f5a741d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a7406abe0 0x7f5a741d35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 -- 172.21.15.118:0/2215833770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009a70 con 0x7f5a740bc6c0 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a78f08640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a7406abe0 0x7f5a741d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.510+0000 7f5a79709640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a740bc6c0 0x7f5a7409bb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009e80 tx=0x7f5a6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.511+0000 7f5a717fa640 1 -- 172.21.15.118:0/2215833770 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c03d600 con 0x7f5a740bc6c0 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.511+0000 7f5a717fa640 1 -- 172.21.15.118:0/2215833770 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c03d780 con 0x7f5a740bc6c0 2024-02-18T10:00:51.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.511+0000 7f5a717fa640 1 -- 172.21.15.118:0/2215833770 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c03db30 con 0x7f5a740bc6c0 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.511+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a741d2b10 con 0x7f5a740bc6c0 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.511+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a741d32f0 con 0x7f5a740bc6c0 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.512+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a74074af0 con 0x7f5a740bc6c0 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.512+0000 7f5a717fa640 1 -- 172.21.15.118:0/2215833770 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f5a6c03b040 con 0x7f5a740bc6c0 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.512+0000 7f5a717fa640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5a6006bc70 0x7f5a6006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.513+0000 7f5a717fa640 1 -- 172.21.15.118:0/2215833770 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a6c0acf30 con 0x7f5a740bc6c0 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.513+0000 7f5a78f08640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5a6006bc70 0x7f5a6006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.513+0000 7f5a78f08640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5a6006bc70 0x7f5a6006e130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a64006fd0 tx=0x7f5a64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.517+0000 7f5a717fa640 1 -- 172.21.15.118:0/2215833770 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a6c0778c0 con 0x7f5a740bc6c0 2024-02-18T10:00:51.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.684+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a740bb910 con 0x7f5a6006bc70 2024-02-18T10:00:51.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.690+0000 7f5a717fa640 1 -- 172.21.15.118:0/2215833770 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240015 (secure 0 0 0) 0x7f5a64009530 con 0x7f5a6006bc70 2024-02-18T10:00:51.696 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:51.697 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5a6006bc70 msgr2=0x7f5a6006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5a6006bc70 0x7f5a6006e130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a64006fd0 tx=0x7f5a64008040 comp rx=0 tx=0).stop 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a740bc6c0 msgr2=0x7f5a7409bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a740bc6c0 0x7f5a7409bb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009e80 tx=0x7f5a6c004a40 comp rx=0 tx=0).stop 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 shutdown_connections 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5a6006bc70 0x7f5a6006e130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a740bc6c0 0x7f5a7409bb60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a7406b750 0x7f5a741df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.693+0000 7f5a7b16c640 1 --2- 172.21.15.118:0/2215833770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a7406abe0 0x7f5a741d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.694+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 >> 172.21.15.118:0/2215833770 conn(0x7f5a740ba430 msgr2=0x7f5a740a1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:51.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.694+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 shutdown_connections 2024-02-18T10:00:51.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.694+0000 7f5a7b16c640 1 -- 172.21.15.118:0/2215833770 wait complete. 2024-02-18T10:00:51.706 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-02-18T10:00:51.278331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236120,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738600,"statfs":{"total":773094113280,"available":772852326400,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.546107"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732436+0000","last_change":"2024-02-18T10:00:46.732436+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732436+0000","last_undegraded":"2024-02-18T10:00:46.732436+0000","last_fullsized":"2024-02-18T10:00:46.732436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734145+0000","last_change":"2024-02-18T10:00:46.734145+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734145+0000","last_undegraded":"2024-02-18T10:00:46.734145+0000","last_fullsized":"2024-02-18T10:00:46.734145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732252+0000","last_change":"2024-02-18T10:00:46.732252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732252+0000","last_undegraded":"2024-02-18T10:00:46.732252+0000","last_fullsized":"2024-02-18T10:00:46.732252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730331+0000","last_change":"2024-02-18T10:00:46.730331+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730331+0000","last_undegraded":"2024-02-18T10:00:46.730331+0000","last_fullsized":"2024-02-18T10:00:46.730331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732053+0000","last_change":"2024-02-18T10:00:46.732053+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732053+0000","last_undegraded":"2024-02-18T10:00:46.732053+0000","last_fullsized":"2024-02-18T10:00:46.732053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733822+0000","last_change":"2024-02-18T10:00:46.733822+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733822+0000","last_undegraded":"2024-02-18T10:00:46.733822+0000","last_fullsized":"2024-02-18T10:00:46.733822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729967+0000","last_change":"2024-02-18T10:00:46.729967+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729967+0000","last_undegraded":"2024-02-18T10:00:46.729967+0000","last_fullsized":"2024-02-18T10:00:46.729967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732068+0000","last_change":"2024-02-18T10:00:46.732068+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732068+0000","last_undegraded":"2024-02-18T10:00:46.732068+0000","last_fullsized":"2024-02-18T10:00:46.732068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732991+0000","last_change":"2024-02-18T10:00:46.732991+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732991+0000","last_undegraded":"2024-02-18T10:00:46.732991+0000","last_fullsized":"2024-02-18T10:00:46.732991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729780+0000","last_change":"2024-02-18T10:00:46.729780+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729780+0000","last_undegraded":"2024-02-18T10:00:46.729780+0000","last_fullsized":"2024-02-18T10:00:46.729780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730365+0000","last_change":"2024-02-18T10:00:46.730365+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730365+0000","last_undegraded":"2024-02-18T10:00:46.730365+0000","last_fullsized":"2024-02-18T10:00:46.730365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730375+0000","last_change":"2024-02-18T10:00:46.730375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730375+0000","last_undegraded":"2024-02-18T10:00:46.730375+0000","last_fullsized":"2024-02-18T10:00:46.730375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733375+0000","last_change":"2024-02-18T10:00:46.733375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733375+0000","last_undegraded":"2024-02-18T10:00:46.733375+0000","last_fullsized":"2024-02-18T10:00:46.733375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730270+0000","last_change":"2024-02-18T10:00:46.730270+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730270+0000","last_undegraded":"2024-02-18T10:00:46.730270+0000","last_fullsized":"2024-02-18T10:00:46.730270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-18T10:00:46.734908+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:00:46.734908+0000","last_peered":"2024-02-18T10:00:46.734908+0000","last_clean":"2024-02-18T10:00:46.734908+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:00:46.734908+0000","last_undegraded":"2024-02-18T10:00:46.734908+0000","last_fullsized":"2024-02-18T10:00:46.734908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732050+0000","last_change":"2024-02-18T10:00:46.732050+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732050+0000","last_undegraded":"2024-02-18T10:00:46.732050+0000","last_fullsized":"2024-02-18T10:00:46.732050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732191+0000","last_change":"2024-02-18T10:00:46.732191+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732191+0000","last_undegraded":"2024-02-18T10:00:46.732191+0000","last_fullsized":"2024-02-18T10:00:46.732191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730252+0000","last_change":"2024-02-18T10:00:46.730252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730252+0000","last_undegraded":"2024-02-18T10:00:46.730252+0000","last_fullsized":"2024-02-18T10:00:46.730252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732044+0000","last_change":"2024-02-18T10:00:46.732044+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732044+0000","last_undegraded":"2024-02-18T10:00:46.732044+0000","last_fullsized":"2024-02-18T10:00:46.732044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732472+0000","last_change":"2024-02-18T10:00:46.732472+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732472+0000","last_undegraded":"2024-02-18T10:00:46.732472+0000","last_fullsized":"2024-02-18T10:00:46.732472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732377+0000","last_change":"2024-02-18T10:00:46.732377+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732377+0000","last_undegraded":"2024-02-18T10:00:46.732377+0000","last_fullsized":"2024-02-18T10:00:46.732377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733537+0000","last_change":"2024-02-18T10:00:46.733537+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733537+0000","last_undegraded":"2024-02-18T10:00:46.733537+0000","last_fullsized":"2024-02-18T10:00:46.733537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729912+0000","last_change":"2024-02-18T10:00:46.729912+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729912+0000","last_undegraded":"2024-02-18T10:00:46.729912+0000","last_fullsized":"2024-02-18T10:00:46.729912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734434+0000","last_change":"2024-02-18T10:00:46.734434+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734434+0000","last_undegraded":"2024-02-18T10:00:46.734434+0000","last_fullsized":"2024-02-18T10:00:46.734434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732484+0000","last_change":"2024-02-18T10:00:46.732484+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732484+0000","last_undegraded":"2024-02-18T10:00:46.732484+0000","last_fullsized":"2024-02-18T10:00:46.732484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732692+0000","last_change":"2024-02-18T10:00:46.732692+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732692+0000","last_undegraded":"2024-02-18T10:00:46.732692+0000","last_fullsized":"2024-02-18T10:00:46.732692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732640+0000","last_change":"2024-02-18T10:00:46.732640+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732640+0000","last_undegraded":"2024-02-18T10:00:46.732640+0000","last_fullsized":"2024-02-18T10:00:46.732640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732398+0000","last_change":"2024-02-18T10:00:46.732398+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732398+0000","last_undegraded":"2024-02-18T10:00:46.732398+0000","last_fullsized":"2024-02-18T10:00:46.732398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733729+0000","last_change":"2024-02-18T10:00:46.733729+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733729+0000","last_undegraded":"2024-02-18T10:00:46.733729+0000","last_fullsized":"2024-02-18T10:00:46.733729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732620+0000","last_change":"2024-02-18T10:00:46.732620+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732620+0000","last_undegraded":"2024-02-18T10:00:46.732620+0000","last_fullsized":"2024-02-18T10:00:46.732620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.731931+0000","last_change":"2024-02-18T10:00:46.731931+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.731931+0000","last_undegraded":"2024-02-18T10:00:46.731931+0000","last_fullsized":"2024-02-18T10:00:46.731931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:00:51.711 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:00:51.732 INFO:tasks.ceph.mds.b.smithi164.stderr:2024-02-18T10:00:51.730+0000 7fda58776640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-18T10:00:51.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.844+0000 7fd23830c640 1 Processor -- start 2024-02-18T10:00:51.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.844+0000 7fd23830c640 1 -- start start 2024-02-18T10:00:51.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd23830c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd23006bbe0 0x7fd230149300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd23830c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300b4e10 con 0x7fd2300bd2b0 2024-02-18T10:00:51.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd23830c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300bc5c0 con 0x7fd230149840 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd23830c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300bdc20 con 0x7fd23006bbe0 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd2358a7640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd2300bd2b0 0x7fd23014bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46970/0 (socket says 172.21.15.118:46970) 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd2358a7640 1 -- 172.21.15.118:0/3640641097 learned_addr learned my addr 172.21.15.118:0/3640641097 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd2360a8640 1 --2- 172.21.15.118:0/3640641097 >> v2:172.21.15.164:3300/0 conn(0x7fd23006bbe0 0x7fd230149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723207991 0 0) 0x7fd2300b4e10 con 0x7fd2300bd2b0 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.845+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c003520 con 0x7fd2300bd2b0 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3723960609 0 0) 0x7fd21c003520 con 0x7fd2300bd2b0 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 >> v2:172.21.15.164:3300/0 conn(0x7fd23006bbe0 msgr2=0x7fd230149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 --2- 172.21.15.118:0/3640641097 >> v2:172.21.15.164:3300/0 conn(0x7fd23006bbe0 0x7fd230149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 >> v1:172.21.15.164:6789/0 conn(0x7fd230149840 legacy=0x7fd230156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300b4b50 con 0x7fd2300bd2b0 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fd220001670 con 0x7fd2300bd2b0 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 >> v1:172.21.15.118:6789/0 conn(0x7fd2300bd2b0 legacy=0x7fd23014bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd21c003970 0x7fd21c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c0047c0 0x7fd21c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd21c005180 0x7fd21c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300bdc20 con 0x7fd21c005180 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c00c120 con 0x7fd21c003970 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c00c2e0 con 0x7fd21c0047c0 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2368a9640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd21c005180 0x7fd21c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2360a8640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd21c003970 0x7fd21c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2358a7640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c0047c0 0x7fd21c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2368a9640 1 -- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c0047c0 msgr2=0x7fd21c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2368a9640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c0047c0 0x7fd21c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2368a9640 1 -- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd21c003970 msgr2=0x7fd21c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2368a9640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd21c003970 0x7fd21c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.846+0000 7fd2368a9640 1 -- 172.21.15.118:0/3640641097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c003520 con 0x7fd21c005180 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd2368a9640 1 -- 172.21.15.118:0/3640641097 reap_dead start 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd2368a9640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd21c005180 0x7fd21c00b980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd228001e50 tx=0x7fd21c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b8a518d1deead0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228003b70 con 0x7fd21c005180 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228003cf0 con 0x7fd21c005180 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd2350a6640 1 -- 172.21.15.118:0/3640641097 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228005310 con 0x7fd21c005180 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd23830c640 1 -- 172.21.15.118:0/3640641097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd21c005180 msgr2=0x7fd21c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd23830c640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd21c005180 0x7fd21c00b980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd228001e50 tx=0x7fd21c0057f0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd23830c640 1 -- 172.21.15.118:0/3640641097 shutdown_connections 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd23830c640 1 --2- 172.21.15.118:0/3640641097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd21c005180 0x7fd21c00b980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.847+0000 7fd23830c640 1 -- 172.21.15.118:0/3640641097 >> 172.21.15.118:0/3640641097 conn(0x7fd2300c18e0 msgr2=0x7fd2300c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.848+0000 7fd23830c640 1 -- 172.21.15.118:0/3640641097 shutdown_connections 2024-02-18T10:00:51.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.848+0000 7fd23830c640 1 -- 172.21.15.118:0/3640641097 wait complete. 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 Processor -- start 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 -- start start 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c005180 0x7fd2300a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2300bab80 0x7fd230144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2301e5230 0x7fd2301e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300a6fb0 con 0x7fd2300bab80 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301e5c00 con 0x7fd2301e5230 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd23830c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301e4d50 con 0x7fd21c005180 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2358a7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2300bab80 0x7fd230144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2358a7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2300bab80 0x7fd230144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57368/0 (socket says 172.21.15.118:57368) 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2358a7640 1 -- 172.21.15.118:0/3781899930 learned_addr learned my addr 172.21.15.118:0/3781899930 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2360a8640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c005180 0x7fd2300a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2368a9640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2301e5230 0x7fd2301e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2358a7640 1 -- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c005180 msgr2=0x7fd2300a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2358a7640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c005180 0x7fd2300a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2358a7640 1 -- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2301e5230 msgr2=0x7fd2301e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.849+0000 7fd2358a7640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2301e5230 0x7fd2301e56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd2358a7640 1 -- 172.21.15.118:0/3781899930 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300bb010 con 0x7fd2300bab80 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd2368a9640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2301e5230 0x7fd2301e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd2358a7640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2300bab80 0x7fd230144e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2200072c0 tx=0x7fd220007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd226ffd640 1 -- 172.21.15.118:0/3781899930 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220004ea0 con 0x7fd2300bab80 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd226ffd640 1 -- 172.21.15.118:0/3781899930 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000f960 con 0x7fd2300bab80 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd226ffd640 1 -- 172.21.15.118:0/3781899930 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000fd30 con 0x7fd2300bab80 2024-02-18T10:00:51.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2300bb2f0 con 0x7fd2300bab80 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.850+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2301453a0 con 0x7fd2300bab80 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.851+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2300c0590 con 0x7fd2300bab80 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.851+0000 7fd226ffd640 1 -- 172.21.15.118:0/3781899930 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fd22001d460 con 0x7fd2300bab80 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.852+0000 7fd226ffd640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd21406bca0 0x7fd21406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.852+0000 7fd2360a8640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd21406bca0 0x7fd21406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.852+0000 7fd226ffd640 1 -- 172.21.15.118:0/3781899930 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd22008a9e0 con 0x7fd2300bab80 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.852+0000 7fd2360a8640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd21406bca0 0x7fd21406e160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009980 tx=0x7fd22c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:51.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:51.856+0000 7fd226ffd640 1 -- 172.21.15.118:0/3781899930 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2200550b0 con 0x7fd2300bab80 2024-02-18T10:00:52.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.022+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2300bc250 con 0x7fd21406bca0 2024-02-18T10:00:52.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.028+0000 7fd226ffd640 1 -- 172.21.15.118:0/3781899930 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240015 (secure 0 0 0) 0x7fd22c013960 con 0x7fd21406bca0 2024-02-18T10:00:52.033 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:52.034 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:00:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd21406bca0 msgr2=0x7fd21406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd21406bca0 0x7fd21406e160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009980 tx=0x7fd22c008040 comp rx=0 tx=0).stop 2024-02-18T10:00:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2300bab80 msgr2=0x7fd230144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2300bab80 0x7fd230144e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2200072c0 tx=0x7fd220007780 comp rx=0 tx=0).stop 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 shutdown_connections 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd21406bca0 0x7fd21406e160 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2301e5230 0x7fd2301e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd2300bab80 0x7fd230144e60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 --2- 172.21.15.118:0/3781899930 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd21c005180 0x7fd2300a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 >> 172.21.15.118:0/3781899930 conn(0x7fd2300c18e0 msgr2=0x7fd2300bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 shutdown_connections 2024-02-18T10:00:52.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.031+0000 7fd23830c640 1 -- 172.21.15.118:0/3781899930 wait complete. 2024-02-18T10:00:52.044 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-02-18T10:00:51.278331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236120,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738600,"statfs":{"total":773094113280,"available":772852326400,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.546107"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732436+0000","last_change":"2024-02-18T10:00:46.732436+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732436+0000","last_undegraded":"2024-02-18T10:00:46.732436+0000","last_fullsized":"2024-02-18T10:00:46.732436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734145+0000","last_change":"2024-02-18T10:00:46.734145+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734145+0000","last_undegraded":"2024-02-18T10:00:46.734145+0000","last_fullsized":"2024-02-18T10:00:46.734145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732252+0000","last_change":"2024-02-18T10:00:46.732252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732252+0000","last_undegraded":"2024-02-18T10:00:46.732252+0000","last_fullsized":"2024-02-18T10:00:46.732252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730331+0000","last_change":"2024-02-18T10:00:46.730331+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730331+0000","last_undegraded":"2024-02-18T10:00:46.730331+0000","last_fullsized":"2024-02-18T10:00:46.730331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732053+0000","last_change":"2024-02-18T10:00:46.732053+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732053+0000","last_undegraded":"2024-02-18T10:00:46.732053+0000","last_fullsized":"2024-02-18T10:00:46.732053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733822+0000","last_change":"2024-02-18T10:00:46.733822+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733822+0000","last_undegraded":"2024-02-18T10:00:46.733822+0000","last_fullsized":"2024-02-18T10:00:46.733822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729967+0000","last_change":"2024-02-18T10:00:46.729967+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729967+0000","last_undegraded":"2024-02-18T10:00:46.729967+0000","last_fullsized":"2024-02-18T10:00:46.729967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732068+0000","last_change":"2024-02-18T10:00:46.732068+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732068+0000","last_undegraded":"2024-02-18T10:00:46.732068+0000","last_fullsized":"2024-02-18T10:00:46.732068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732991+0000","last_change":"2024-02-18T10:00:46.732991+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732991+0000","last_undegraded":"2024-02-18T10:00:46.732991+0000","last_fullsized":"2024-02-18T10:00:46.732991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729780+0000","last_change":"2024-02-18T10:00:46.729780+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729780+0000","last_undegraded":"2024-02-18T10:00:46.729780+0000","last_fullsized":"2024-02-18T10:00:46.729780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730365+0000","last_change":"2024-02-18T10:00:46.730365+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730365+0000","last_undegraded":"2024-02-18T10:00:46.730365+0000","last_fullsized":"2024-02-18T10:00:46.730365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730375+0000","last_change":"2024-02-18T10:00:46.730375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730375+0000","last_undegraded":"2024-02-18T10:00:46.730375+0000","last_fullsized":"2024-02-18T10:00:46.730375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733375+0000","last_change":"2024-02-18T10:00:46.733375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733375+0000","last_undegraded":"2024-02-18T10:00:46.733375+0000","last_fullsized":"2024-02-18T10:00:46.733375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730270+0000","last_change":"2024-02-18T10:00:46.730270+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730270+0000","last_undegraded":"2024-02-18T10:00:46.730270+0000","last_fullsized":"2024-02-18T10:00:46.730270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-18T10:00:46.734908+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:00:46.734908+0000","last_peered":"2024-02-18T10:00:46.734908+0000","last_clean":"2024-02-18T10:00:46.734908+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:00:46.734908+0000","last_undegraded":"2024-02-18T10:00:46.734908+0000","last_fullsized":"2024-02-18T10:00:46.734908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732050+0000","last_change":"2024-02-18T10:00:46.732050+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732050+0000","last_undegraded":"2024-02-18T10:00:46.732050+0000","last_fullsized":"2024-02-18T10:00:46.732050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732191+0000","last_change":"2024-02-18T10:00:46.732191+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732191+0000","last_undegraded":"2024-02-18T10:00:46.732191+0000","last_fullsized":"2024-02-18T10:00:46.732191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730252+0000","last_change":"2024-02-18T10:00:46.730252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730252+0000","last_undegraded":"2024-02-18T10:00:46.730252+0000","last_fullsized":"2024-02-18T10:00:46.730252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732044+0000","last_change":"2024-02-18T10:00:46.732044+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732044+0000","last_undegraded":"2024-02-18T10:00:46.732044+0000","last_fullsized":"2024-02-18T10:00:46.732044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732472+0000","last_change":"2024-02-18T10:00:46.732472+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732472+0000","last_undegraded":"2024-02-18T10:00:46.732472+0000","last_fullsized":"2024-02-18T10:00:46.732472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732377+0000","last_change":"2024-02-18T10:00:46.732377+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732377+0000","last_undegraded":"2024-02-18T10:00:46.732377+0000","last_fullsized":"2024-02-18T10:00:46.732377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733537+0000","last_change":"2024-02-18T10:00:46.733537+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733537+0000","last_undegraded":"2024-02-18T10:00:46.733537+0000","last_fullsized":"2024-02-18T10:00:46.733537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729912+0000","last_change":"2024-02-18T10:00:46.729912+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729912+0000","last_undegraded":"2024-02-18T10:00:46.729912+0000","last_fullsized":"2024-02-18T10:00:46.729912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734434+0000","last_change":"2024-02-18T10:00:46.734434+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734434+0000","last_undegraded":"2024-02-18T10:00:46.734434+0000","last_fullsized":"2024-02-18T10:00:46.734434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732484+0000","last_change":"2024-02-18T10:00:46.732484+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732484+0000","last_undegraded":"2024-02-18T10:00:46.732484+0000","last_fullsized":"2024-02-18T10:00:46.732484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732692+0000","last_change":"2024-02-18T10:00:46.732692+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732692+0000","last_undegraded":"2024-02-18T10:00:46.732692+0000","last_fullsized":"2024-02-18T10:00:46.732692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732640+0000","last_change":"2024-02-18T10:00:46.732640+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732640+0000","last_undegraded":"2024-02-18T10:00:46.732640+0000","last_fullsized":"2024-02-18T10:00:46.732640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732398+0000","last_change":"2024-02-18T10:00:46.732398+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732398+0000","last_undegraded":"2024-02-18T10:00:46.732398+0000","last_fullsized":"2024-02-18T10:00:46.732398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733729+0000","last_change":"2024-02-18T10:00:46.733729+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733729+0000","last_undegraded":"2024-02-18T10:00:46.733729+0000","last_fullsized":"2024-02-18T10:00:46.733729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732620+0000","last_change":"2024-02-18T10:00:46.732620+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732620+0000","last_undegraded":"2024-02-18T10:00:46.732620+0000","last_fullsized":"2024-02-18T10:00:46.732620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.731931+0000","last_change":"2024-02-18T10:00:46.731931+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.731931+0000","last_undegraded":"2024-02-18T10:00:46.731931+0000","last_fullsized":"2024-02-18T10:00:46.731931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:00:52.047 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:00:52.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96e608d640 1 Processor -- start 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96e608d640 1 -- start start 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96e608d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f96e0142d20 0x7f96e0148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96e608d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0072bd0 0x7f96e0071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96e608d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e0149450 con 0x7f96e0148e40 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96e608d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0143100 con 0x7f96e0142d20 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96e608d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0070510 con 0x7f96e0072bd0 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96df7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f96e0142d20 0x7f96e0148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96df7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f96e0142d20 0x7f96e0148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57384/0 (socket says 172.21.15.118:57384) 2024-02-18T10:00:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.182+0000 7f96df7fe640 1 -- 172.21.15.118:0/1870920281 learned_addr learned my addr 172.21.15.118:0/1870920281 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.183+0000 7f96df7fe640 1 -- 172.21.15.118:0/1870920281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0072bd0 msgr2=0x7f96e0071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.183+0000 7f96df7fe640 1 --2- 172.21.15.118:0/1870920281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0072bd0 0x7f96e0071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.183+0000 7f96df7fe640 1 -- 172.21.15.118:0/1870920281 >> v1:172.21.15.164:6789/0 conn(0x7f96e0148e40 legacy=0x7f96e014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:52.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.183+0000 7f96df7fe640 1 -- 172.21.15.118:0/1870920281 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e006ff90 con 0x7f96e0142d20 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.183+0000 7f96df7fe640 1 --2- 172.21.15.118:0/1870920281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0142d20 0x7f96e0148900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f96d000bb10 tx=0x7f96d002e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d865e8c2b71b2b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96de7fc640 1 -- 172.21.15.118:0/1870920281 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d002ee70 con 0x7f96e0142d20 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96de7fc640 1 -- 172.21.15.118:0/1870920281 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0036440 con 0x7f96e0142d20 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96de7fc640 1 -- 172.21.15.118:0/1870920281 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00367d0 con 0x7f96e0142d20 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 -- 172.21.15.118:0/1870920281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0142d20 msgr2=0x7f96e0148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 --2- 172.21.15.118:0/1870920281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0142d20 0x7f96e0148900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f96d000bb10 tx=0x7f96d002e0c0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 -- 172.21.15.118:0/1870920281 shutdown_connections 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 --2- 172.21.15.118:0/1870920281 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0072bd0 0x7f96e0071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 --2- 172.21.15.118:0/1870920281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0142d20 0x7f96e0148900 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 -- 172.21.15.118:0/1870920281 >> 172.21.15.118:0/1870920281 conn(0x7f96e00b9ca0 msgr2=0x7f96e00ba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 -- 172.21.15.118:0/1870920281 shutdown_connections 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.184+0000 7f96e608d640 1 -- 172.21.15.118:0/1870920281 wait complete. 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.185+0000 7f96e608d640 1 Processor -- start 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.185+0000 7f96e608d640 1 -- start start 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96e608d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0072bd0 0x7f96e014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96e608d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0142d20 0x7f96e01dd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96e608d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96e0148e40 0x7f96e01dd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96e608d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e014a810 con 0x7f96e0072bd0 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96e608d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01dcfc0 con 0x7f96e0148e40 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96e608d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01e09a0 con 0x7f96e0142d20 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0072bd0 0x7f96e014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0072bd0 0x7f96e014a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57394/0 (socket says 172.21.15.118:57394) 2024-02-18T10:00:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 -- 172.21.15.118:0/2293572733 learned_addr learned my addr 172.21.15.118:0/2293572733 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 -- 172.21.15.118:0/2293572733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0142d20 msgr2=0x7f96e01dd450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0142d20 0x7f96e01dd450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 -- 172.21.15.118:0/2293572733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96e0148e40 msgr2=0x7f96e01dd990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96e0148e40 0x7f96e01dd990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 -- 172.21.15.118:0/2293572733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d000b770 con 0x7f96e0072bd0 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.186+0000 7f96df7fe640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0072bd0 0x7f96e014a2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96d000b2c0 tx=0x7f96d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.187+0000 7f96c7fff640 1 -- 172.21.15.118:0/2293572733 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0034950 con 0x7f96e0072bd0 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.187+0000 7f96c7fff640 1 -- 172.21.15.118:0/2293572733 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0034ad0 con 0x7f96e0072bd0 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.187+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e01e0c20 con 0x7f96e0072bd0 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.187+0000 7f96c7fff640 1 -- 172.21.15.118:0/2293572733 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0034e80 con 0x7f96e0072bd0 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.187+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e01e11e0 con 0x7f96e0072bd0 2024-02-18T10:00:52.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.187+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e01e13d0 con 0x7f96e0072bd0 2024-02-18T10:00:52.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.188+0000 7f96c7fff640 1 -- 172.21.15.118:0/2293572733 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f96d003d040 con 0x7f96e0072bd0 2024-02-18T10:00:52.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.188+0000 7f96c7fff640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f96cc06bca0 0x7f96cc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.188+0000 7f96c7fff640 1 -- 172.21.15.118:0/2293572733 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96d00af400 con 0x7f96e0072bd0 2024-02-18T10:00:52.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.188+0000 7f96deffd640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f96cc06bca0 0x7f96cc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.189+0000 7f96deffd640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f96cc06bca0 0x7f96cc06e160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96e006ca40 tx=0x7f96d4006c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.193+0000 7f96c7fff640 1 -- 172.21.15.118:0/2293572733 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f96d0079c70 con 0x7f96e0072bd0 2024-02-18T10:00:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.360+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96e00b7ea0 con 0x7f96cc06bca0 2024-02-18T10:00:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.365+0000 7f96c7fff640 1 -- 172.21.15.118:0/2293572733 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240015 (secure 0 0 0) 0x7f96e00b7ea0 con 0x7f96cc06bca0 2024-02-18T10:00:52.372 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:52.373 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f96cc06bca0 msgr2=0x7f96cc06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f96cc06bca0 0x7f96cc06e160 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f96e006ca40 tx=0x7f96d4006c20 comp rx=0 tx=0).stop 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0072bd0 msgr2=0x7f96e014a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0072bd0 0x7f96e014a2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96d000b2c0 tx=0x7f96d00046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 shutdown_connections 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f96cc06bca0 0x7f96cc06e160 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96e0148e40 0x7f96e01dd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f96e0142d20 0x7f96e01dd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 --2- 172.21.15.118:0/2293572733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96e0072bd0 0x7f96e014a2d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.368+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 >> 172.21.15.118:0/2293572733 conn(0x7f96e00b9ca0 msgr2=0x7f96e006d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.369+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 shutdown_connections 2024-02-18T10:00:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.369+0000 7f96e608d640 1 -- 172.21.15.118:0/2293572733 wait complete. 2024-02-18T10:00:52.382 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-02-18T10:00:51.278331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236120,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738600,"statfs":{"total":773094113280,"available":772852326400,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.546107"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732436+0000","last_change":"2024-02-18T10:00:46.732436+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732436+0000","last_undegraded":"2024-02-18T10:00:46.732436+0000","last_fullsized":"2024-02-18T10:00:46.732436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734145+0000","last_change":"2024-02-18T10:00:46.734145+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734145+0000","last_undegraded":"2024-02-18T10:00:46.734145+0000","last_fullsized":"2024-02-18T10:00:46.734145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732252+0000","last_change":"2024-02-18T10:00:46.732252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732252+0000","last_undegraded":"2024-02-18T10:00:46.732252+0000","last_fullsized":"2024-02-18T10:00:46.732252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730331+0000","last_change":"2024-02-18T10:00:46.730331+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730331+0000","last_undegraded":"2024-02-18T10:00:46.730331+0000","last_fullsized":"2024-02-18T10:00:46.730331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732053+0000","last_change":"2024-02-18T10:00:46.732053+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732053+0000","last_undegraded":"2024-02-18T10:00:46.732053+0000","last_fullsized":"2024-02-18T10:00:46.732053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733822+0000","last_change":"2024-02-18T10:00:46.733822+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733822+0000","last_undegraded":"2024-02-18T10:00:46.733822+0000","last_fullsized":"2024-02-18T10:00:46.733822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729967+0000","last_change":"2024-02-18T10:00:46.729967+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729967+0000","last_undegraded":"2024-02-18T10:00:46.729967+0000","last_fullsized":"2024-02-18T10:00:46.729967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732068+0000","last_change":"2024-02-18T10:00:46.732068+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732068+0000","last_undegraded":"2024-02-18T10:00:46.732068+0000","last_fullsized":"2024-02-18T10:00:46.732068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732991+0000","last_change":"2024-02-18T10:00:46.732991+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732991+0000","last_undegraded":"2024-02-18T10:00:46.732991+0000","last_fullsized":"2024-02-18T10:00:46.732991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729780+0000","last_change":"2024-02-18T10:00:46.729780+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729780+0000","last_undegraded":"2024-02-18T10:00:46.729780+0000","last_fullsized":"2024-02-18T10:00:46.729780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730365+0000","last_change":"2024-02-18T10:00:46.730365+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730365+0000","last_undegraded":"2024-02-18T10:00:46.730365+0000","last_fullsized":"2024-02-18T10:00:46.730365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730375+0000","last_change":"2024-02-18T10:00:46.730375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730375+0000","last_undegraded":"2024-02-18T10:00:46.730375+0000","last_fullsized":"2024-02-18T10:00:46.730375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733375+0000","last_change":"2024-02-18T10:00:46.733375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733375+0000","last_undegraded":"2024-02-18T10:00:46.733375+0000","last_fullsized":"2024-02-18T10:00:46.733375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730270+0000","last_change":"2024-02-18T10:00:46.730270+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730270+0000","last_undegraded":"2024-02-18T10:00:46.730270+0000","last_fullsized":"2024-02-18T10:00:46.730270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-18T10:00:46.734908+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:00:46.734908+0000","last_peered":"2024-02-18T10:00:46.734908+0000","last_clean":"2024-02-18T10:00:46.734908+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:00:46.734908+0000","last_undegraded":"2024-02-18T10:00:46.734908+0000","last_fullsized":"2024-02-18T10:00:46.734908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732050+0000","last_change":"2024-02-18T10:00:46.732050+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732050+0000","last_undegraded":"2024-02-18T10:00:46.732050+0000","last_fullsized":"2024-02-18T10:00:46.732050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732191+0000","last_change":"2024-02-18T10:00:46.732191+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732191+0000","last_undegraded":"2024-02-18T10:00:46.732191+0000","last_fullsized":"2024-02-18T10:00:46.732191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730252+0000","last_change":"2024-02-18T10:00:46.730252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730252+0000","last_undegraded":"2024-02-18T10:00:46.730252+0000","last_fullsized":"2024-02-18T10:00:46.730252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732044+0000","last_change":"2024-02-18T10:00:46.732044+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732044+0000","last_undegraded":"2024-02-18T10:00:46.732044+0000","last_fullsized":"2024-02-18T10:00:46.732044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732472+0000","last_change":"2024-02-18T10:00:46.732472+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732472+0000","last_undegraded":"2024-02-18T10:00:46.732472+0000","last_fullsized":"2024-02-18T10:00:46.732472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732377+0000","last_change":"2024-02-18T10:00:46.732377+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732377+0000","last_undegraded":"2024-02-18T10:00:46.732377+0000","last_fullsized":"2024-02-18T10:00:46.732377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733537+0000","last_change":"2024-02-18T10:00:46.733537+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733537+0000","last_undegraded":"2024-02-18T10:00:46.733537+0000","last_fullsized":"2024-02-18T10:00:46.733537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729912+0000","last_change":"2024-02-18T10:00:46.729912+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729912+0000","last_undegraded":"2024-02-18T10:00:46.729912+0000","last_fullsized":"2024-02-18T10:00:46.729912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734434+0000","last_change":"2024-02-18T10:00:46.734434+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734434+0000","last_undegraded":"2024-02-18T10:00:46.734434+0000","last_fullsized":"2024-02-18T10:00:46.734434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732484+0000","last_change":"2024-02-18T10:00:46.732484+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732484+0000","last_undegraded":"2024-02-18T10:00:46.732484+0000","last_fullsized":"2024-02-18T10:00:46.732484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732692+0000","last_change":"2024-02-18T10:00:46.732692+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732692+0000","last_undegraded":"2024-02-18T10:00:46.732692+0000","last_fullsized":"2024-02-18T10:00:46.732692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732640+0000","last_change":"2024-02-18T10:00:46.732640+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732640+0000","last_undegraded":"2024-02-18T10:00:46.732640+0000","last_fullsized":"2024-02-18T10:00:46.732640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732398+0000","last_change":"2024-02-18T10:00:46.732398+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732398+0000","last_undegraded":"2024-02-18T10:00:46.732398+0000","last_fullsized":"2024-02-18T10:00:46.732398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733729+0000","last_change":"2024-02-18T10:00:46.733729+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733729+0000","last_undegraded":"2024-02-18T10:00:46.733729+0000","last_fullsized":"2024-02-18T10:00:46.733729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732620+0000","last_change":"2024-02-18T10:00:46.732620+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732620+0000","last_undegraded":"2024-02-18T10:00:46.732620+0000","last_fullsized":"2024-02-18T10:00:46.732620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.731931+0000","last_change":"2024-02-18T10:00:46.731931+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.731931+0000","last_undegraded":"2024-02-18T10:00:46.731931+0000","last_fullsized":"2024-02-18T10:00:46.731931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:00:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-02-18T10:00:52.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-02-18T10:00:52.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-02-18T10:00:52.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-02-18T10:00:52.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-02-18T10:00:52.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-02-18T10:00:52.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-02-18T10:00:52.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-02-18T10:00:52.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-02-18T10:00:52.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-02-18T10:00:52.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-02-18T10:00:52.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-02-18T10:00:52.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-02-18T10:00:52.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-02-18T10:00:52.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-02-18T10:00:52.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-02-18T10:00:52.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732436+0000', 'last_change': '2024-02-18T10:00:46.732436+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732436+0000', 'last_undegraded': '2024-02-18T10:00:46.732436+0000', 'last_fullsized': '2024-02-18T10:00:46.732436+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-18T10:00:52.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-02-18T10:00:52.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-02-18T10:00:52.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.729771+0000', 'last_change': '2024-02-18T10:00:46.729771+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.729771+0000', 'last_undegraded': '2024-02-18T10:00:46.729771+0000', 'last_fullsized': '2024-02-18T10:00:46.729771+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-18T10:00:52.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-02-18T10:00:52.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.734145+0000', 'last_change': '2024-02-18T10:00:46.734145+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.734145+0000', 'last_undegraded': '2024-02-18T10:00:46.734145+0000', 'last_fullsized': '2024-02-18T10:00:46.734145+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-18T10:00:52.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-02-18T10:00:52.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-02-18T10:00:52.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732252+0000', 'last_change': '2024-02-18T10:00:46.732252+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732252+0000', 'last_undegraded': '2024-02-18T10:00:46.732252+0000', 'last_fullsized': '2024-02-18T10:00:46.732252+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-18T10:00:52.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-02-18T10:00:52.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-02-18T10:00:52.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.730331+0000', 'last_change': '2024-02-18T10:00:46.730331+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.730331+0000', 'last_undegraded': '2024-02-18T10:00:46.730331+0000', 'last_fullsized': '2024-02-18T10:00:46.730331+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-18T10:00:52.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-02-18T10:00:52.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-02-18T10:00:52.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732053+0000', 'last_change': '2024-02-18T10:00:46.732053+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732053+0000', 'last_undegraded': '2024-02-18T10:00:46.732053+0000', 'last_fullsized': '2024-02-18T10:00:46.732053+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-18T10:00:52.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-02-18T10:00:52.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-02-18T10:00:52.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.733822+0000', 'last_change': '2024-02-18T10:00:46.733822+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.733822+0000', 'last_undegraded': '2024-02-18T10:00:46.733822+0000', 'last_fullsized': '2024-02-18T10:00:46.733822+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-18T10:00:52.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.729967+0000', 'last_change': '2024-02-18T10:00:46.729967+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.729967+0000', 'last_undegraded': '2024-02-18T10:00:46.729967+0000', 'last_fullsized': '2024-02-18T10:00:46.729967+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732068+0000', 'last_change': '2024-02-18T10:00:46.732068+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732068+0000', 'last_undegraded': '2024-02-18T10:00:46.732068+0000', 'last_fullsized': '2024-02-18T10:00:46.732068+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732991+0000', 'last_change': '2024-02-18T10:00:46.732991+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732991+0000', 'last_undegraded': '2024-02-18T10:00:46.732991+0000', 'last_fullsized': '2024-02-18T10:00:46.732991+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.729780+0000', 'last_change': '2024-02-18T10:00:46.729780+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.729780+0000', 'last_undegraded': '2024-02-18T10:00:46.729780+0000', 'last_fullsized': '2024-02-18T10:00:46.729780+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-02-18T10:00:52.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.730365+0000', 'last_change': '2024-02-18T10:00:46.730365+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.730365+0000', 'last_undegraded': '2024-02-18T10:00:46.730365+0000', 'last_fullsized': '2024-02-18T10:00:46.730365+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.729771+0000', 'last_change': '2024-02-18T10:00:46.729771+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.729771+0000', 'last_undegraded': '2024-02-18T10:00:46.729771+0000', 'last_fullsized': '2024-02-18T10:00:46.729771+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.730375+0000', 'last_change': '2024-02-18T10:00:46.730375+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.730375+0000', 'last_undegraded': '2024-02-18T10:00:46.730375+0000', 'last_fullsized': '2024-02-18T10:00:46.730375+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.733375+0000', 'last_change': '2024-02-18T10:00:46.733375+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.733375+0000', 'last_undegraded': '2024-02-18T10:00:46.733375+0000', 'last_fullsized': '2024-02-18T10:00:46.733375+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.730270+0000', 'last_change': '2024-02-18T10:00:46.730270+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.730270+0000', 'last_undegraded': '2024-02-18T10:00:46.730270+0000', 'last_fullsized': '2024-02-18T10:00:46.730270+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-02-18T10:00:52.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732050+0000', 'last_change': '2024-02-18T10:00:46.732050+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732050+0000', 'last_undegraded': '2024-02-18T10:00:46.732050+0000', 'last_fullsized': '2024-02-18T10:00:46.732050+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732191+0000', 'last_change': '2024-02-18T10:00:46.732191+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732191+0000', 'last_undegraded': '2024-02-18T10:00:46.732191+0000', 'last_fullsized': '2024-02-18T10:00:46.732191+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.730252+0000', 'last_change': '2024-02-18T10:00:46.730252+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.730252+0000', 'last_undegraded': '2024-02-18T10:00:46.730252+0000', 'last_fullsized': '2024-02-18T10:00:46.730252+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-02-18T10:00:52.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732044+0000', 'last_change': '2024-02-18T10:00:46.732044+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732044+0000', 'last_undegraded': '2024-02-18T10:00:46.732044+0000', 'last_fullsized': '2024-02-18T10:00:46.732044+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-18T10:00:52.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732472+0000', 'last_change': '2024-02-18T10:00:46.732472+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732472+0000', 'last_undegraded': '2024-02-18T10:00:46.732472+0000', 'last_fullsized': '2024-02-18T10:00:46.732472+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732377+0000', 'last_change': '2024-02-18T10:00:46.732377+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732377+0000', 'last_undegraded': '2024-02-18T10:00:46.732377+0000', 'last_fullsized': '2024-02-18T10:00:46.732377+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-02-18T10:00:52.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.733537+0000', 'last_change': '2024-02-18T10:00:46.733537+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.733537+0000', 'last_undegraded': '2024-02-18T10:00:46.733537+0000', 'last_fullsized': '2024-02-18T10:00:46.733537+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.729912+0000', 'last_change': '2024-02-18T10:00:46.729912+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.729912+0000', 'last_undegraded': '2024-02-18T10:00:46.729912+0000', 'last_fullsized': '2024-02-18T10:00:46.729912+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-02-18T10:00:52.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.734434+0000', 'last_change': '2024-02-18T10:00:46.734434+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.734434+0000', 'last_undegraded': '2024-02-18T10:00:46.734434+0000', 'last_fullsized': '2024-02-18T10:00:46.734434+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732484+0000', 'last_change': '2024-02-18T10:00:46.732484+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732484+0000', 'last_undegraded': '2024-02-18T10:00:46.732484+0000', 'last_fullsized': '2024-02-18T10:00:46.732484+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732692+0000', 'last_change': '2024-02-18T10:00:46.732692+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732692+0000', 'last_undegraded': '2024-02-18T10:00:46.732692+0000', 'last_fullsized': '2024-02-18T10:00:46.732692+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-02-18T10:00:52.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732640+0000', 'last_change': '2024-02-18T10:00:46.732640+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732640+0000', 'last_undegraded': '2024-02-18T10:00:46.732640+0000', 'last_fullsized': '2024-02-18T10:00:46.732640+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732398+0000', 'last_change': '2024-02-18T10:00:46.732398+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732398+0000', 'last_undegraded': '2024-02-18T10:00:46.732398+0000', 'last_fullsized': '2024-02-18T10:00:46.732398+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-02-18T10:00:52.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.733729+0000', 'last_change': '2024-02-18T10:00:46.733729+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.733729+0000', 'last_undegraded': '2024-02-18T10:00:46.733729+0000', 'last_fullsized': '2024-02-18T10:00:46.733729+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.732620+0000', 'last_change': '2024-02-18T10:00:46.732620+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.732620+0000', 'last_undegraded': '2024-02-18T10:00:46.732620+0000', 'last_fullsized': '2024-02-18T10:00:46.732620+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-18T10:00:47.727742+0000', 'last_change': '2024-02-18T10:00:47.727742+0000', 'last_active': '2024-02-18T10:00:47.727742+0000', 'last_peered': '2024-02-18T10:00:47.727742+0000', 'last_clean': '2024-02-18T10:00:47.727742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:47.727742+0000', 'last_undegraded': '2024-02-18T10:00:47.727742+0000', 'last_fullsized': '2024-02-18T10:00:47.727742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:47.727742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-02-18T10:00:52.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-02-18T10:00:46.731931+0000', 'last_change': '2024-02-18T10:00:46.731931+0000', 'last_active': '2024-02-18T10:00:46.725428+0000', 'last_peered': '2024-02-18T10:00:46.725428+0000', 'last_clean': '2024-02-18T10:00:46.725428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-18T10:00:46.731931+0000', 'last_undegraded': '2024-02-18T10:00:46.731931+0000', 'last_fullsized': '2024-02-18T10:00:46.731931+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'last_clean_scrub_stamp': '2024-02-18T10:00:46.725428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-18T10:00:52.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-18T10:00:52.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.518+0000 7f50c3a95640 1 Processor -- start 2024-02-18T10:00:52.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.518+0000 7f50c3a95640 1 -- start start 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c3a95640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc0ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c3a95640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f50bc0a0ce0 0x7f50bc070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c3a95640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50bc14cfd0 0x7f50bc14d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c3a95640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc072fe0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c3a95640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc0b4f90 con 0x7f50bc0a0ce0 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c3a95640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1441f0 con 0x7f50bc143e10 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50bc14cfd0 0x7f50bc14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50bc14cfd0 0x7f50bc14d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57410/0 (socket says 172.21.15.118:57410) 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 -- 172.21.15.118:0/129538641 learned_addr learned my addr 172.21.15.118:0/129538641 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:52.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c1831640 1 --2- 172.21.15.118:0/129538641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc0ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c1030640 1 --2- 172.21.15.118:0/129538641 >> v2:172.21.15.164:3300/0 conn(0x7f50bc0a0ce0 0x7f50bc070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 -- 172.21.15.118:0/129538641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 msgr2=0x7f50bc0ba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 --2- 172.21.15.118:0/129538641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc0ba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 -- 172.21.15.118:0/129538641 >> v2:172.21.15.164:3300/0 conn(0x7f50bc0a0ce0 msgr2=0x7f50bc070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 --2- 172.21.15.118:0/129538641 >> v2:172.21.15.164:3300/0 conn(0x7f50bc0a0ce0 0x7f50bc070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c2032640 1 -- 172.21.15.118:0/129538641 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0b4660 con 0x7f50bc14cfd0 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.519+0000 7f50c1030640 1 --2- 172.21.15.118:0/129538641 >> v2:172.21.15.164:3300/0 conn(0x7f50bc0a0ce0 0x7f50bc070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.520+0000 7f50c2032640 1 --2- 172.21.15.118:0/129538641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc14d480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e50 tx=0x7f50b802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a71b4b4d4594549 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.520+0000 7f50c082f640 1 -- 172.21.15.118:0/129538641 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b802cb00 con 0x7f50bc14cfd0 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.520+0000 7f50c082f640 1 -- 172.21.15.118:0/129538641 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b802cc60 con 0x7f50bc14cfd0 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.520+0000 7f50c082f640 1 -- 172.21.15.118:0/129538641 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b80343f0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 -- 172.21.15.118:0/129538641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 msgr2=0x7f50bc14d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 --2- 172.21.15.118:0/129538641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc14d480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e50 tx=0x7f50b802bf60 comp rx=0 tx=0).stop 2024-02-18T10:00:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 -- 172.21.15.118:0/129538641 shutdown_connections 2024-02-18T10:00:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 --2- 172.21.15.118:0/129538641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc14d480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 --2- 172.21.15.118:0/129538641 >> v2:172.21.15.164:3300/0 conn(0x7f50bc0a0ce0 0x7f50bc070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 --2- 172.21.15.118:0/129538641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc0ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 -- 172.21.15.118:0/129538641 >> 172.21.15.118:0/129538641 conn(0x7f50bc06bcf0 msgr2=0x7f50bc06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 -- 172.21.15.118:0/129538641 shutdown_connections 2024-02-18T10:00:52.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.521+0000 7f50c3a95640 1 -- 172.21.15.118:0/129538641 wait complete. 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.522+0000 7f50c3a95640 1 Processor -- start 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.522+0000 7f50c3a95640 1 -- start start 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50bc0a0ce0 0x7f50bc06e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc13d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc1e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc13dde0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc06eba0 con 0x7f50bc0a0ce0 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc06e830 con 0x7f50bc143e10 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc1e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc1e10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57416/0 (socket says 172.21.15.118:57416) 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 -- 172.21.15.118:0/3039909181 learned_addr learned my addr 172.21.15.118:0/3039909181 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c1030640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc13d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c1831640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50bc0a0ce0 0x7f50bc06e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 -- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 msgr2=0x7f50bc13d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc13d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 -- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50bc0a0ce0 msgr2=0x7f50bc06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50bc0a0ce0 0x7f50bc06e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 -- 172.21.15.118:0/3039909181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009b30 con 0x7f50bc14cfd0 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c2032640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc1e10b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e50 tx=0x7f50b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50b27fc640 1 -- 172.21.15.118:0/3039909181 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8040670 con 0x7f50bc14cfd0 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50b27fc640 1 -- 172.21.15.118:0/3039909181 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b80407f0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc1e15f0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50b27fc640 1 -- 172.21.15.118:0/3039909181 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8040ba0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.523+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc1e4840 con 0x7f50bc14cfd0 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.524+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc0b40a0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.525+0000 7f50b27fc640 1 -- 172.21.15.118:0/3039909181 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f50b8040d00 con 0x7f50bc14cfd0 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.525+0000 7f50b27fc640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50a006bc70 0x7f50a006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.525+0000 7f50b27fc640 1 -- 172.21.15.118:0/3039909181 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50b80ad950 con 0x7f50bc14cfd0 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.525+0000 7f50c1831640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50a006bc70 0x7f50a006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.525+0000 7f50c1831640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50a006bc70 0x7f50a006e130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f50b4006fd0 tx=0x7f50b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.529+0000 7f50b27fc640 1 -- 172.21.15.118:0/3039909181 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f50b8078270 con 0x7f50bc14cfd0 2024-02-18T10:00:52.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.771+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f50bc074af0 con 0x7f50bc14cfd0 2024-02-18T10:00:52.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.772+0000 7f50b27fc640 1 -- 172.21.15.118:0/3039909181 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1107 (secure 0 0 0) 0x7f50b8009510 con 0x7f50bc14cfd0 2024-02-18T10:00:52.774 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:52.774 INFO:teuthology.orchestra.run.smithi118.stdout:{"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1708250441,"num_in_osds":8,"osd_in_since":1708250433,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":241786880,"bytes_avail":772852326400,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4264}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-02-18T10:00:31.154952+0000","services":{}},"progress_events":{}} 2024-02-18T10:00:52.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50a006bc70 msgr2=0x7f50a006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50a006bc70 0x7f50a006e130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f50b4006fd0 tx=0x7f50b4008040 comp rx=0 tx=0).stop 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 msgr2=0x7f50bc1e10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc1e10b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009e50 tx=0x7f50b8004a40 comp rx=0 tx=0).stop 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 shutdown_connections 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50a006bc70 0x7f50a006e130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50bc14cfd0 0x7f50bc1e10b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50bc143e10 0x7f50bc13d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 --2- 172.21.15.118:0/3039909181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50bc0a0ce0 0x7f50bc06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 >> 172.21.15.118:0/3039909181 conn(0x7f50bc06bcf0 msgr2=0x7f50bc1406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 shutdown_connections 2024-02-18T10:00:52.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.774+0000 7f50c3a95640 1 -- 172.21.15.118:0/3039909181 wait complete. 2024-02-18T10:00:52.787 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-18T10:00:52.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:00:52.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.884+0000 7f0129cf4640 1 Processor -- start 2024-02-18T10:00:52.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.884+0000 7f0129cf4640 1 -- start start 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0129cf4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0124072c50 0x7f0124070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0129cf4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f012414bbf0 0x7f012414c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0129cf4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01240ba190 con 0x7f0124145f30 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0129cf4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01240babe0 con 0x7f0124072c50 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0129cf4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0124146310 con 0x7f012414bbf0 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f01237fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0124145f30 0x7f012406abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46978/0 (socket says 172.21.15.118:46978) 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0122ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0124072c50 0x7f0124070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f01237fe640 1 -- 172.21.15.118:0/616853867 learned_addr learned my addr 172.21.15.118:0/616853867 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:52.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0123fff640 1 --2- 172.21.15.118:0/616853867 >> v2:172.21.15.164:3300/0 conn(0x7f012414bbf0 0x7f012414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0122ffd640 1 -- 172.21.15.118:0/616853867 >> v2:172.21.15.164:3300/0 conn(0x7f012414bbf0 msgr2=0x7f012414c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:52.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0122ffd640 1 --2- 172.21.15.118:0/616853867 >> v2:172.21.15.164:3300/0 conn(0x7f012414bbf0 0x7f012414c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0122ffd640 1 -- 172.21.15.118:0/616853867 >> v1:172.21.15.118:6789/0 conn(0x7f0124145f30 legacy=0x7f012406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f0122ffd640 1 -- 172.21.15.118:0/616853867 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012406b2f0 con 0x7f0124072c50 2024-02-18T10:00:52.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.885+0000 7f01227fc640 1 -- 172.21.15.118:0/616853867 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948724502 0 0) 0x7f01240ba190 con 0x7f0124145f30 2024-02-18T10:00:52.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.886+0000 7f0122ffd640 1 --2- 172.21.15.118:0/616853867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0124072c50 0x7f0124070f70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f01240673b0 tx=0x7f011802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae46f9a5324658a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.886+0000 7f01227fc640 1 -- 172.21.15.118:0/616853867 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118031830 con 0x7f0124072c50 2024-02-18T10:00:52.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.886+0000 7f01227fc640 1 -- 172.21.15.118:0/616853867 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0118031990 con 0x7f0124072c50 2024-02-18T10:00:52.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.886+0000 7f01227fc640 1 -- 172.21.15.118:0/616853867 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118031d20 con 0x7f0124072c50 2024-02-18T10:00:52.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 -- 172.21.15.118:0/616853867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0124072c50 msgr2=0x7f0124070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 --2- 172.21.15.118:0/616853867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0124072c50 0x7f0124070f70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f01240673b0 tx=0x7f011802b8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 -- 172.21.15.118:0/616853867 shutdown_connections 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 --2- 172.21.15.118:0/616853867 >> v2:172.21.15.164:3300/0 conn(0x7f012414bbf0 0x7f012414c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 --2- 172.21.15.118:0/616853867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0124072c50 0x7f0124070f70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 -- 172.21.15.118:0/616853867 >> 172.21.15.118:0/616853867 conn(0x7f012406bcf0 msgr2=0x7f012406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 -- 172.21.15.118:0/616853867 shutdown_connections 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.887+0000 7f0129cf4640 1 -- 172.21.15.118:0/616853867 wait complete. 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 Processor -- start 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 -- start start 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0124072c50 0x7f01240a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0124145f30 0x7f01240a3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012414bbf0 0x7f012413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01240a3a70 con 0x7f012414bbf0 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01240a42d0 con 0x7f0124072c50 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0129cf4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01241e2080 con 0x7f0124145f30 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.888+0000 7f0123fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012414bbf0 0x7f012413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012414bbf0 0x7f012413f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57440/0 (socket says 172.21.15.118:57440) 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 -- 172.21.15.118:0/2456207120 learned_addr learned my addr 172.21.15.118:0/2456207120 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f01237fe640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0124072c50 0x7f01240a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0122ffd640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0124145f30 0x7f01240a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 -- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0124145f30 msgr2=0x7f01240a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0124145f30 0x7f01240a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 -- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0124072c50 msgr2=0x7f01240a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0124072c50 0x7f01240a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 -- 172.21.15.118:0/2456207120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0118009400 con 0x7f012414bbf0 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0123fff640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012414bbf0 0x7f012413f250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f011c007e90 tx=0x7f011c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f010bfff640 1 -- 172.21.15.118:0/2456207120 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c014420 con 0x7f012414bbf0 2024-02-18T10:00:52.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f010bfff640 1 -- 172.21.15.118:0/2456207120 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c014580 con 0x7f012414bbf0 2024-02-18T10:00:52.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01240a2710 con 0x7f012414bbf0 2024-02-18T10:00:52.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f010bfff640 1 -- 172.21.15.118:0/2456207120 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c014930 con 0x7f012414bbf0 2024-02-18T10:00:52.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.889+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01241e1a30 con 0x7f012414bbf0 2024-02-18T10:00:52.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.890+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01241e1880 con 0x7f012414bbf0 2024-02-18T10:00:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.890+0000 7f010bfff640 1 -- 172.21.15.118:0/2456207120 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f011c014a90 con 0x7f012414bbf0 2024-02-18T10:00:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.891+0000 7f010bfff640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f011006bca0 0x7f011006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.891+0000 7f010bfff640 1 -- 172.21.15.118:0/2456207120 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f011c08aef0 con 0x7f012414bbf0 2024-02-18T10:00:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.891+0000 7f01237fe640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f011006bca0 0x7f011006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:52.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.891+0000 7f01237fe640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f011006bca0 0x7f011006e160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0114000f60 tx=0x7f0114007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:52.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:52.895+0000 7f010bfff640 1 -- 172.21.15.118:0/2456207120 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f011c055760 con 0x7f012414bbf0 2024-02-18T10:00:53.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.060+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01240ba3e0 con 0x7f011006bca0 2024-02-18T10:00:53.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.065+0000 7f010bfff640 1 -- 172.21.15.118:0/2456207120 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240015 (secure 0 0 0) 0x7f0114004c70 con 0x7f011006bca0 2024-02-18T10:00:53.070 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:53.071 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f011006bca0 msgr2=0x7f011006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f011006bca0 0x7f011006e160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0114000f60 tx=0x7f0114007d50 comp rx=0 tx=0).stop 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012414bbf0 msgr2=0x7f012413f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012414bbf0 0x7f012413f250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f011c007e90 tx=0x7f011c00e4b0 comp rx=0 tx=0).stop 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 shutdown_connections 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f011006bca0 0x7f011006e160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f012414bbf0 0x7f012413f250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:53.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0124145f30 0x7f01240a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:53.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 --2- 172.21.15.118:0/2456207120 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0124072c50 0x7f01240a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:53.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 >> 172.21.15.118:0/2456207120 conn(0x7f012406bcf0 msgr2=0x7f012406df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:53.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 shutdown_connections 2024-02-18T10:00:53.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:53.068+0000 7f0129cf4640 1 -- 172.21.15.118:0/2456207120 wait complete. 2024-02-18T10:00:53.081 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-02-18T10:00:51.278331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236120,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738600,"statfs":{"total":773094113280,"available":772852326400,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.546107"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732436+0000","last_change":"2024-02-18T10:00:46.732436+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732436+0000","last_undegraded":"2024-02-18T10:00:46.732436+0000","last_fullsized":"2024-02-18T10:00:46.732436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734145+0000","last_change":"2024-02-18T10:00:46.734145+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734145+0000","last_undegraded":"2024-02-18T10:00:46.734145+0000","last_fullsized":"2024-02-18T10:00:46.734145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732252+0000","last_change":"2024-02-18T10:00:46.732252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732252+0000","last_undegraded":"2024-02-18T10:00:46.732252+0000","last_fullsized":"2024-02-18T10:00:46.732252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730331+0000","last_change":"2024-02-18T10:00:46.730331+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730331+0000","last_undegraded":"2024-02-18T10:00:46.730331+0000","last_fullsized":"2024-02-18T10:00:46.730331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732053+0000","last_change":"2024-02-18T10:00:46.732053+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732053+0000","last_undegraded":"2024-02-18T10:00:46.732053+0000","last_fullsized":"2024-02-18T10:00:46.732053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733822+0000","last_change":"2024-02-18T10:00:46.733822+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733822+0000","last_undegraded":"2024-02-18T10:00:46.733822+0000","last_fullsized":"2024-02-18T10:00:46.733822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729967+0000","last_change":"2024-02-18T10:00:46.729967+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729967+0000","last_undegraded":"2024-02-18T10:00:46.729967+0000","last_fullsized":"2024-02-18T10:00:46.729967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732068+0000","last_change":"2024-02-18T10:00:46.732068+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732068+0000","last_undegraded":"2024-02-18T10:00:46.732068+0000","last_fullsized":"2024-02-18T10:00:46.732068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732991+0000","last_change":"2024-02-18T10:00:46.732991+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732991+0000","last_undegraded":"2024-02-18T10:00:46.732991+0000","last_fullsized":"2024-02-18T10:00:46.732991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729780+0000","last_change":"2024-02-18T10:00:46.729780+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729780+0000","last_undegraded":"2024-02-18T10:00:46.729780+0000","last_fullsized":"2024-02-18T10:00:46.729780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730365+0000","last_change":"2024-02-18T10:00:46.730365+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730365+0000","last_undegraded":"2024-02-18T10:00:46.730365+0000","last_fullsized":"2024-02-18T10:00:46.730365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729771+0000","last_change":"2024-02-18T10:00:46.729771+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729771+0000","last_undegraded":"2024-02-18T10:00:46.729771+0000","last_fullsized":"2024-02-18T10:00:46.729771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730375+0000","last_change":"2024-02-18T10:00:46.730375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730375+0000","last_undegraded":"2024-02-18T10:00:46.730375+0000","last_fullsized":"2024-02-18T10:00:46.730375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733375+0000","last_change":"2024-02-18T10:00:46.733375+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733375+0000","last_undegraded":"2024-02-18T10:00:46.733375+0000","last_fullsized":"2024-02-18T10:00:46.733375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730270+0000","last_change":"2024-02-18T10:00:46.730270+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730270+0000","last_undegraded":"2024-02-18T10:00:46.730270+0000","last_fullsized":"2024-02-18T10:00:46.730270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-02-18T10:00:46.734908+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:00:46.734908+0000","last_peered":"2024-02-18T10:00:46.734908+0000","last_clean":"2024-02-18T10:00:46.734908+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:00:46.734908+0000","last_undegraded":"2024-02-18T10:00:46.734908+0000","last_fullsized":"2024-02-18T10:00:46.734908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732050+0000","last_change":"2024-02-18T10:00:46.732050+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732050+0000","last_undegraded":"2024-02-18T10:00:46.732050+0000","last_fullsized":"2024-02-18T10:00:46.732050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732191+0000","last_change":"2024-02-18T10:00:46.732191+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732191+0000","last_undegraded":"2024-02-18T10:00:46.732191+0000","last_fullsized":"2024-02-18T10:00:46.732191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.730252+0000","last_change":"2024-02-18T10:00:46.730252+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.730252+0000","last_undegraded":"2024-02-18T10:00:46.730252+0000","last_fullsized":"2024-02-18T10:00:46.730252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732044+0000","last_change":"2024-02-18T10:00:46.732044+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732044+0000","last_undegraded":"2024-02-18T10:00:46.732044+0000","last_fullsized":"2024-02-18T10:00:46.732044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732472+0000","last_change":"2024-02-18T10:00:46.732472+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732472+0000","last_undegraded":"2024-02-18T10:00:46.732472+0000","last_fullsized":"2024-02-18T10:00:46.732472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732377+0000","last_change":"2024-02-18T10:00:46.732377+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732377+0000","last_undegraded":"2024-02-18T10:00:46.732377+0000","last_fullsized":"2024-02-18T10:00:46.732377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733537+0000","last_change":"2024-02-18T10:00:46.733537+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733537+0000","last_undegraded":"2024-02-18T10:00:46.733537+0000","last_fullsized":"2024-02-18T10:00:46.733537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.729912+0000","last_change":"2024-02-18T10:00:46.729912+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.729912+0000","last_undegraded":"2024-02-18T10:00:46.729912+0000","last_fullsized":"2024-02-18T10:00:46.729912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.734434+0000","last_change":"2024-02-18T10:00:46.734434+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.734434+0000","last_undegraded":"2024-02-18T10:00:46.734434+0000","last_fullsized":"2024-02-18T10:00:46.734434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732484+0000","last_change":"2024-02-18T10:00:46.732484+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732484+0000","last_undegraded":"2024-02-18T10:00:46.732484+0000","last_fullsized":"2024-02-18T10:00:46.732484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732692+0000","last_change":"2024-02-18T10:00:46.732692+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732692+0000","last_undegraded":"2024-02-18T10:00:46.732692+0000","last_fullsized":"2024-02-18T10:00:46.732692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732640+0000","last_change":"2024-02-18T10:00:46.732640+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732640+0000","last_undegraded":"2024-02-18T10:00:46.732640+0000","last_fullsized":"2024-02-18T10:00:46.732640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732398+0000","last_change":"2024-02-18T10:00:46.732398+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732398+0000","last_undegraded":"2024-02-18T10:00:46.732398+0000","last_fullsized":"2024-02-18T10:00:46.732398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.733729+0000","last_change":"2024-02-18T10:00:46.733729+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.733729+0000","last_undegraded":"2024-02-18T10:00:46.733729+0000","last_fullsized":"2024-02-18T10:00:46.733729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.732620+0000","last_change":"2024-02-18T10:00:46.732620+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.732620+0000","last_undegraded":"2024-02-18T10:00:46.732620+0000","last_fullsized":"2024-02-18T10:00:46.732620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-18T10:00:47.727742+0000","last_change":"2024-02-18T10:00:47.727742+0000","last_active":"2024-02-18T10:00:47.727742+0000","last_peered":"2024-02-18T10:00:47.727742+0000","last_clean":"2024-02-18T10:00:47.727742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:47.727742+0000","last_undegraded":"2024-02-18T10:00:47.727742+0000","last_fullsized":"2024-02-18T10:00:47.727742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-02-18T10:00:46.731931+0000","last_change":"2024-02-18T10:00:46.731931+0000","last_active":"2024-02-18T10:00:46.725428+0000","last_peered":"2024-02-18T10:00:46.725428+0000","last_clean":"2024-02-18T10:00:46.725428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-18T10:00:46.731931+0000","last_undegraded":"2024-02-18T10:00:46.731931+0000","last_fullsized":"2024-02-18T10:00:46.731931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:00:56.085 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:00:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.195+0000 7fabe3202640 1 Processor -- start 2024-02-18T10:00:56.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.195+0000 7fabe3202640 1 -- start start 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe3202640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fabdc06bc20 0x7fabdc14c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe3202640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabdc0bd240 0x7fabdc0bf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe3202640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bfe60 0x7fabdc14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe3202640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0bdbb0 con 0x7fabdc0bd240 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe3202640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc14be60 con 0x7fabdc06bc20 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe3202640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc14c140 con 0x7fabdc0bfe60 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabdc0bd240 0x7fabdc0bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabdc0bd240 0x7fabdc0bf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57442/0 (socket says 172.21.15.118:57442) 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 -- 172.21.15.118:0/2510048970 learned_addr learned my addr 172.21.15.118:0/2510048970 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe0f9e640 1 --2- 172.21.15.118:0/2510048970 >> v2:172.21.15.164:3300/0 conn(0x7fabdc06bc20 0x7fabdc14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabe179f640 1 --2- 172.21.15.118:0/2510048970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bfe60 0x7fabdc14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 -- 172.21.15.118:0/2510048970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bfe60 msgr2=0x7fabdc14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 --2- 172.21.15.118:0/2510048970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bfe60 0x7fabdc14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 -- 172.21.15.118:0/2510048970 >> v2:172.21.15.164:3300/0 conn(0x7fabdc06bc20 msgr2=0x7fabdc14c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 --2- 172.21.15.118:0/2510048970 >> v2:172.21.15.164:3300/0 conn(0x7fabdc06bc20 0x7fabdc14c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.196+0000 7fabdbfff640 1 -- 172.21.15.118:0/2510048970 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc14c420 con 0x7fabdc0bd240 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabdbfff640 1 --2- 172.21.15.118:0/2510048970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc0bd240 0x7fabdc0bf260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fabdc06ac90 tx=0x7fabc802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d589bfeb3778ef server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabdb7fe640 1 -- 172.21.15.118:0/2510048970 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80317e0 con 0x7fabdc0bd240 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabdb7fe640 1 -- 172.21.15.118:0/2510048970 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8031940 con 0x7fabdc0bd240 2024-02-18T10:00:56.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabdb7fe640 1 -- 172.21.15.118:0/2510048970 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8031cd0 con 0x7fabdc0bd240 2024-02-18T10:00:56.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 -- 172.21.15.118:0/2510048970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc0bd240 msgr2=0x7fabdc0bf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 --2- 172.21.15.118:0/2510048970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc0bd240 0x7fabdc0bf260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fabdc06ac90 tx=0x7fabc802b880 comp rx=0 tx=0).stop 2024-02-18T10:00:56.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 -- 172.21.15.118:0/2510048970 shutdown_connections 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 --2- 172.21.15.118:0/2510048970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bfe60 0x7fabdc14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 --2- 172.21.15.118:0/2510048970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc0bd240 0x7fabdc0bf260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 --2- 172.21.15.118:0/2510048970 >> v2:172.21.15.164:3300/0 conn(0x7fabdc06bc20 0x7fabdc14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 -- 172.21.15.118:0/2510048970 >> 172.21.15.118:0/2510048970 conn(0x7fabdc0c1850 msgr2=0x7fabdc0c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 -- 172.21.15.118:0/2510048970 shutdown_connections 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.197+0000 7fabe3202640 1 -- 172.21.15.118:0/2510048970 wait complete. 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.198+0000 7fabe3202640 1 Processor -- start 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe3202640 1 -- start start 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe3202640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc06bc20 0x7fabdc0a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe3202640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bd240 0x7fabdc0baa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe3202640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabdc0bfe60 0x7fabdc0bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe3202640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0a6190 con 0x7fabdc06bc20 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe3202640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0b88a0 con 0x7fabdc0bfe60 2024-02-18T10:00:56.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe3202640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0b6ff0 con 0x7fabdc0bd240 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe0f9e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc06bc20 0x7fabdc0a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe0f9e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc06bc20 0x7fabdc0a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57456/0 (socket says 172.21.15.118:57456) 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.199+0000 7fabe0f9e640 1 -- 172.21.15.118:0/4118571074 learned_addr learned my addr 172.21.15.118:0/4118571074 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe179f640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabdc0bfe60 0x7fabdc0bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabdbfff640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bd240 0x7fabdc0baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe0f9e640 1 -- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bd240 msgr2=0x7fabdc0baa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe0f9e640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bd240 0x7fabdc0baa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe0f9e640 1 -- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabdc0bfe60 msgr2=0x7fabdc0bafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe0f9e640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabdc0bfe60 0x7fabdc0bafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe0f9e640 1 -- 172.21.15.118:0/4118571074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80094d0 con 0x7fabdc06bc20 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe179f640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabdc0bfe60 0x7fabdc0bafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe0f9e640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc06bc20 0x7fabdc0a5c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabd000d830 tx=0x7fabd000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabd97fa640 1 -- 172.21.15.118:0/4118571074 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00096a0 con 0x7fabdc06bc20 2024-02-18T10:00:56.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabd97fa640 1 -- 172.21.15.118:0/4118571074 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0009800 con 0x7fabdc06bc20 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabd97fa640 1 -- 172.21.15.118:0/4118571074 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0009b90 con 0x7fabdc06bc20 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc0ba480 con 0x7fabdc06bc20 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.200+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc0b6d10 con 0x7fabdc06bc20 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.201+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc0bbcc0 con 0x7fabdc06bc20 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.202+0000 7fabd97fa640 1 -- 172.21.15.118:0/4118571074 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fabd0014410 con 0x7fabdc06bc20 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.202+0000 7fabd97fa640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fabc006bc70 0x7fabc006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.202+0000 7fabdbfff640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fabc006bc70 0x7fabc006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.202+0000 7fabd97fa640 1 -- 172.21.15.118:0/4118571074 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd008ad70 con 0x7fabdc06bc20 2024-02-18T10:00:56.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.202+0000 7fabdbfff640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fabc006bc70 0x7fabc006e130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabc8036000 tx=0x7fabc803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.206+0000 7fabd97fa640 1 -- 172.21.15.118:0/4118571074 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fabd00555e0 con 0x7fabdc06bc20 2024-02-18T10:00:56.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.375+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabdc0c10c0 con 0x7fabc006bc70 2024-02-18T10:00:56.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.381+0000 7fabd97fa640 1 -- 172.21.15.118:0/4118571074 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251948 (secure 0 0 0) 0x7fabc8031b30 con 0x7fabc006bc70 2024-02-18T10:00:56.386 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:56.388 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:00:56.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fabc006bc70 msgr2=0x7fabc006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fabc006bc70 0x7fabc006e130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabc8036000 tx=0x7fabc803d040 comp rx=0 tx=0).stop 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc06bc20 msgr2=0x7fabdc0a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc06bc20 0x7fabdc0a5c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabd000d830 tx=0x7fabd000dcf0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 shutdown_connections 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fabc006bc70 0x7fabc006e130 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabdc0bfe60 0x7fabdc0bafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fabdc0bd240 0x7fabdc0baa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 --2- 172.21.15.118:0/4118571074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabdc06bc20 0x7fabdc0a5c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 >> 172.21.15.118:0/4118571074 conn(0x7fabdc0c1850 msgr2=0x7fabdc0a1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 shutdown_connections 2024-02-18T10:00:56.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.384+0000 7fabe3202640 1 -- 172.21.15.118:0/4118571074 wait complete. 2024-02-18T10:00:56.397 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-02-18T10:00:55.279214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235724,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738996,"statfs":{"total":773094113280,"available":772852731904,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.546990"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086380+0000","last_change":"2024-02-18T10:00:48.762372+0000","last_active":"2024-02-18T10:00:51.086380+0000","last_peered":"2024-02-18T10:00:51.086380+0000","last_clean":"2024-02-18T10:00:51.086380+0000","last_became_active":"2024-02-18T10:00:48.762116+0000","last_became_peered":"2024-02-18T10:00:48.762116+0000","last_unstale":"2024-02-18T10:00:51.086380+0000","last_undegraded":"2024-02-18T10:00:51.086380+0000","last_fullsized":"2024-02-18T10:00:51.086380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736363+0000","last_change":"2024-02-18T10:00:48.749144+0000","last_active":"2024-02-18T10:00:49.736363+0000","last_peered":"2024-02-18T10:00:49.736363+0000","last_clean":"2024-02-18T10:00:49.736363+0000","last_became_active":"2024-02-18T10:00:48.748769+0000","last_became_peered":"2024-02-18T10:00:48.748769+0000","last_unstale":"2024-02-18T10:00:49.736363+0000","last_undegraded":"2024-02-18T10:00:49.736363+0000","last_fullsized":"2024-02-18T10:00:49.736363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085421+0000","last_change":"2024-02-18T10:00:48.746009+0000","last_active":"2024-02-18T10:00:51.085421+0000","last_peered":"2024-02-18T10:00:51.085421+0000","last_clean":"2024-02-18T10:00:51.085421+0000","last_became_active":"2024-02-18T10:00:48.745723+0000","last_became_peered":"2024-02-18T10:00:48.745723+0000","last_unstale":"2024-02-18T10:00:51.085421+0000","last_undegraded":"2024-02-18T10:00:51.085421+0000","last_fullsized":"2024-02-18T10:00:51.085421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086634+0000","last_change":"2024-02-18T10:00:48.765838+0000","last_active":"2024-02-18T10:00:51.086634+0000","last_peered":"2024-02-18T10:00:51.086634+0000","last_clean":"2024-02-18T10:00:51.086634+0000","last_became_active":"2024-02-18T10:00:48.765603+0000","last_became_peered":"2024-02-18T10:00:48.765603+0000","last_unstale":"2024-02-18T10:00:51.086634+0000","last_undegraded":"2024-02-18T10:00:51.086634+0000","last_fullsized":"2024-02-18T10:00:51.086634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086270+0000","last_change":"2024-02-18T10:00:48.756241+0000","last_active":"2024-02-18T10:00:51.086270+0000","last_peered":"2024-02-18T10:00:51.086270+0000","last_clean":"2024-02-18T10:00:51.086270+0000","last_became_active":"2024-02-18T10:00:48.755053+0000","last_became_peered":"2024-02-18T10:00:48.755053+0000","last_unstale":"2024-02-18T10:00:51.086270+0000","last_undegraded":"2024-02-18T10:00:51.086270+0000","last_fullsized":"2024-02-18T10:00:51.086270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086826+0000","last_change":"2024-02-18T10:00:48.752872+0000","last_active":"2024-02-18T10:00:51.086826+0000","last_peered":"2024-02-18T10:00:51.086826+0000","last_clean":"2024-02-18T10:00:51.086826+0000","last_became_active":"2024-02-18T10:00:48.752303+0000","last_became_peered":"2024-02-18T10:00:48.752303+0000","last_unstale":"2024-02-18T10:00:51.086826+0000","last_undegraded":"2024-02-18T10:00:51.086826+0000","last_fullsized":"2024-02-18T10:00:51.086826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085945+0000","last_change":"2024-02-18T10:00:48.761872+0000","last_active":"2024-02-18T10:00:51.085945+0000","last_peered":"2024-02-18T10:00:51.085945+0000","last_clean":"2024-02-18T10:00:51.085945+0000","last_became_active":"2024-02-18T10:00:48.761571+0000","last_became_peered":"2024-02-18T10:00:48.761571+0000","last_unstale":"2024-02-18T10:00:51.085945+0000","last_undegraded":"2024-02-18T10:00:51.085945+0000","last_fullsized":"2024-02-18T10:00:51.085945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172589+0000","last_change":"2024-02-18T10:00:48.769207+0000","last_active":"2024-02-18T10:00:50.172589+0000","last_peered":"2024-02-18T10:00:50.172589+0000","last_clean":"2024-02-18T10:00:50.172589+0000","last_became_active":"2024-02-18T10:00:48.768911+0000","last_became_peered":"2024-02-18T10:00:48.768911+0000","last_unstale":"2024-02-18T10:00:50.172589+0000","last_undegraded":"2024-02-18T10:00:50.172589+0000","last_fullsized":"2024-02-18T10:00:50.172589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086809+0000","last_change":"2024-02-18T10:00:48.767470+0000","last_active":"2024-02-18T10:00:51.086809+0000","last_peered":"2024-02-18T10:00:51.086809+0000","last_clean":"2024-02-18T10:00:51.086809+0000","last_became_active":"2024-02-18T10:00:48.767204+0000","last_became_peered":"2024-02-18T10:00:48.767204+0000","last_unstale":"2024-02-18T10:00:51.086809+0000","last_undegraded":"2024-02-18T10:00:51.086809+0000","last_fullsized":"2024-02-18T10:00:51.086809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:44.598357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738102+0000","last_change":"2024-02-18T10:00:48.767769+0000","last_active":"2024-02-18T10:00:49.738102+0000","last_peered":"2024-02-18T10:00:49.738102+0000","last_clean":"2024-02-18T10:00:49.738102+0000","last_became_active":"2024-02-18T10:00:48.767502+0000","last_became_peered":"2024-02-18T10:00:48.767502+0000","last_unstale":"2024-02-18T10:00:49.738102+0000","last_undegraded":"2024-02-18T10:00:49.738102+0000","last_fullsized":"2024-02-18T10:00:49.738102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737554+0000","last_change":"2024-02-18T10:00:48.766859+0000","last_active":"2024-02-18T10:00:49.737554+0000","last_peered":"2024-02-18T10:00:49.737554+0000","last_clean":"2024-02-18T10:00:49.737554+0000","last_became_active":"2024-02-18T10:00:48.766595+0000","last_became_peered":"2024-02-18T10:00:48.766595+0000","last_unstale":"2024-02-18T10:00:49.737554+0000","last_undegraded":"2024-02-18T10:00:49.737554+0000","last_fullsized":"2024-02-18T10:00:49.737554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:45:13.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738472+0000","last_change":"2024-02-18T10:00:48.755535+0000","last_active":"2024-02-18T10:00:49.738472+0000","last_peered":"2024-02-18T10:00:49.738472+0000","last_clean":"2024-02-18T10:00:49.738472+0000","last_became_active":"2024-02-18T10:00:48.755267+0000","last_became_peered":"2024-02-18T10:00:48.755267+0000","last_unstale":"2024-02-18T10:00:49.738472+0000","last_undegraded":"2024-02-18T10:00:49.738472+0000","last_fullsized":"2024-02-18T10:00:49.738472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:49.765437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172950+0000","last_change":"2024-02-18T10:00:48.750469+0000","last_active":"2024-02-18T10:00:50.172950+0000","last_peered":"2024-02-18T10:00:50.172950+0000","last_clean":"2024-02-18T10:00:50.172950+0000","last_became_active":"2024-02-18T10:00:48.750226+0000","last_became_peered":"2024-02-18T10:00:48.750226+0000","last_unstale":"2024-02-18T10:00:50.172950+0000","last_undegraded":"2024-02-18T10:00:50.172950+0000","last_fullsized":"2024-02-18T10:00:50.172950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:16:25.495152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085186+0000","last_change":"2024-02-18T10:00:48.750924+0000","last_active":"2024-02-18T10:00:51.085186+0000","last_peered":"2024-02-18T10:00:51.085186+0000","last_clean":"2024-02-18T10:00:51.085186+0000","last_became_active":"2024-02-18T10:00:48.750592+0000","last_became_peered":"2024-02-18T10:00:48.750592+0000","last_unstale":"2024-02-18T10:00:51.085186+0000","last_undegraded":"2024-02-18T10:00:51.085186+0000","last_fullsized":"2024-02-18T10:00:51.085186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:27:13.111020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736200+0000","last_change":"2024-02-18T10:00:48.746265+0000","last_active":"2024-02-18T10:00:49.736200+0000","last_peered":"2024-02-18T10:00:49.736200+0000","last_clean":"2024-02-18T10:00:49.736200+0000","last_became_active":"2024-02-18T10:00:48.746015+0000","last_became_peered":"2024-02-18T10:00:48.746015+0000","last_unstale":"2024-02-18T10:00:49.736200+0000","last_undegraded":"2024-02-18T10:00:49.736200+0000","last_fullsized":"2024-02-18T10:00:49.736200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086113+0000","last_change":"2024-02-18T10:00:48.753217+0000","last_active":"2024-02-18T10:00:51.086113+0000","last_peered":"2024-02-18T10:00:51.086113+0000","last_clean":"2024-02-18T10:00:51.086113+0000","last_became_active":"2024-02-18T10:00:48.752488+0000","last_became_peered":"2024-02-18T10:00:48.752488+0000","last_unstale":"2024-02-18T10:00:51.086113+0000","last_undegraded":"2024-02-18T10:00:51.086113+0000","last_fullsized":"2024-02-18T10:00:51.086113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087297+0000","last_change":"2024-02-18T10:00:48.763358+0000","last_active":"2024-02-18T10:00:51.087297+0000","last_peered":"2024-02-18T10:00:51.087297+0000","last_clean":"2024-02-18T10:00:51.087297+0000","last_became_active":"2024-02-18T10:00:48.762822+0000","last_became_peered":"2024-02-18T10:00:48.762822+0000","last_unstale":"2024-02-18T10:00:51.087297+0000","last_undegraded":"2024-02-18T10:00:51.087297+0000","last_fullsized":"2024-02-18T10:00:51.087297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:18.873439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584653+0000","last_change":"2024-02-18T10:00:48.751879+0000","last_active":"2024-02-18T10:00:50.584653+0000","last_peered":"2024-02-18T10:00:50.584653+0000","last_clean":"2024-02-18T10:00:50.584653+0000","last_became_active":"2024-02-18T10:00:48.751596+0000","last_became_peered":"2024-02-18T10:00:48.751596+0000","last_unstale":"2024-02-18T10:00:50.584653+0000","last_undegraded":"2024-02-18T10:00:50.584653+0000","last_fullsized":"2024-02-18T10:00:50.584653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:58:39.082250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086833+0000","last_change":"2024-02-18T10:00:48.756771+0000","last_active":"2024-02-18T10:00:51.086833+0000","last_peered":"2024-02-18T10:00:51.086833+0000","last_clean":"2024-02-18T10:00:51.086833+0000","last_became_active":"2024-02-18T10:00:48.756506+0000","last_became_peered":"2024-02-18T10:00:48.756506+0000","last_unstale":"2024-02-18T10:00:51.086833+0000","last_undegraded":"2024-02-18T10:00:51.086833+0000","last_fullsized":"2024-02-18T10:00:51.086833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:40:48.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737843+0000","last_change":"2024-02-18T10:00:48.763478+0000","last_active":"2024-02-18T10:00:49.737843+0000","last_peered":"2024-02-18T10:00:49.737843+0000","last_clean":"2024-02-18T10:00:49.737843+0000","last_became_active":"2024-02-18T10:00:48.762974+0000","last_became_peered":"2024-02-18T10:00:48.762974+0000","last_unstale":"2024-02-18T10:00:49.737843+0000","last_undegraded":"2024-02-18T10:00:49.737843+0000","last_fullsized":"2024-02-18T10:00:49.737843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085325+0000","last_change":"2024-02-18T10:00:48.755841+0000","last_active":"2024-02-18T10:00:51.085325+0000","last_peered":"2024-02-18T10:00:51.085325+0000","last_clean":"2024-02-18T10:00:51.085325+0000","last_became_active":"2024-02-18T10:00:48.755563+0000","last_became_peered":"2024-02-18T10:00:48.755563+0000","last_unstale":"2024-02-18T10:00:51.085325+0000","last_undegraded":"2024-02-18T10:00:51.085325+0000","last_fullsized":"2024-02-18T10:00:51.085325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:55:44.537624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086926+0000","last_change":"2024-02-18T10:00:48.763939+0000","last_active":"2024-02-18T10:00:51.086926+0000","last_peered":"2024-02-18T10:00:51.086926+0000","last_clean":"2024-02-18T10:00:51.086926+0000","last_became_active":"2024-02-18T10:00:48.763645+0000","last_became_peered":"2024-02-18T10:00:48.763645+0000","last_unstale":"2024-02-18T10:00:51.086926+0000","last_undegraded":"2024-02-18T10:00:51.086926+0000","last_fullsized":"2024-02-18T10:00:51.086926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172661+0000","last_change":"2024-02-18T10:00:48.746911+0000","last_active":"2024-02-18T10:00:50.172661+0000","last_peered":"2024-02-18T10:00:50.172661+0000","last_clean":"2024-02-18T10:00:50.172661+0000","last_became_active":"2024-02-18T10:00:48.746634+0000","last_became_peered":"2024-02-18T10:00:48.746634+0000","last_unstale":"2024-02-18T10:00:50.172661+0000","last_undegraded":"2024-02-18T10:00:50.172661+0000","last_fullsized":"2024-02-18T10:00:50.172661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086406+0000","last_change":"2024-02-18T10:00:48.757610+0000","last_active":"2024-02-18T10:00:51.086406+0000","last_peered":"2024-02-18T10:00:51.086406+0000","last_clean":"2024-02-18T10:00:51.086406+0000","last_became_active":"2024-02-18T10:00:48.757334+0000","last_became_peered":"2024-02-18T10:00:48.757334+0000","last_unstale":"2024-02-18T10:00:51.086406+0000","last_undegraded":"2024-02-18T10:00:51.086406+0000","last_fullsized":"2024-02-18T10:00:51.086406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172992+0000","last_change":"2024-02-18T10:00:48.746788+0000","last_active":"2024-02-18T10:00:50.172992+0000","last_peered":"2024-02-18T10:00:50.172992+0000","last_clean":"2024-02-18T10:00:50.172992+0000","last_became_active":"2024-02-18T10:00:48.746523+0000","last_became_peered":"2024-02-18T10:00:48.746523+0000","last_unstale":"2024-02-18T10:00:50.172992+0000","last_undegraded":"2024-02-18T10:00:50.172992+0000","last_fullsized":"2024-02-18T10:00:50.172992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738283+0000","last_change":"2024-02-18T10:00:48.756429+0000","last_active":"2024-02-18T10:00:49.738283+0000","last_peered":"2024-02-18T10:00:49.738283+0000","last_clean":"2024-02-18T10:00:49.738283+0000","last_became_active":"2024-02-18T10:00:48.756141+0000","last_became_peered":"2024-02-18T10:00:48.756141+0000","last_unstale":"2024-02-18T10:00:49.738283+0000","last_undegraded":"2024-02-18T10:00:49.738283+0000","last_fullsized":"2024-02-18T10:00:49.738283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736343+0000","last_change":"2024-02-18T10:00:48.742514+0000","last_active":"2024-02-18T10:00:49.736343+0000","last_peered":"2024-02-18T10:00:49.736343+0000","last_clean":"2024-02-18T10:00:49.736343+0000","last_became_active":"2024-02-18T10:00:48.742264+0000","last_became_peered":"2024-02-18T10:00:48.742264+0000","last_unstale":"2024-02-18T10:00:49.736343+0000","last_undegraded":"2024-02-18T10:00:49.736343+0000","last_fullsized":"2024-02-18T10:00:49.736343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172990+0000","last_change":"2024-02-18T10:00:48.746831+0000","last_active":"2024-02-18T10:00:50.172990+0000","last_peered":"2024-02-18T10:00:50.172990+0000","last_clean":"2024-02-18T10:00:50.172990+0000","last_became_active":"2024-02-18T10:00:48.746574+0000","last_became_peered":"2024-02-18T10:00:48.746574+0000","last_unstale":"2024-02-18T10:00:50.172990+0000","last_undegraded":"2024-02-18T10:00:50.172990+0000","last_fullsized":"2024-02-18T10:00:50.172990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085359+0000","last_change":"2024-02-18T10:00:48.752619+0000","last_active":"2024-02-18T10:00:51.085359+0000","last_peered":"2024-02-18T10:00:51.085359+0000","last_clean":"2024-02-18T10:00:51.085359+0000","last_became_active":"2024-02-18T10:00:48.752114+0000","last_became_peered":"2024-02-18T10:00:48.752114+0000","last_unstale":"2024-02-18T10:00:51.085359+0000","last_undegraded":"2024-02-18T10:00:51.085359+0000","last_fullsized":"2024-02-18T10:00:51.085359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:45:13.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087086+0000","last_change":"2024-02-18T10:00:48.766940+0000","last_active":"2024-02-18T10:00:51.087086+0000","last_peered":"2024-02-18T10:00:51.087086+0000","last_clean":"2024-02-18T10:00:51.087086+0000","last_became_active":"2024-02-18T10:00:48.766671+0000","last_became_peered":"2024-02-18T10:00:48.766671+0000","last_unstale":"2024-02-18T10:00:51.087086+0000","last_undegraded":"2024-02-18T10:00:51.087086+0000","last_fullsized":"2024-02-18T10:00:51.087086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584567+0000","last_change":"2024-02-18T10:00:48.758455+0000","last_active":"2024-02-18T10:00:50.584567+0000","last_peered":"2024-02-18T10:00:50.584567+0000","last_clean":"2024-02-18T10:00:50.584567+0000","last_became_active":"2024-02-18T10:00:48.758160+0000","last_became_peered":"2024-02-18T10:00:48.758160+0000","last_unstale":"2024-02-18T10:00:50.584567+0000","last_undegraded":"2024-02-18T10:00:50.584567+0000","last_fullsized":"2024-02-18T10:00:50.584567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:27:13.111020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737885+0000","last_change":"2024-02-18T10:00:48.751567+0000","last_active":"2024-02-18T10:00:49.737885+0000","last_peered":"2024-02-18T10:00:49.737885+0000","last_clean":"2024-02-18T10:00:49.737885+0000","last_became_active":"2024-02-18T10:00:48.751213+0000","last_became_peered":"2024-02-18T10:00:48.751213+0000","last_unstale":"2024-02-18T10:00:49.737885+0000","last_undegraded":"2024-02-18T10:00:49.737885+0000","last_fullsized":"2024-02-18T10:00:49.737885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738361+0000","last_change":"2024-02-18T10:00:48.744508+0000","last_active":"2024-02-18T10:00:49.738361+0000","last_peered":"2024-02-18T10:00:49.738361+0000","last_clean":"2024-02-18T10:00:49.738361+0000","last_became_active":"2024-02-18T10:00:48.744189+0000","last_became_peered":"2024-02-18T10:00:48.744189+0000","last_unstale":"2024-02-18T10:00:49.738361+0000","last_undegraded":"2024-02-18T10:00:49.738361+0000","last_fullsized":"2024-02-18T10:00:49.738361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:08.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.173009+0000","last_change":"2024-02-18T10:00:47.748736+0000","last_active":"2024-02-18T10:00:50.173009+0000","last_peered":"2024-02-18T10:00:50.173009+0000","last_clean":"2024-02-18T10:00:50.173009+0000","last_became_active":"2024-02-18T10:00:47.748495+0000","last_became_peered":"2024-02-18T10:00:47.748495+0000","last_unstale":"2024-02-18T10:00:50.173009+0000","last_undegraded":"2024-02-18T10:00:50.173009+0000","last_fullsized":"2024-02-18T10:00:50.173009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:08:15.620449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085495+0000","last_change":"2024-02-18T10:00:48.751693+0000","last_active":"2024-02-18T10:00:51.085495+0000","last_peered":"2024-02-18T10:00:51.085495+0000","last_clean":"2024-02-18T10:00:51.085495+0000","last_became_active":"2024-02-18T10:00:48.750387+0000","last_became_peered":"2024-02-18T10:00:48.750387+0000","last_unstale":"2024-02-18T10:00:51.085495+0000","last_undegraded":"2024-02-18T10:00:51.085495+0000","last_fullsized":"2024-02-18T10:00:51.085495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737442+0000","last_change":"2024-02-18T10:00:47.747048+0000","last_active":"2024-02-18T10:00:49.737442+0000","last_peered":"2024-02-18T10:00:49.737442+0000","last_clean":"2024-02-18T10:00:49.737442+0000","last_became_active":"2024-02-18T10:00:47.745420+0000","last_became_peered":"2024-02-18T10:00:47.745420+0000","last_unstale":"2024-02-18T10:00:49.737442+0000","last_undegraded":"2024-02-18T10:00:49.737442+0000","last_fullsized":"2024-02-18T10:00:49.737442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172667+0000","last_change":"2024-02-18T10:00:47.747163+0000","last_active":"2024-02-18T10:00:50.172667+0000","last_peered":"2024-02-18T10:00:50.172667+0000","last_clean":"2024-02-18T10:00:50.172667+0000","last_became_active":"2024-02-18T10:00:47.746804+0000","last_became_peered":"2024-02-18T10:00:47.746804+0000","last_unstale":"2024-02-18T10:00:50.172667+0000","last_undegraded":"2024-02-18T10:00:50.172667+0000","last_fullsized":"2024-02-18T10:00:50.172667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172651+0000","last_change":"2024-02-18T10:00:48.748557+0000","last_active":"2024-02-18T10:00:50.172651+0000","last_peered":"2024-02-18T10:00:50.172651+0000","last_clean":"2024-02-18T10:00:50.172651+0000","last_became_active":"2024-02-18T10:00:48.748261+0000","last_became_peered":"2024-02-18T10:00:48.748261+0000","last_unstale":"2024-02-18T10:00:50.172651+0000","last_undegraded":"2024-02-18T10:00:50.172651+0000","last_fullsized":"2024-02-18T10:00:50.172651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086460+0000","last_change":"2024-02-18T10:00:47.753258+0000","last_active":"2024-02-18T10:00:51.086460+0000","last_peered":"2024-02-18T10:00:51.086460+0000","last_clean":"2024-02-18T10:00:51.086460+0000","last_became_active":"2024-02-18T10:00:47.752682+0000","last_became_peered":"2024-02-18T10:00:47.752682+0000","last_unstale":"2024-02-18T10:00:51.086460+0000","last_undegraded":"2024-02-18T10:00:51.086460+0000","last_fullsized":"2024-02-18T10:00:51.086460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736477+0000","last_change":"2024-02-18T10:00:48.741101+0000","last_active":"2024-02-18T10:00:49.736477+0000","last_peered":"2024-02-18T10:00:49.736477+0000","last_clean":"2024-02-18T10:00:49.736477+0000","last_became_active":"2024-02-18T10:00:48.740821+0000","last_became_peered":"2024-02-18T10:00:48.740821+0000","last_unstale":"2024-02-18T10:00:49.736477+0000","last_undegraded":"2024-02-18T10:00:49.736477+0000","last_fullsized":"2024-02-18T10:00:49.736477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737973+0000","last_change":"2024-02-18T10:00:47.750376+0000","last_active":"2024-02-18T10:00:49.737973+0000","last_peered":"2024-02-18T10:00:49.737973+0000","last_clean":"2024-02-18T10:00:49.737973+0000","last_became_active":"2024-02-18T10:00:47.749941+0000","last_became_peered":"2024-02-18T10:00:47.749941+0000","last_unstale":"2024-02-18T10:00:49.737973+0000","last_undegraded":"2024-02-18T10:00:49.737973+0000","last_fullsized":"2024-02-18T10:00:49.737973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087243+0000","last_change":"2024-02-18T10:00:48.765815+0000","last_active":"2024-02-18T10:00:51.087243+0000","last_peered":"2024-02-18T10:00:51.087243+0000","last_clean":"2024-02-18T10:00:51.087243+0000","last_became_active":"2024-02-18T10:00:48.765552+0000","last_became_peered":"2024-02-18T10:00:48.765552+0000","last_unstale":"2024-02-18T10:00:51.087243+0000","last_undegraded":"2024-02-18T10:00:51.087243+0000","last_fullsized":"2024-02-18T10:00:51.087243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:27.370397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087167+0000","last_change":"2024-02-18T10:00:47.750861+0000","last_active":"2024-02-18T10:00:51.087167+0000","last_peered":"2024-02-18T10:00:51.087167+0000","last_clean":"2024-02-18T10:00:51.087167+0000","last_became_active":"2024-02-18T10:00:47.749726+0000","last_became_peered":"2024-02-18T10:00:47.749726+0000","last_unstale":"2024-02-18T10:00:51.087167+0000","last_undegraded":"2024-02-18T10:00:51.087167+0000","last_fullsized":"2024-02-18T10:00:51.087167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085615+0000","last_change":"2024-02-18T10:00:48.754488+0000","last_active":"2024-02-18T10:00:51.085615+0000","last_peered":"2024-02-18T10:00:51.085615+0000","last_clean":"2024-02-18T10:00:51.085615+0000","last_became_active":"2024-02-18T10:00:48.753912+0000","last_became_peered":"2024-02-18T10:00:48.753912+0000","last_unstale":"2024-02-18T10:00:51.085615+0000","last_undegraded":"2024-02-18T10:00:51.085615+0000","last_fullsized":"2024-02-18T10:00:51.085615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736254+0000","last_change":"2024-02-18T10:00:47.757202+0000","last_active":"2024-02-18T10:00:49.736254+0000","last_peered":"2024-02-18T10:00:49.736254+0000","last_clean":"2024-02-18T10:00:49.736254+0000","last_became_active":"2024-02-18T10:00:47.756943+0000","last_became_peered":"2024-02-18T10:00:47.756943+0000","last_unstale":"2024-02-18T10:00:49.736254+0000","last_undegraded":"2024-02-18T10:00:49.736254+0000","last_fullsized":"2024-02-18T10:00:49.736254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738548+0000","last_change":"2024-02-18T10:00:48.756580+0000","last_active":"2024-02-18T10:00:49.738548+0000","last_peered":"2024-02-18T10:00:49.738548+0000","last_clean":"2024-02-18T10:00:49.738548+0000","last_became_active":"2024-02-18T10:00:48.755023+0000","last_became_peered":"2024-02-18T10:00:48.755023+0000","last_unstale":"2024-02-18T10:00:49.738548+0000","last_undegraded":"2024-02-18T10:00:49.738548+0000","last_fullsized":"2024-02-18T10:00:49.738548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:15.426726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737938+0000","last_change":"2024-02-18T10:00:47.745417+0000","last_active":"2024-02-18T10:00:49.737938+0000","last_peered":"2024-02-18T10:00:49.737938+0000","last_clean":"2024-02-18T10:00:49.737938+0000","last_became_active":"2024-02-18T10:00:47.745037+0000","last_became_peered":"2024-02-18T10:00:47.745037+0000","last_unstale":"2024-02-18T10:00:49.737938+0000","last_undegraded":"2024-02-18T10:00:49.737938+0000","last_fullsized":"2024-02-18T10:00:49.737938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086528+0000","last_change":"2024-02-18T10:00:48.757256+0000","last_active":"2024-02-18T10:00:51.086528+0000","last_peered":"2024-02-18T10:00:51.086528+0000","last_clean":"2024-02-18T10:00:51.086528+0000","last_became_active":"2024-02-18T10:00:48.756024+0000","last_became_peered":"2024-02-18T10:00:48.756024+0000","last_unstale":"2024-02-18T10:00:51.086528+0000","last_undegraded":"2024-02-18T10:00:51.086528+0000","last_fullsized":"2024-02-18T10:00:51.086528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:04:20.542014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085539+0000","last_change":"2024-02-18T10:00:47.743984+0000","last_active":"2024-02-18T10:00:51.085539+0000","last_peered":"2024-02-18T10:00:51.085539+0000","last_clean":"2024-02-18T10:00:51.085539+0000","last_became_active":"2024-02-18T10:00:47.743265+0000","last_became_peered":"2024-02-18T10:00:47.743265+0000","last_unstale":"2024-02-18T10:00:51.085539+0000","last_undegraded":"2024-02-18T10:00:51.085539+0000","last_fullsized":"2024-02-18T10:00:51.085539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:08:15.620449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085266+0000","last_change":"2024-02-18T10:00:48.753376+0000","last_active":"2024-02-18T10:00:51.085266+0000","last_peered":"2024-02-18T10:00:51.085266+0000","last_clean":"2024-02-18T10:00:51.085266+0000","last_became_active":"2024-02-18T10:00:48.752989+0000","last_became_peered":"2024-02-18T10:00:48.752989+0000","last_unstale":"2024-02-18T10:00:51.085266+0000","last_undegraded":"2024-02-18T10:00:51.085266+0000","last_fullsized":"2024-02-18T10:00:51.085266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:21:14.163404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086987+0000","last_change":"2024-02-18T10:00:47.754739+0000","last_active":"2024-02-18T10:00:51.086987+0000","last_peered":"2024-02-18T10:00:51.086987+0000","last_clean":"2024-02-18T10:00:51.086987+0000","last_became_active":"2024-02-18T10:00:47.754464+0000","last_became_peered":"2024-02-18T10:00:47.754464+0000","last_unstale":"2024-02-18T10:00:51.086987+0000","last_undegraded":"2024-02-18T10:00:51.086987+0000","last_fullsized":"2024-02-18T10:00:51.086987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086959+0000","last_change":"2024-02-18T10:00:48.765437+0000","last_active":"2024-02-18T10:00:51.086959+0000","last_peered":"2024-02-18T10:00:51.086959+0000","last_clean":"2024-02-18T10:00:51.086959+0000","last_became_active":"2024-02-18T10:00:48.765097+0000","last_became_peered":"2024-02-18T10:00:48.765097+0000","last_unstale":"2024-02-18T10:00:51.086959+0000","last_undegraded":"2024-02-18T10:00:51.086959+0000","last_fullsized":"2024-02-18T10:00:51.086959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:08:37.437332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737570+0000","last_change":"2024-02-18T10:00:47.746081+0000","last_active":"2024-02-18T10:00:49.737570+0000","last_peered":"2024-02-18T10:00:49.737570+0000","last_clean":"2024-02-18T10:00:49.737570+0000","last_became_active":"2024-02-18T10:00:47.745764+0000","last_became_peered":"2024-02-18T10:00:47.745764+0000","last_unstale":"2024-02-18T10:00:49.737570+0000","last_undegraded":"2024-02-18T10:00:49.737570+0000","last_fullsized":"2024-02-18T10:00:49.737570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737642+0000","last_change":"2024-02-18T10:00:48.751734+0000","last_active":"2024-02-18T10:00:49.737642+0000","last_peered":"2024-02-18T10:00:49.737642+0000","last_clean":"2024-02-18T10:00:49.737642+0000","last_became_active":"2024-02-18T10:00:48.751254+0000","last_became_peered":"2024-02-18T10:00:48.751254+0000","last_unstale":"2024-02-18T10:00:49.737642+0000","last_undegraded":"2024-02-18T10:00:49.737642+0000","last_fullsized":"2024-02-18T10:00:49.737642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584421+0000","last_change":"2024-02-18T10:00:47.743876+0000","last_active":"2024-02-18T10:00:50.584421+0000","last_peered":"2024-02-18T10:00:50.584421+0000","last_clean":"2024-02-18T10:00:50.584421+0000","last_became_active":"2024-02-18T10:00:47.743205+0000","last_became_peered":"2024-02-18T10:00:47.743205+0000","last_unstale":"2024-02-18T10:00:50.584421+0000","last_undegraded":"2024-02-18T10:00:50.584421+0000","last_fullsized":"2024-02-18T10:00:50.584421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086006+0000","last_change":"2024-02-18T10:00:48.765053+0000","last_active":"2024-02-18T10:00:51.086006+0000","last_peered":"2024-02-18T10:00:51.086006+0000","last_clean":"2024-02-18T10:00:51.086006+0000","last_became_active":"2024-02-18T10:00:48.764751+0000","last_became_peered":"2024-02-18T10:00:48.764751+0000","last_unstale":"2024-02-18T10:00:51.086006+0000","last_undegraded":"2024-02-18T10:00:51.086006+0000","last_fullsized":"2024-02-18T10:00:51.086006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738191+0000","last_change":"2024-02-18T10:00:47.749664+0000","last_active":"2024-02-18T10:00:49.738191+0000","last_peered":"2024-02-18T10:00:49.738191+0000","last_clean":"2024-02-18T10:00:49.738191+0000","last_became_active":"2024-02-18T10:00:47.749355+0000","last_became_peered":"2024-02-18T10:00:47.749355+0000","last_unstale":"2024-02-18T10:00:49.738191+0000","last_undegraded":"2024-02-18T10:00:49.738191+0000","last_fullsized":"2024-02-18T10:00:49.738191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:12:10.356826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086559+0000","last_change":"2024-02-18T10:00:48.764166+0000","last_active":"2024-02-18T10:00:51.086559+0000","last_peered":"2024-02-18T10:00:51.086559+0000","last_clean":"2024-02-18T10:00:51.086559+0000","last_became_active":"2024-02-18T10:00:48.763233+0000","last_became_peered":"2024-02-18T10:00:48.763233+0000","last_unstale":"2024-02-18T10:00:51.086559+0000","last_undegraded":"2024-02-18T10:00:51.086559+0000","last_fullsized":"2024-02-18T10:00:51.086559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:15.703316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584556+0000","last_change":"2024-02-18T10:00:47.746336+0000","last_active":"2024-02-18T10:00:50.584556+0000","last_peered":"2024-02-18T10:00:50.584556+0000","last_clean":"2024-02-18T10:00:50.584556+0000","last_became_active":"2024-02-18T10:00:47.746080+0000","last_became_peered":"2024-02-18T10:00:47.746080+0000","last_unstale":"2024-02-18T10:00:50.584556+0000","last_undegraded":"2024-02-18T10:00:50.584556+0000","last_fullsized":"2024-02-18T10:00:50.584556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086647+0000","last_change":"2024-02-18T10:00:48.764919+0000","last_active":"2024-02-18T10:00:51.086647+0000","last_peered":"2024-02-18T10:00:51.086647+0000","last_clean":"2024-02-18T10:00:51.086647+0000","last_became_active":"2024-02-18T10:00:48.764631+0000","last_became_peered":"2024-02-18T10:00:48.764631+0000","last_unstale":"2024-02-18T10:00:51.086647+0000","last_undegraded":"2024-02-18T10:00:51.086647+0000","last_fullsized":"2024-02-18T10:00:51.086647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:18.873439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736349+0000","last_change":"2024-02-18T10:00:47.744202+0000","last_active":"2024-02-18T10:00:49.736349+0000","last_peered":"2024-02-18T10:00:49.736349+0000","last_clean":"2024-02-18T10:00:49.736349+0000","last_became_active":"2024-02-18T10:00:47.743927+0000","last_became_peered":"2024-02-18T10:00:47.743927+0000","last_unstale":"2024-02-18T10:00:49.736349+0000","last_undegraded":"2024-02-18T10:00:49.736349+0000","last_fullsized":"2024-02-18T10:00:49.736349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086559+0000","last_change":"2024-02-18T10:00:48.762138+0000","last_active":"2024-02-18T10:00:51.086559+0000","last_peered":"2024-02-18T10:00:51.086559+0000","last_clean":"2024-02-18T10:00:51.086559+0000","last_became_active":"2024-02-18T10:00:48.761841+0000","last_became_peered":"2024-02-18T10:00:48.761841+0000","last_unstale":"2024-02-18T10:00:51.086559+0000","last_undegraded":"2024-02-18T10:00:51.086559+0000","last_fullsized":"2024-02-18T10:00:51.086559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:16:25.495152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584531+0000","last_change":"2024-02-18T10:00:47.750440+0000","last_active":"2024-02-18T10:00:50.584531+0000","last_peered":"2024-02-18T10:00:50.584531+0000","last_clean":"2024-02-18T10:00:50.584531+0000","last_became_active":"2024-02-18T10:00:47.750171+0000","last_became_peered":"2024-02-18T10:00:47.750171+0000","last_unstale":"2024-02-18T10:00:50.584531+0000","last_undegraded":"2024-02-18T10:00:50.584531+0000","last_fullsized":"2024-02-18T10:00:50.584531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086597+0000","last_change":"2024-02-18T10:00:48.766662+0000","last_active":"2024-02-18T10:00:51.086597+0000","last_peered":"2024-02-18T10:00:51.086597+0000","last_clean":"2024-02-18T10:00:51.086597+0000","last_became_active":"2024-02-18T10:00:48.766405+0000","last_became_peered":"2024-02-18T10:00:48.766405+0000","last_unstale":"2024-02-18T10:00:51.086597+0000","last_undegraded":"2024-02-18T10:00:51.086597+0000","last_fullsized":"2024-02-18T10:00:51.086597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:27.370397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085926+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:00:51.085926+0000","last_peered":"2024-02-18T10:00:51.085926+0000","last_clean":"2024-02-18T10:00:51.085926+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:00:51.085926+0000","last_undegraded":"2024-02-18T10:00:51.085926+0000","last_fullsized":"2024-02-18T10:00:51.085926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086179+0000","last_change":"2024-02-18T10:00:47.747706+0000","last_active":"2024-02-18T10:00:51.086179+0000","last_peered":"2024-02-18T10:00:51.086179+0000","last_clean":"2024-02-18T10:00:51.086179+0000","last_became_active":"2024-02-18T10:00:47.747410+0000","last_became_peered":"2024-02-18T10:00:47.747410+0000","last_unstale":"2024-02-18T10:00:51.086179+0000","last_undegraded":"2024-02-18T10:00:51.086179+0000","last_fullsized":"2024-02-18T10:00:51.086179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172827+0000","last_change":"2024-02-18T10:00:48.769224+0000","last_active":"2024-02-18T10:00:50.172827+0000","last_peered":"2024-02-18T10:00:50.172827+0000","last_clean":"2024-02-18T10:00:50.172827+0000","last_became_active":"2024-02-18T10:00:48.768881+0000","last_became_peered":"2024-02-18T10:00:48.768881+0000","last_unstale":"2024-02-18T10:00:50.172827+0000","last_undegraded":"2024-02-18T10:00:50.172827+0000","last_fullsized":"2024-02-18T10:00:50.172827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085786+0000","last_change":"2024-02-18T10:00:47.753097+0000","last_active":"2024-02-18T10:00:51.085786+0000","last_peered":"2024-02-18T10:00:51.085786+0000","last_clean":"2024-02-18T10:00:51.085786+0000","last_became_active":"2024-02-18T10:00:47.751883+0000","last_became_peered":"2024-02-18T10:00:47.751883+0000","last_unstale":"2024-02-18T10:00:51.085786+0000","last_undegraded":"2024-02-18T10:00:51.085786+0000","last_fullsized":"2024-02-18T10:00:51.085786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:32:25.941422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085198+0000","last_change":"2024-02-18T10:00:48.749065+0000","last_active":"2024-02-18T10:00:51.085198+0000","last_peered":"2024-02-18T10:00:51.085198+0000","last_clean":"2024-02-18T10:00:51.085198+0000","last_became_active":"2024-02-18T10:00:48.748721+0000","last_became_peered":"2024-02-18T10:00:48.748721+0000","last_unstale":"2024-02-18T10:00:51.085198+0000","last_undegraded":"2024-02-18T10:00:51.085198+0000","last_fullsized":"2024-02-18T10:00:51.085198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:58:39.082250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584505+0000","last_change":"2024-02-18T10:00:47.746892+0000","last_active":"2024-02-18T10:00:50.584505+0000","last_peered":"2024-02-18T10:00:50.584505+0000","last_clean":"2024-02-18T10:00:50.584505+0000","last_became_active":"2024-02-18T10:00:47.746655+0000","last_became_peered":"2024-02-18T10:00:47.746655+0000","last_unstale":"2024-02-18T10:00:50.584505+0000","last_undegraded":"2024-02-18T10:00:50.584505+0000","last_fullsized":"2024-02-18T10:00:50.584505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736201+0000","last_change":"2024-02-18T10:00:48.741827+0000","last_active":"2024-02-18T10:00:49.736201+0000","last_peered":"2024-02-18T10:00:49.736201+0000","last_clean":"2024-02-18T10:00:49.736201+0000","last_became_active":"2024-02-18T10:00:48.741575+0000","last_became_peered":"2024-02-18T10:00:48.741575+0000","last_unstale":"2024-02-18T10:00:49.736201+0000","last_undegraded":"2024-02-18T10:00:49.736201+0000","last_fullsized":"2024-02-18T10:00:49.736201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087119+0000","last_change":"2024-02-18T10:00:47.751869+0000","last_active":"2024-02-18T10:00:51.087119+0000","last_peered":"2024-02-18T10:00:51.087119+0000","last_clean":"2024-02-18T10:00:51.087119+0000","last_became_active":"2024-02-18T10:00:47.751627+0000","last_became_peered":"2024-02-18T10:00:47.751627+0000","last_unstale":"2024-02-18T10:00:51.087119+0000","last_undegraded":"2024-02-18T10:00:51.087119+0000","last_fullsized":"2024-02-18T10:00:51.087119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738483+0000","last_change":"2024-02-18T10:00:48.749047+0000","last_active":"2024-02-18T10:00:49.738483+0000","last_peered":"2024-02-18T10:00:49.738483+0000","last_clean":"2024-02-18T10:00:49.738483+0000","last_became_active":"2024-02-18T10:00:48.748750+0000","last_became_peered":"2024-02-18T10:00:48.748750+0000","last_unstale":"2024-02-18T10:00:49.738483+0000","last_undegraded":"2024-02-18T10:00:49.738483+0000","last_fullsized":"2024-02-18T10:00:49.738483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:35.064701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736176+0000","last_change":"2024-02-18T10:00:47.747157+0000","last_active":"2024-02-18T10:00:49.736176+0000","last_peered":"2024-02-18T10:00:49.736176+0000","last_clean":"2024-02-18T10:00:49.736176+0000","last_became_active":"2024-02-18T10:00:47.746267+0000","last_became_peered":"2024-02-18T10:00:47.746267+0000","last_unstale":"2024-02-18T10:00:49.736176+0000","last_undegraded":"2024-02-18T10:00:49.736176+0000","last_fullsized":"2024-02-18T10:00:49.736176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087197+0000","last_change":"2024-02-18T10:00:48.754892+0000","last_active":"2024-02-18T10:00:51.087197+0000","last_peered":"2024-02-18T10:00:51.087197+0000","last_clean":"2024-02-18T10:00:51.087197+0000","last_became_active":"2024-02-18T10:00:48.754634+0000","last_became_peered":"2024-02-18T10:00:48.754634+0000","last_unstale":"2024-02-18T10:00:51.087197+0000","last_undegraded":"2024-02-18T10:00:51.087197+0000","last_fullsized":"2024-02-18T10:00:51.087197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:15.703316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086711+0000","last_change":"2024-02-18T10:00:47.752978+0000","last_active":"2024-02-18T10:00:51.086711+0000","last_peered":"2024-02-18T10:00:51.086711+0000","last_clean":"2024-02-18T10:00:51.086711+0000","last_became_active":"2024-02-18T10:00:47.752637+0000","last_became_peered":"2024-02-18T10:00:47.752637+0000","last_unstale":"2024-02-18T10:00:51.086711+0000","last_undegraded":"2024-02-18T10:00:51.086711+0000","last_fullsized":"2024-02-18T10:00:51.086711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.062387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736363+0000","last_change":"2024-02-18T10:00:48.741218+0000","last_active":"2024-02-18T10:00:49.736363+0000","last_peered":"2024-02-18T10:00:49.736363+0000","last_clean":"2024-02-18T10:00:49.736363+0000","last_became_active":"2024-02-18T10:00:48.740947+0000","last_became_peered":"2024-02-18T10:00:48.740947+0000","last_unstale":"2024-02-18T10:00:49.736363+0000","last_undegraded":"2024-02-18T10:00:49.736363+0000","last_fullsized":"2024-02-18T10:00:49.736363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736441+0000","last_change":"2024-02-18T10:00:47.745748+0000","last_active":"2024-02-18T10:00:49.736441+0000","last_peered":"2024-02-18T10:00:49.736441+0000","last_clean":"2024-02-18T10:00:49.736441+0000","last_became_active":"2024-02-18T10:00:47.745483+0000","last_became_peered":"2024-02-18T10:00:47.745483+0000","last_unstale":"2024-02-18T10:00:49.736441+0000","last_undegraded":"2024-02-18T10:00:49.736441+0000","last_fullsized":"2024-02-18T10:00:49.736441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.062387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172965+0000","last_change":"2024-02-18T10:00:48.754790+0000","last_active":"2024-02-18T10:00:50.172965+0000","last_peered":"2024-02-18T10:00:50.172965+0000","last_clean":"2024-02-18T10:00:50.172965+0000","last_became_active":"2024-02-18T10:00:48.754516+0000","last_became_peered":"2024-02-18T10:00:48.754516+0000","last_unstale":"2024-02-18T10:00:50.172965+0000","last_undegraded":"2024-02-18T10:00:50.172965+0000","last_fullsized":"2024-02-18T10:00:50.172965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738088+0000","last_change":"2024-02-18T10:00:47.743582+0000","last_active":"2024-02-18T10:00:49.738088+0000","last_peered":"2024-02-18T10:00:49.738088+0000","last_clean":"2024-02-18T10:00:49.738088+0000","last_became_active":"2024-02-18T10:00:47.743314+0000","last_became_peered":"2024-02-18T10:00:47.743314+0000","last_unstale":"2024-02-18T10:00:49.738088+0000","last_undegraded":"2024-02-18T10:00:49.738088+0000","last_fullsized":"2024-02-18T10:00:49.738088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085499+0000","last_change":"2024-02-18T10:00:48.748201+0000","last_active":"2024-02-18T10:00:51.085499+0000","last_peered":"2024-02-18T10:00:51.085499+0000","last_clean":"2024-02-18T10:00:51.085499+0000","last_became_active":"2024-02-18T10:00:48.747809+0000","last_became_peered":"2024-02-18T10:00:48.747809+0000","last_unstale":"2024-02-18T10:00:51.085499+0000","last_undegraded":"2024-02-18T10:00:51.085499+0000","last_fullsized":"2024-02-18T10:00:51.085499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085772+0000","last_change":"2024-02-18T10:00:47.752933+0000","last_active":"2024-02-18T10:00:51.085772+0000","last_peered":"2024-02-18T10:00:51.085772+0000","last_clean":"2024-02-18T10:00:51.085772+0000","last_became_active":"2024-02-18T10:00:47.752594+0000","last_became_peered":"2024-02-18T10:00:47.752594+0000","last_unstale":"2024-02-18T10:00:51.085772+0000","last_undegraded":"2024-02-18T10:00:51.085772+0000","last_fullsized":"2024-02-18T10:00:51.085772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:57:31.966004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737717+0000","last_change":"2024-02-18T10:00:48.744423+0000","last_active":"2024-02-18T10:00:49.737717+0000","last_peered":"2024-02-18T10:00:49.737717+0000","last_clean":"2024-02-18T10:00:49.737717+0000","last_became_active":"2024-02-18T10:00:48.744108+0000","last_became_peered":"2024-02-18T10:00:48.744108+0000","last_unstale":"2024-02-18T10:00:49.737717+0000","last_undegraded":"2024-02-18T10:00:49.737717+0000","last_fullsized":"2024-02-18T10:00:49.737717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:07.789780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736266+0000","last_change":"2024-02-18T10:00:47.748994+0000","last_active":"2024-02-18T10:00:49.736266+0000","last_peered":"2024-02-18T10:00:49.736266+0000","last_clean":"2024-02-18T10:00:49.736266+0000","last_became_active":"2024-02-18T10:00:47.748750+0000","last_became_peered":"2024-02-18T10:00:47.748750+0000","last_unstale":"2024-02-18T10:00:49.736266+0000","last_undegraded":"2024-02-18T10:00:49.736266+0000","last_fullsized":"2024-02-18T10:00:49.736266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:14.424412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172744+0000","last_change":"2024-02-18T10:00:48.742322+0000","last_active":"2024-02-18T10:00:50.172744+0000","last_peered":"2024-02-18T10:00:50.172744+0000","last_clean":"2024-02-18T10:00:50.172744+0000","last_became_active":"2024-02-18T10:00:48.742051+0000","last_became_peered":"2024-02-18T10:00:48.742051+0000","last_unstale":"2024-02-18T10:00:50.172744+0000","last_undegraded":"2024-02-18T10:00:50.172744+0000","last_fullsized":"2024-02-18T10:00:50.172744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736239+0000","last_change":"2024-02-18T10:00:47.744495+0000","last_active":"2024-02-18T10:00:49.736239+0000","last_peered":"2024-02-18T10:00:49.736239+0000","last_clean":"2024-02-18T10:00:49.736239+0000","last_became_active":"2024-02-18T10:00:47.744212+0000","last_became_peered":"2024-02-18T10:00:47.744212+0000","last_unstale":"2024-02-18T10:00:49.736239+0000","last_undegraded":"2024-02-18T10:00:49.736239+0000","last_fullsized":"2024-02-18T10:00:49.736239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172955+0000","last_change":"2024-02-18T10:00:48.748982+0000","last_active":"2024-02-18T10:00:50.172955+0000","last_peered":"2024-02-18T10:00:50.172955+0000","last_clean":"2024-02-18T10:00:50.172955+0000","last_became_active":"2024-02-18T10:00:48.748709+0000","last_became_peered":"2024-02-18T10:00:48.748709+0000","last_unstale":"2024-02-18T10:00:50.172955+0000","last_undegraded":"2024-02-18T10:00:50.172955+0000","last_fullsized":"2024-02-18T10:00:50.172955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086642+0000","last_change":"2024-02-18T10:00:47.751004+0000","last_active":"2024-02-18T10:00:51.086642+0000","last_peered":"2024-02-18T10:00:51.086642+0000","last_clean":"2024-02-18T10:00:51.086642+0000","last_became_active":"2024-02-18T10:00:47.750711+0000","last_became_peered":"2024-02-18T10:00:47.750711+0000","last_unstale":"2024-02-18T10:00:51.086642+0000","last_undegraded":"2024-02-18T10:00:51.086642+0000","last_fullsized":"2024-02-18T10:00:51.086642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:14.424412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737387+0000","last_change":"2024-02-18T10:00:48.763662+0000","last_active":"2024-02-18T10:00:49.737387+0000","last_peered":"2024-02-18T10:00:49.737387+0000","last_clean":"2024-02-18T10:00:49.737387+0000","last_became_active":"2024-02-18T10:00:48.763395+0000","last_became_peered":"2024-02-18T10:00:48.763395+0000","last_unstale":"2024-02-18T10:00:49.737387+0000","last_undegraded":"2024-02-18T10:00:49.737387+0000","last_fullsized":"2024-02-18T10:00:49.737387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:55:44.537624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087087+0000","last_change":"2024-02-18T10:00:48.752146+0000","last_active":"2024-02-18T10:00:51.087087+0000","last_peered":"2024-02-18T10:00:51.087087+0000","last_clean":"2024-02-18T10:00:51.087087+0000","last_became_active":"2024-02-18T10:00:48.751865+0000","last_became_peered":"2024-02-18T10:00:48.751865+0000","last_unstale":"2024-02-18T10:00:51.087087+0000","last_undegraded":"2024-02-18T10:00:51.087087+0000","last_fullsized":"2024-02-18T10:00:51.087087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:04:20.542014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086278+0000","last_change":"2024-02-18T10:00:47.757335+0000","last_active":"2024-02-18T10:00:51.086278+0000","last_peered":"2024-02-18T10:00:51.086278+0000","last_clean":"2024-02-18T10:00:51.086278+0000","last_became_active":"2024-02-18T10:00:47.756953+0000","last_became_peered":"2024-02-18T10:00:47.756953+0000","last_unstale":"2024-02-18T10:00:51.086278+0000","last_undegraded":"2024-02-18T10:00:51.086278+0000","last_fullsized":"2024-02-18T10:00:51.086278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086394+0000","last_change":"2024-02-18T10:00:48.754209+0000","last_active":"2024-02-18T10:00:51.086394+0000","last_peered":"2024-02-18T10:00:51.086394+0000","last_clean":"2024-02-18T10:00:51.086394+0000","last_became_active":"2024-02-18T10:00:48.753933+0000","last_became_peered":"2024-02-18T10:00:48.753933+0000","last_unstale":"2024-02-18T10:00:51.086394+0000","last_undegraded":"2024-02-18T10:00:51.086394+0000","last_fullsized":"2024-02-18T10:00:51.086394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086599+0000","last_change":"2024-02-18T10:00:47.753398+0000","last_active":"2024-02-18T10:00:51.086599+0000","last_peered":"2024-02-18T10:00:51.086599+0000","last_clean":"2024-02-18T10:00:51.086599+0000","last_became_active":"2024-02-18T10:00:47.753137+0000","last_became_peered":"2024-02-18T10:00:47.753137+0000","last_unstale":"2024-02-18T10:00:51.086599+0000","last_undegraded":"2024-02-18T10:00:51.086599+0000","last_fullsized":"2024-02-18T10:00:51.086599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085481+0000","last_change":"2024-02-18T10:00:48.754681+0000","last_active":"2024-02-18T10:00:51.085481+0000","last_peered":"2024-02-18T10:00:51.085481+0000","last_clean":"2024-02-18T10:00:51.085481+0000","last_became_active":"2024-02-18T10:00:48.754241+0000","last_became_peered":"2024-02-18T10:00:48.754241+0000","last_unstale":"2024-02-18T10:00:51.085481+0000","last_undegraded":"2024-02-18T10:00:51.085481+0000","last_fullsized":"2024-02-18T10:00:51.085481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172832+0000","last_change":"2024-02-18T10:00:47.748073+0000","last_active":"2024-02-18T10:00:50.172832+0000","last_peered":"2024-02-18T10:00:50.172832+0000","last_clean":"2024-02-18T10:00:50.172832+0000","last_became_active":"2024-02-18T10:00:47.747834+0000","last_became_peered":"2024-02-18T10:00:47.747834+0000","last_unstale":"2024-02-18T10:00:50.172832+0000","last_undegraded":"2024-02-18T10:00:50.172832+0000","last_fullsized":"2024-02-18T10:00:50.172832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:03:07.548576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172932+0000","last_change":"2024-02-18T10:00:48.749891+0000","last_active":"2024-02-18T10:00:50.172932+0000","last_peered":"2024-02-18T10:00:50.172932+0000","last_clean":"2024-02-18T10:00:50.172932+0000","last_became_active":"2024-02-18T10:00:48.749644+0000","last_became_peered":"2024-02-18T10:00:48.749644+0000","last_unstale":"2024-02-18T10:00:50.172932+0000","last_undegraded":"2024-02-18T10:00:50.172932+0000","last_fullsized":"2024-02-18T10:00:50.172932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085516+0000","last_change":"2024-02-18T10:00:47.745160+0000","last_active":"2024-02-18T10:00:51.085516+0000","last_peered":"2024-02-18T10:00:51.085516+0000","last_clean":"2024-02-18T10:00:51.085516+0000","last_became_active":"2024-02-18T10:00:47.744705+0000","last_became_peered":"2024-02-18T10:00:47.744705+0000","last_unstale":"2024-02-18T10:00:51.085516+0000","last_undegraded":"2024-02-18T10:00:51.085516+0000","last_fullsized":"2024-02-18T10:00:51.085516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:24:45.056853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:00:56.401 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-18T10:00:56.402 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-18T10:00:56.402 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-18T10:00:56.402 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-18T10:00:56.402 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-18T10:00:56.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.535+0000 7f4bf9f99640 1 Processor -- start 2024-02-18T10:00:56.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.535+0000 7f4bf9f99640 1 -- start start 2024-02-18T10:00:56.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.535+0000 7f4bf9f99640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4bf414fde0 0x7f4bf4157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.535+0000 7f4bf9f99640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf414f240 con 0x7f4bf406eb40 2024-02-18T10:00:56.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.535+0000 7f4bf9f99640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf406f260 con 0x7f4bf4145f80 2024-02-18T10:00:56.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.535+0000 7f4bf9f99640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf406f540 con 0x7f4bf414fde0 2024-02-18T10:00:56.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.536+0000 7f4bf3fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4bf414fde0 0x7f4bf4157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.536+0000 7f4bf2ffd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4bf406eb40 0x7f4bf414f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46984/0 (socket says 172.21.15.118:46984) 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.536+0000 7f4bf2ffd640 1 -- 172.21.15.118:0/2575159672 learned_addr learned my addr 172.21.15.118:0/2575159672 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.536+0000 7f4bf3fff640 1 -- 172.21.15.118:0/2575159672 >> v1:172.21.15.164:6789/0 conn(0x7f4bf4145f80 legacy=0x7f4bf40bab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.536+0000 7f4bf3fff640 1 -- 172.21.15.118:0/2575159672 >> v1:172.21.15.118:6789/0 conn(0x7f4bf406eb40 legacy=0x7f4bf414f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.536+0000 7f4bf3fff640 1 -- 172.21.15.118:0/2575159672 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf406f820 con 0x7f4bf414fde0 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.536+0000 7f4bf27fc640 1 -- 172.21.15.118:0/2575159672 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192216364 0 0) 0x7f4bf414f240 con 0x7f4bf406eb40 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf3fff640 1 --2- 172.21.15.118:0/2575159672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf414fde0 0x7f4bf4157580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009d90 tx=0x7f4bec02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdf94f21fdb9522 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf27fc640 1 -- 172.21.15.118:0/2575159672 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec02cc60 con 0x7f4bf414fde0 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf27fc640 1 -- 172.21.15.118:0/2575159672 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec02cdc0 con 0x7f4bf414fde0 2024-02-18T10:00:56.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf27fc640 1 -- 172.21.15.118:0/2575159672 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec034660 con 0x7f4bf414fde0 2024-02-18T10:00:56.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf9f99640 1 -- 172.21.15.118:0/2575159672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf414fde0 msgr2=0x7f4bf4157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/2575159672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf414fde0 0x7f4bf4157580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009d90 tx=0x7f4bec02beb0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf9f99640 1 -- 172.21.15.118:0/2575159672 shutdown_connections 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/2575159672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf414fde0 0x7f4bf4157580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf9f99640 1 -- 172.21.15.118:0/2575159672 >> 172.21.15.118:0/2575159672 conn(0x7f4bf40a11c0 msgr2=0x7f4bf40a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf9f99640 1 -- 172.21.15.118:0/2575159672 shutdown_connections 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.537+0000 7f4bf9f99640 1 -- 172.21.15.118:0/2575159672 wait complete. 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.538+0000 7f4bf9f99640 1 Processor -- start 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.538+0000 7f4bf9f99640 1 -- start start 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf9f99640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf406eb40 0x7f4bf41e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf9f99640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf4145f80 0x7f4bf409fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf9f99640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bf414fde0 0x7f4bf40a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf9f99640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf409e880 con 0x7f4bf406eb40 2024-02-18T10:00:56.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf9f99640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41e54e0 con 0x7f4bf4145f80 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf9f99640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4141550 con 0x7f4bf414fde0 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf406eb40 0x7f4bf41e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf406eb40 0x7f4bf41e4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57474/0 (socket says 172.21.15.118:57474) 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 -- 172.21.15.118:0/330724180 learned_addr learned my addr 172.21.15.118:0/330724180 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 -- 172.21.15.118:0/330724180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bf414fde0 msgr2=0x7f4bf40a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bf414fde0 0x7f4bf40a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 -- 172.21.15.118:0/330724180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf4145f80 msgr2=0x7f4bf409fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf4145f80 0x7f4bf409fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 -- 172.21.15.118:0/330724180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009a70 con 0x7f4bf406eb40 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.539+0000 7f4bf37fe640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf406eb40 0x7f4bf41e4fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c430 tx=0x7f4be400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.540+0000 7f4bdbfff640 1 -- 172.21.15.118:0/330724180 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4011790 con 0x7f4bf406eb40 2024-02-18T10:00:56.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.540+0000 7f4bdbfff640 1 -- 172.21.15.118:0/330724180 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40118f0 con 0x7f4bf406eb40 2024-02-18T10:00:56.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.540+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf41e5c40 con 0x7f4bf406eb40 2024-02-18T10:00:56.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.540+0000 7f4bdbfff640 1 -- 172.21.15.118:0/330724180 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4011ce0 con 0x7f4bf406eb40 2024-02-18T10:00:56.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.540+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf41e5960 con 0x7f4bf406eb40 2024-02-18T10:00:56.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.541+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf4074af0 con 0x7f4bf406eb40 2024-02-18T10:00:56.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.541+0000 7f4bdbfff640 1 -- 172.21.15.118:0/330724180 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f4be401c460 con 0x7f4bf406eb40 2024-02-18T10:00:56.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.541+0000 7f4bdbfff640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f4be006bc70 0x7f4be006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.541+0000 7f4bdbfff640 1 -- 172.21.15.118:0/330724180 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4be408a780 con 0x7f4bf406eb40 2024-02-18T10:00:56.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.541+0000 7f4bf2ffd640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f4be006bc70 0x7f4be006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.542+0000 7f4bf2ffd640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f4be006bc70 0x7f4be006e130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4be8007fd0 tx=0x7f4be8007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.546+0000 7f4bdbfff640 1 -- 172.21.15.118:0/330724180 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4be4054f60 con 0x7f4bf406eb40 2024-02-18T10:00:56.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.764+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4bf406c450 con 0x7f4bf406eb40 2024-02-18T10:00:56.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.767+0000 7f4bdbfff640 1 -- 172.21.15.118:0/330724180 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+172336 (secure 0 0 0) 0x7f4be4058620 con 0x7f4bf406eb40 2024-02-18T10:00:56.772 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.769+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f4be006bc70 msgr2=0x7f4be006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.769+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f4be006bc70 0x7f4be006e130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4be8007fd0 tx=0x7f4be8007920 comp rx=0 tx=0).stop 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.769+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf406eb40 msgr2=0x7f4bf41e4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.769+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf406eb40 0x7f4bf41e4fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c430 tx=0x7f4be400c8f0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 shutdown_connections 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f4be006bc70 0x7f4be006e130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4bf414fde0 0x7f4bf40a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4bf4145f80 0x7f4bf409fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 --2- 172.21.15.118:0/330724180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4bf406eb40 0x7f4bf41e4fa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 >> 172.21.15.118:0/330724180 conn(0x7f4bf40a11c0 msgr2=0x7f4bf41444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:56.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 shutdown_connections 2024-02-18T10:00:56.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.770+0000 7f4bf9f99640 1 -- 172.21.15.118:0/330724180 wait complete. 2024-02-18T10:00:56.784 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":906581077},{"type":"v1","addr":"172.21.15.118:6833","nonce":906581077}]},"active_addr":"172.21.15.118:6833/906581077","active_change":"2024-02-18T10:00:35.270842+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":737948170}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1655220185}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":3879719650}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1866736086}]}]} 2024-02-18T10:00:56.787 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-18T10:00:56.787 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-18T10:00:56.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:56.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.883+0000 7f2cb4b8a640 1 Processor -- start 2024-02-18T10:00:56.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.883+0000 7f2cb4b8a640 1 -- start start 2024-02-18T10:00:56.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cb4b8a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2cb00b9870 0x7f2cb00704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cb4b8a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb014ddf0 con 0x7f2cb014d590 2024-02-18T10:00:56.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cb4b8a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb0072c80 con 0x7f2cb014d1b0 2024-02-18T10:00:56.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cb4b8a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb0072a70 con 0x7f2cb00b9870 2024-02-18T10:00:56.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cadd9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2cb00b9870 0x7f2cb00704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2caed9d640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2cb014d590 0x7f2cb01542b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46994/0 (socket says 172.21.15.118:46994) 2024-02-18T10:00:56.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cadd9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2cb00b9870 0x7f2cb00704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57480/0 (socket says 172.21.15.118:57480) 2024-02-18T10:00:56.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2caed9d640 1 -- 172.21.15.118:0/4239639061 learned_addr learned my addr 172.21.15.118:0/4239639061 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:56.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cadd9b640 1 -- 172.21.15.118:0/4239639061 >> v1:172.21.15.164:6789/0 conn(0x7f2cb014d1b0 legacy=0x7f2cb00a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:56.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.884+0000 7f2cadd9b640 1 -- 172.21.15.118:0/4239639061 >> v1:172.21.15.118:6789/0 conn(0x7f2cb014d590 legacy=0x7f2cb01542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.885+0000 7f2cad59a640 1 -- 172.21.15.118:0/4239639061 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432360395 0 0) 0x7f2cb014ddf0 con 0x7f2cb014d590 2024-02-18T10:00:56.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.885+0000 7f2cadd9b640 1 -- 172.21.15.118:0/4239639061 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb014da80 con 0x7f2cb00b9870 2024-02-18T10:00:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.885+0000 7f2cadd9b640 1 --2- 172.21.15.118:0/4239639061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb00b9870 0x7f2cb00704c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40097a0 tx=0x7f2ca402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675e056c7df5c923 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.885+0000 7f2cad59a640 1 -- 172.21.15.118:0/4239639061 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4031830 con 0x7f2cb00b9870 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.885+0000 7f2cad59a640 1 -- 172.21.15.118:0/4239639061 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4031990 con 0x7f2cb00b9870 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.885+0000 7f2cad59a640 1 -- 172.21.15.118:0/4239639061 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4031d20 con 0x7f2cb00b9870 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.886+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/4239639061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb00b9870 msgr2=0x7f2cb00704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.886+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/4239639061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb00b9870 0x7f2cb00704c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40097a0 tx=0x7f2ca402b8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.886+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/4239639061 shutdown_connections 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.886+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/4239639061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb00b9870 0x7f2cb00704c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.886+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/4239639061 >> 172.21.15.118:0/4239639061 conn(0x7f2cb00b9ca0 msgr2=0x7f2cb00ba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.886+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/4239639061 shutdown_connections 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.886+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/4239639061 wait complete. 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.887+0000 7f2cb4b8a640 1 Processor -- start 2024-02-18T10:00:56.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.887+0000 7f2cb4b8a640 1 -- start start 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cb4b8a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb00b9870 0x7f2cb0148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cb4b8a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb014d1b0 0x7f2cb01df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cb4b8a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb014d590 0x7f2cb01dfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cb4b8a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0148f50 con 0x7f2cb014d590 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cb4b8a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0149ee0 con 0x7f2cb014d1b0 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cb4b8a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0146dd0 con 0x7f2cb00b9870 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb014d590 0x7f2cb01dfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb014d590 0x7f2cb01dfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57492/0 (socket says 172.21.15.118:57492) 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 -- 172.21.15.118:0/1358735580 learned_addr learned my addr 172.21.15.118:0/1358735580 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cadd9b640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb014d1b0 0x7f2cb01df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 -- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb00b9870 msgr2=0x7f2cb0148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cae59c640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb00b9870 0x7f2cb0148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb00b9870 0x7f2cb0148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 -- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb014d1b0 msgr2=0x7f2cb01df6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb014d1b0 0x7f2cb01df6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 -- 172.21.15.118:0/1358735580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4009400 con 0x7f2cb014d590 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cadd9b640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb014d1b0 0x7f2cb01df6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2caed9d640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb014d590 0x7f2cb01dfc00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c410 tx=0x7f2ca800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2c9effd640 1 -- 172.21.15.118:0/1358735580 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80074e0 con 0x7f2cb014d590 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2c9effd640 1 -- 172.21.15.118:0/1358735580 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8007640 con 0x7f2cb014d590 2024-02-18T10:00:56.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.888+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb0148340 con 0x7f2cb014d590 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.889+0000 7f2c9effd640 1 -- 172.21.15.118:0/1358735580 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004a20 con 0x7f2cb014d590 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.889+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb014a0e0 con 0x7f2cb014d590 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.890+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb01468c0 con 0x7f2cb014d590 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.890+0000 7f2c9effd640 1 -- 172.21.15.118:0/1358735580 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f2ca8004b80 con 0x7f2cb014d590 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.890+0000 7f2c9effd640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2c9006bc70 0x7f2c9006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.890+0000 7f2c9effd640 1 -- 172.21.15.118:0/1358735580 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ca808a600 con 0x7f2cb014d590 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.890+0000 7f2cae59c640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2c9006bc70 0x7f2c9006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:56.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.891+0000 7f2cae59c640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2c9006bc70 0x7f2c9006e130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0007fd0 tx=0x7f2ca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:56.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:56.895+0000 7f2c9effd640 1 -- 172.21.15.118:0/1358735580 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2cb01468c0 con 0x7f2cb014d590 2024-02-18T10:00:57.066 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:00:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.065+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb01468c0 con 0x7f2cb014d590 2024-02-18T10:00:57.068 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:00:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.066+0000 7f2c9effd640 1 -- 172.21.15.118:0/1358735580 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f2cb01468c0 con 0x7f2cb014d590 2024-02-18T10:00:57.070 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:57.070 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:57.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2c9006bc70 msgr2=0x7f2c9006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2c9006bc70 0x7f2c9006e130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0007fd0 tx=0x7f2ca0009040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb014d590 msgr2=0x7f2cb01dfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb014d590 0x7f2cb01dfc00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c410 tx=0x7f2ca800c8d0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 shutdown_connections 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2c9006bc70 0x7f2c9006e130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2cb014d590 0x7f2cb01dfc00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cb014d1b0 0x7f2cb01df6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 --2- 172.21.15.118:0/1358735580 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2cb00b9870 0x7f2cb0148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 >> 172.21.15.118:0/1358735580 conn(0x7f2cb00b9ca0 msgr2=0x7f2cb00b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 shutdown_connections 2024-02-18T10:00:57.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.068+0000 7f2cb4b8a640 1 -- 172.21.15.118:0/1358735580 wait complete. 2024-02-18T10:00:57.073 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:00:57.082 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-18T10:00:57.082 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:00:57.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780e3d0640 1 Processor -- start 2024-02-18T10:00:57.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780e3d0640 1 -- start start 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780e3d0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7808143e10 0x7f78080ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780e3d0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f780814cfd0 0x7f780814d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780e3d0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080b4f90 con 0x7f78080a0ce0 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780e3d0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7808072fe0 con 0x7f780814cfd0 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780e3d0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78081441f0 con 0x7f7808143e10 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780c96d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f780814cfd0 0x7f780814d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780c96d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f780814cfd0 0x7f780814d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57496/0 (socket says 172.21.15.118:57496) 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.250+0000 7f780c96d640 1 -- 172.21.15.118:0/808842911 learned_addr learned my addr 172.21.15.118:0/808842911 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f7807fff640 1 --2- 172.21.15.118:0/808842911 >> v2:172.21.15.164:3300/0 conn(0x7f7808143e10 0x7f78080ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f780c96d640 1 -- 172.21.15.118:0/808842911 >> v2:172.21.15.164:3300/0 conn(0x7f7808143e10 msgr2=0x7f78080ba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f780c96d640 1 --2- 172.21.15.118:0/808842911 >> v2:172.21.15.164:3300/0 conn(0x7f7808143e10 0x7f78080ba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f780c96d640 1 -- 172.21.15.118:0/808842911 >> v1:172.21.15.118:6789/0 conn(0x7f78080a0ce0 legacy=0x7f7808070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f780c96d640 1 -- 172.21.15.118:0/808842911 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080716f0 con 0x7f780814cfd0 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f7806ffd640 1 -- 172.21.15.118:0/808842911 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525885734 0 0) 0x7f78080b4f90 con 0x7f78080a0ce0 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f7807fff640 1 --2- 172.21.15.118:0/808842911 >> v2:172.21.15.164:3300/0 conn(0x7f7808143e10 0x7f78080ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.251+0000 7f780c96d640 1 --2- 172.21.15.118:0/808842911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f780814d480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7808070bc0 tx=0x7f780002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23cd7a127f18226 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f7806ffd640 1 -- 172.21.15.118:0/808842911 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780002cbb0 con 0x7f780814cfd0 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f7806ffd640 1 -- 172.21.15.118:0/808842911 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780002cd10 con 0x7f780814cfd0 2024-02-18T10:00:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f7806ffd640 1 -- 172.21.15.118:0/808842911 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800034610 con 0x7f780814cfd0 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 -- 172.21.15.118:0/808842911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 msgr2=0x7f780814d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 --2- 172.21.15.118:0/808842911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f780814d480 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7808070bc0 tx=0x7f780002c010 comp rx=0 tx=0).stop 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 -- 172.21.15.118:0/808842911 shutdown_connections 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 --2- 172.21.15.118:0/808842911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f780814d480 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 --2- 172.21.15.118:0/808842911 >> v2:172.21.15.164:3300/0 conn(0x7f7808143e10 0x7f78080ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 -- 172.21.15.118:0/808842911 >> 172.21.15.118:0/808842911 conn(0x7f780806bcf0 msgr2=0x7f780806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 -- 172.21.15.118:0/808842911 shutdown_connections 2024-02-18T10:00:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.252+0000 7f780e3d0640 1 -- 172.21.15.118:0/808842911 wait complete. 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.253+0000 7f780e3d0640 1 Processor -- start 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.253+0000 7f780e3d0640 1 -- start start 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780e3d0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78080a0ce0 0x7f780806e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780e3d0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7808143e10 0x7f78081e5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780e3d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f78081e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780e3d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b8700 con 0x7f780814cfd0 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780e3d0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780806e830 con 0x7f78080a0ce0 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780e3d0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78081e4550 con 0x7f7808143e10 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f78081e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f78081e0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57512/0 (socket says 172.21.15.118:57512) 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 -- 172.21.15.118:0/3994562137 learned_addr learned my addr 172.21.15.118:0/3994562137 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f7807fff640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78080a0ce0 0x7f780806e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f78077fe640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7808143e10 0x7f78081e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 -- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7808143e10 msgr2=0x7f78081e5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7808143e10 0x7f78081e5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 -- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78080a0ce0 msgr2=0x7f780806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78080a0ce0 0x7f780806e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 -- 172.21.15.118:0/3994562137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800009b30 con 0x7f780814cfd0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f78077fe640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7808143e10 0x7f78081e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780c96d640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f78081e0fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7800036040 tx=0x7f7800004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f7804ff9640 1 -- 172.21.15.118:0/3994562137 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780003e450 con 0x7f780814cfd0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f7804ff9640 1 -- 172.21.15.118:0/3994562137 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780003e5d0 con 0x7f780814cfd0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f7804ff9640 1 -- 172.21.15.118:0/3994562137 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780003e780 con 0x7f780814cfd0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.254+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78081e4830 con 0x7f780814cfd0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.255+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7808148a90 con 0x7f780814cfd0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.256+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78081e4d50 con 0x7f780814cfd0 2024-02-18T10:00:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.256+0000 7f7804ff9640 1 -- 172.21.15.118:0/3994562137 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f780003e8e0 con 0x7f780814cfd0 2024-02-18T10:00:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.256+0000 7f7804ff9640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77f406bc70 0x7f77f406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.256+0000 7f7804ff9640 1 -- 172.21.15.118:0/3994562137 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78000acfa0 con 0x7f780814cfd0 2024-02-18T10:00:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.256+0000 7f7807fff640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77f406bc70 0x7f77f406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.257+0000 7f7807fff640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77f406bc70 0x7f77f406e130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a990 tx=0x7f77fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.260+0000 7f7804ff9640 1 -- 172.21.15.118:0/3994562137 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78081e4d50 con 0x7f780814cfd0 2024-02-18T10:00:57.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.433+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78081e4d50 con 0x7f780814cfd0 2024-02-18T10:00:57.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.434+0000 7f7804ff9640 1 -- 172.21.15.118:0/3994562137 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f78081e4d50 con 0x7f780814cfd0 2024-02-18T10:00:57.437 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:00:57.437 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:00:57.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77f406bc70 msgr2=0x7f77f406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77f406bc70 0x7f77f406e130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a990 tx=0x7f77fc008040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 msgr2=0x7f78081e0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f78081e0fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7800036040 tx=0x7f7800004a40 comp rx=0 tx=0).stop 2024-02-18T10:00:57.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 shutdown_connections 2024-02-18T10:00:57.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77f406bc70 0x7f77f406e130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f780814cfd0 0x7f78081e0fa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7808143e10 0x7f78081e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 --2- 172.21.15.118:0/3994562137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78080a0ce0 0x7f780806e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 >> 172.21.15.118:0/3994562137 conn(0x7f780806bcf0 msgr2=0x7f7808072140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 shutdown_connections 2024-02-18T10:00:57.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.436+0000 7f780e3d0640 1 -- 172.21.15.118:0/3994562137 wait complete. 2024-02-18T10:00:57.450 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-18T10:00:57.450 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-18T10:00:57.451 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-18T10:00:57.451 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-18T10:00:57.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-18T10:00:57.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-18T10:00:57.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-18T10:00:57.453 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.617+0000 7f3694d17640 1 Processor -- start 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.617+0000 7f3694d17640 1 -- start start 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.618+0000 7f3694d17640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f368803ae50 0x7f3688039790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.618+0000 7f3694d17640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f368803b230 0x7f36880f2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.618+0000 7f3694d17640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3688038e10 con 0x7f36880f2640 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.618+0000 7f3694d17640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368803c620 con 0x7f368803ae50 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.618+0000 7f3694d17640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36880e9240 con 0x7f368803b230 2024-02-18T10:00:57.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368f7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f368803ae50 0x7f3688039790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368f7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f368803ae50 0x7f3688039790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57526/0 (socket says 172.21.15.118:57526) 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368f7fe640 1 -- 172.21.15.118:0/1473724085 learned_addr learned my addr 172.21.15.118:0/1473724085 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368effd640 1 --2- 172.21.15.118:0/1473724085 >> v2:172.21.15.164:3300/0 conn(0x7f368803b230 0x7f36880f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368e7fc640 1 -- 172.21.15.118:0/1473724085 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673700411 0 0) 0x7f3688038e10 con 0x7f36880f2640 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368e7fc640 1 -- 172.21.15.118:0/1473724085 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f368000bd30 con 0x7f36880f2640 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368f7fe640 1 -- 172.21.15.118:0/1473724085 >> v2:172.21.15.164:3300/0 conn(0x7f368803b230 msgr2=0x7f36880f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368f7fe640 1 --2- 172.21.15.118:0/1473724085 >> v2:172.21.15.164:3300/0 conn(0x7f368803b230 0x7f36880f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368f7fe640 1 -- 172.21.15.118:0/1473724085 >> v1:172.21.15.164:6789/0 conn(0x7f36880f2640 legacy=0x7f36880e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.619+0000 7f368f7fe640 1 -- 172.21.15.118:0/1473724085 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368803a060 con 0x7f368803ae50 2024-02-18T10:00:57.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f5c26f28640 1 Processor -- start 2024-02-18T10:00:57.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f1e4a49a640 1 Processor -- start 2024-02-18T10:00:57.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f0ac4d65640 1 Processor -- start 2024-02-18T10:00:57.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f1e4a49a640 1 -- start start 2024-02-18T10:00:57.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f368f7fe640 1 --2- 172.21.15.118:0/1473724085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368803ae50 0x7f3688039790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3690050820 tx=0x7f3690095de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dd148cc16dd3c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f5c26f28640 1 -- start start 2024-02-18T10:00:57.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f368e7fc640 1 -- 172.21.15.118:0/1473724085 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690096a40 con 0x7f368803ae50 2024-02-18T10:00:57.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f8568839640 1 Processor -- start 2024-02-18T10:00:57.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f8568839640 1 -- start start 2024-02-18T10:00:57.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f688fe9a640 1 Processor -- start 2024-02-18T10:00:57.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f368e7fc640 1 -- 172.21.15.118:0/1473724085 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690096ba0 con 0x7f368803ae50 2024-02-18T10:00:57.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.620+0000 7f0ac4d65640 1 -- start start 2024-02-18T10:00:57.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f8568839640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f85640b9770 0x7f856406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f688fe9a640 1 -- start start 2024-02-18T10:00:57.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f1e4a49a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e440a6e60 0x7f1e4406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f0ac4d65640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ac01538c0 0x7f0ac0151550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f1e4a49a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1e441546d0 0x7f1e44156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f1e4a49a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440b4aa0 con 0x7f1e4414bf20 2024-02-18T10:00:57.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f1e4a49a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440b4cf0 con 0x7f1e440a6e60 2024-02-18T10:00:57.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.621+0000 7f1e4a49a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440a7350 con 0x7f1e441546d0 2024-02-18T10:00:57.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0ac4d65640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0ac00a30f0 0x7f0ac014a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0ac4d65640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac00b33c0 con 0x7f0ac014a550 2024-02-18T10:00:57.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0ac4d65640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac00b2a90 con 0x7f0ac00a30f0 2024-02-18T10:00:57.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0ac4d65640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac00b2d70 con 0x7f0ac01538c0 2024-02-18T10:00:57.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f856259c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f85640b9770 0x7f856406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f855bfff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f856415c4d0 0x7f85640b81f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47020/0 (socket says 172.21.15.118:47020) 2024-02-18T10:00:57.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e43fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e440a6e60 0x7f1e4406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0abed9d640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0ac014a550 0x7f0ac0150150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47030/0 (socket says 172.21.15.118:47030) 2024-02-18T10:00:57.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f855bfff640 1 -- 172.21.15.118:0/1083798482 learned_addr learned my addr 172.21.15.118:0/1083798482 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:57.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f8568839640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f856415c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0abed9d640 1 -- 172.21.15.118:0/2480022872 learned_addr learned my addr 172.21.15.118:0/2480022872 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:57.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e43fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e440a6e60 0x7f1e4406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57528/0 (socket says 172.21.15.118:57528) 2024-02-18T10:00:57.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e43fff640 1 -- 172.21.15.118:0/3258531444 learned_addr learned my addr 172.21.15.118:0/3258531444 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e48a37640 1 --2- 172.21.15.118:0/3258531444 >> v2:172.21.15.164:3300/0 conn(0x7f1e441546d0 0x7f1e44156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85640a32f0 con 0x7f856415c4d0 2024-02-18T10:00:57.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0ab7fff640 1 --2- 172.21.15.118:0/2480022872 >> v2:172.21.15.118:3300/0 conn(0x7f0ac00a30f0 0x7f0ac014a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85640b9610 con 0x7f85640b9770 2024-02-18T10:00:57.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85640b2480 con 0x7f85640b8900 2024-02-18T10:00:57.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f3694d17640 1 -- 172.21.15.118:0/1473724085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368803ae50 msgr2=0x7f3688039790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f3694d17640 1 --2- 172.21.15.118:0/1473724085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368803ae50 0x7f3688039790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3690050820 tx=0x7f3690095de0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f3694d17640 1 -- 172.21.15.118:0/1473724085 shutdown_connections 2024-02-18T10:00:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f3694d17640 1 --2- 172.21.15.118:0/1473724085 >> v2:172.21.15.164:3300/0 conn(0x7f368803b230 0x7f36880f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f3694d17640 1 --2- 172.21.15.118:0/1473724085 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f368803ae50 0x7f3688039790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f3694d17640 1 -- 172.21.15.118:0/1473724085 >> 172.21.15.118:0/1473724085 conn(0x7f3688005e80 msgr2=0x7f3688006260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f0abe59c640 1 --2- 172.21.15.118:0/2480022872 >> v2:172.21.15.164:3300/0 conn(0x7f0ac01538c0 0x7f0ac0151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e48a37640 1 -- 172.21.15.118:0/3258531444 >> v2:172.21.15.118:3300/0 conn(0x7f1e440a6e60 msgr2=0x7f1e4406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e48a37640 1 --2- 172.21.15.118:0/3258531444 >> v2:172.21.15.118:3300/0 conn(0x7f1e440a6e60 0x7f1e4406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e48a37640 1 -- 172.21.15.118:0/3258531444 >> v1:172.21.15.164:6789/0 conn(0x7f1e4414bf20 legacy=0x7f1e4414c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e42ffd640 1 -- 172.21.15.118:0/3258531444 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567199541 0 0) 0x7f1e440b4aa0 con 0x7f1e4414bf20 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f5c26f28640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5c200bcf10 0x7f5c2006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f5c26f28640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c200b9650 0x7f5c2015a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f5c26f28640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c200bca80 con 0x7f5c20150b70 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f5c26f28640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c200bc4a0 con 0x7f5c200bcf10 2024-02-18T10:00:57.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f5c26f28640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2009cca0 con 0x7f5c200b9650 2024-02-18T10:00:57.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7ff25a655640 1 Processor -- start 2024-02-18T10:00:57.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.622+0000 7f1e48a37640 1 -- 172.21.15.118:0/3258531444 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440c1140 con 0x7f1e441546d0 2024-02-18T10:00:57.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f688fe9a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f68880b93f0 0x7f6888072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f8562d9d640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f856415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f1e43fff640 1 --2- 172.21.15.118:0/3258531444 >> v2:172.21.15.118:3300/0 conn(0x7f1e440a6e60 0x7f1e4406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:57.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f688dc36640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f688806e090 0x7f6888142960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:34062/0 (socket says 172.21.15.118:34062) 2024-02-18T10:00:57.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f856259c640 1 -- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 msgr2=0x7f856415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f688dc36640 1 -- 172.21.15.118:0/1960838727 learned_addr learned my addr 172.21.15.118:0/1960838727 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f688fe9a640 1 --2- 172.21.15.118:0/1960838727 >> v2:172.21.15.164:3300/0 conn(0x7f6888148900 0x7f6888148d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f856259c640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f856415c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f856259c640 1 -- 172.21.15.118:0/1083798482 >> v1:172.21.15.118:6789/0 conn(0x7f856415c4d0 legacy=0x7f85640b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f856259c640 1 -- 172.21.15.118:0/1083798482 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85640a08f0 con 0x7f85640b9770 2024-02-18T10:00:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f8562d9d640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f856415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f3694d17640 1 -- 172.21.15.118:0/1473724085 shutdown_connections 2024-02-18T10:00:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f3694d17640 1 -- 172.21.15.118:0/1473724085 wait complete. 2024-02-18T10:00:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880b9810 con 0x7f688806e090 2024-02-18T10:00:57.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f688e437640 1 --2- 172.21.15.118:0/1960838727 >> v2:172.21.15.164:3300/0 conn(0x7f6888148900 0x7f6888148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6888072a40 con 0x7f68880b93f0 2024-02-18T10:00:57.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7ff25a655640 1 -- start start 2024-02-18T10:00:57.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f1e48a37640 1 --2- 172.21.15.118:0/3258531444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e441546d0 0x7f1e44156ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e4404f930 tx=0x7f1e3c02bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e090a67af054fb server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c25f26640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5c20150b70 0x7f5c200b7ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:34064/0 (socket says 172.21.15.118:34064) 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c25f26640 1 -- 172.21.15.118:0/444590496 learned_addr learned my addr 172.21.15.118:0/444590496 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c25725640 1 --2- 172.21.15.118:0/444590496 >> v2:172.21.15.118:3300/0 conn(0x7f5c200bcf10 0x7f5c2006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c26727640 1 --2- 172.21.15.118:0/444590496 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c200b9650 0x7f5c2015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c25725640 1 -- 172.21.15.118:0/444590496 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c200b9650 msgr2=0x7f5c2015a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c25725640 1 --2- 172.21.15.118:0/444590496 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c200b9650 0x7f5c2015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c25725640 1 -- 172.21.15.118:0/444590496 >> v1:172.21.15.164:6789/0 conn(0x7f5c20150b70 legacy=0x7f5c200b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.623+0000 7f5c25725640 1 -- 172.21.15.118:0/444590496 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c200bc710 con 0x7f5c200bcf10 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff25a655640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff25406bbe0 0x7ff254149300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff25a655640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff254149840 0x7ff254156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff25a655640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2540b4e10 con 0x7ff2540bd2b0 2024-02-18T10:00:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff25a655640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2540bdc20 con 0x7ff25406bbe0 2024-02-18T10:00:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff25a655640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540bc5c0 con 0x7ff254149840 2024-02-18T10:00:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f0abe59c640 1 -- 172.21.15.118:0/2480022872 >> v2:172.21.15.118:3300/0 conn(0x7f0ac00a30f0 msgr2=0x7f0ac014a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f0abe59c640 1 --2- 172.21.15.118:0/2480022872 >> v2:172.21.15.118:3300/0 conn(0x7f0ac00a30f0 0x7f0ac014a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f0abe59c640 1 -- 172.21.15.118:0/2480022872 >> v1:172.21.15.118:6789/0 conn(0x7f0ac014a550 legacy=0x7f0ac0150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f0abe59c640 1 -- 172.21.15.118:0/2480022872 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00b3050 con 0x7f0ac01538c0 2024-02-18T10:00:57.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f1e42ffd640 1 -- 172.21.15.118:0/3258531444 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c02cb50 con 0x7f1e441546d0 2024-02-18T10:00:57.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f1e42ffd640 1 -- 172.21.15.118:0/3258531444 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c02ccb0 con 0x7f1e441546d0 2024-02-18T10:00:57.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f1e42ffd640 1 -- 172.21.15.118:0/3258531444 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c034660 con 0x7f1e441546d0 2024-02-18T10:00:57.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff24bfff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff2540bd2b0 0x7ff25414bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:34070/0 (socket says 172.21.15.118:34070) 2024-02-18T10:00:57.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff24bfff640 1 -- 172.21.15.118:0/2929227663 learned_addr learned my addr 172.21.15.118:0/2929227663 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:57.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff258bf2640 1 --2- 172.21.15.118:0/2929227663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff254149840 0x7ff254156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff253fff640 1 --2- 172.21.15.118:0/2929227663 >> v2:172.21.15.164:3300/0 conn(0x7ff25406bbe0 0x7ff254149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f688cc34640 1 -- 172.21.15.118:0/1960838727 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239930508 0 0) 0x7f6884001110 con 0x7f688806e090 2024-02-18T10:00:57.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f688d435640 1 --2- 172.21.15.118:0/1960838727 >> v2:172.21.15.118:3300/0 conn(0x7f68880b93f0 0x7f6888072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68880b9a30 con 0x7f6888148900 2024-02-18T10:00:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff2537fe640 1 -- 172.21.15.118:0/2929227663 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837730127 0 0) 0x7ff2540b4e10 con 0x7ff2540bd2b0 2024-02-18T10:00:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff2537fe640 1 -- 172.21.15.118:0/2929227663 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff240003520 con 0x7ff2540bd2b0 2024-02-18T10:00:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff258bf2640 1 -- 172.21.15.118:0/2929227663 >> v2:172.21.15.164:3300/0 conn(0x7ff25406bbe0 msgr2=0x7ff254149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff258bf2640 1 --2- 172.21.15.118:0/2929227663 >> v2:172.21.15.164:3300/0 conn(0x7ff25406bbe0 0x7ff254149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff258bf2640 1 -- 172.21.15.118:0/2929227663 >> v1:172.21.15.164:6789/0 conn(0x7ff2540bd2b0 legacy=0x7ff25414bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.624+0000 7ff258bf2640 1 -- 172.21.15.118:0/2929227663 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540b4b50 con 0x7ff254149840 2024-02-18T10:00:57.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f5c25725640 1 --2- 172.21.15.118:0/444590496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200bcf10 0x7f5c2006ca80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c100097a0 tx=0x7f5c1002b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c3100f699d557c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f856259c640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85640b9770 0x7f856406c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85540097d0 tx=0x7f855402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a0403d5931fb88d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f8561d9b640 1 -- 172.21.15.118:0/1083798482 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554031780 con 0x7f85640b9770 2024-02-18T10:00:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f5c24f24640 1 -- 172.21.15.118:0/444590496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10030710 con 0x7f5c200bcf10 2024-02-18T10:00:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f688cc34640 1 -- 172.21.15.118:0/1960838727 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6874003520 con 0x7f688806e090 2024-02-18T10:00:57.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f8561d9b640 1 -- 172.21.15.118:0/1083798482 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85540318e0 con 0x7f85640b9770 2024-02-18T10:00:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f5c24f24640 1 -- 172.21.15.118:0/444590496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1002e050 con 0x7f5c200bcf10 2024-02-18T10:00:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f8561d9b640 1 -- 172.21.15.118:0/1083798482 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554031780 con 0x7f85640b9770 2024-02-18T10:00:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 -- 172.21.15.118:0/3258531444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e441546d0 msgr2=0x7f1e44156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 --2- 172.21.15.118:0/3258531444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e441546d0 0x7f1e44156ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e4404f930 tx=0x7f1e3c02bda0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f0abe59c640 1 --2- 172.21.15.118:0/2480022872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0151550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ac006bc10 tx=0x7f0ab002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a39eed159f4ebac server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 -- 172.21.15.118:0/3258531444 shutdown_connections 2024-02-18T10:00:57.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f688e437640 1 -- 172.21.15.118:0/1960838727 >> v2:172.21.15.118:3300/0 conn(0x7f68880b93f0 msgr2=0x7f6888072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 --2- 172.21.15.118:0/3258531444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e441546d0 0x7f1e44156ac0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 --2- 172.21.15.118:0/3258531444 >> v2:172.21.15.118:3300/0 conn(0x7f1e440a6e60 0x7f1e4406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 -- 172.21.15.118:0/3258531444 >> 172.21.15.118:0/3258531444 conn(0x7f1e440c15b0 msgr2=0x7f1e440c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f5c24f24640 1 -- 172.21.15.118:0/444590496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10030a90 con 0x7f5c200bcf10 2024-02-18T10:00:57.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f688e437640 1 --2- 172.21.15.118:0/1960838727 >> v2:172.21.15.118:3300/0 conn(0x7f68880b93f0 0x7f6888072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f0abdd9b640 1 -- 172.21.15.118:0/2480022872 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0030610 con 0x7f0ac01538c0 2024-02-18T10:00:57.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f688cc34640 1 -- 172.21.15.118:0/1960838727 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891002376 0 0) 0x7f6874003520 con 0x7f688806e090 2024-02-18T10:00:57.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f688e437640 1 -- 172.21.15.118:0/1960838727 >> v1:172.21.15.164:6789/0 conn(0x7f688806e090 legacy=0x7f6888142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7ff258bf2640 1 --2- 172.21.15.118:0/2929227663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff254149840 0x7ff254156650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009d90 tx=0x7ff24c02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae601e51974f381d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f0abdd9b640 1 -- 172.21.15.118:0/2480022872 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab0030770 con 0x7f0ac01538c0 2024-02-18T10:00:57.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7ff2537fe640 1 -- 172.21.15.118:0/2929227663 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02cbd0 con 0x7ff254149840 2024-02-18T10:00:57.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f0abdd9b640 1 -- 172.21.15.118:0/2480022872 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0030b00 con 0x7f0ac01538c0 2024-02-18T10:00:57.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 -- 172.21.15.118:0/3258531444 shutdown_connections 2024-02-18T10:00:57.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f1e4a49a640 1 -- 172.21.15.118:0/3258531444 wait complete. 2024-02-18T10:00:57.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7ff2537fe640 1 -- 172.21.15.118:0/2929227663 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c02cd30 con 0x7ff254149840 2024-02-18T10:00:57.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85640b9770 msgr2=0x7f856406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85640b9770 0x7f856406c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85540097d0 tx=0x7f855402b820 comp rx=0 tx=0).stop 2024-02-18T10:00:57.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 shutdown_connections 2024-02-18T10:00:57.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f856415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 --2- 172.21.15.118:0/1083798482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85640b9770 0x7f856406c8e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 >> 172.21.15.118:0/1083798482 conn(0x7f85640bd520 msgr2=0x7f85640bd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f688e437640 1 -- 172.21.15.118:0/1960838727 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880ba440 con 0x7f6888148900 2024-02-18T10:00:57.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 shutdown_connections 2024-02-18T10:00:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f688d435640 1 --2- 172.21.15.118:0/1960838727 >> v2:172.21.15.118:3300/0 conn(0x7f68880b93f0 0x7f6888072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8568839640 1 -- 172.21.15.118:0/1083798482 wait complete. 2024-02-18T10:00:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f5c26f28640 1 -- 172.21.15.118:0/444590496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200bcf10 msgr2=0x7f5c2006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f5c26f28640 1 --2- 172.21.15.118:0/444590496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200bcf10 0x7f5c2006ca80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c100097a0 tx=0x7f5c1002b660 comp rx=0 tx=0).stop 2024-02-18T10:00:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f8b9f62a640 1 Processor -- start 2024-02-18T10:00:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f5c26f28640 1 -- 172.21.15.118:0/444590496 shutdown_connections 2024-02-18T10:00:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f5c26f28640 1 --2- 172.21.15.118:0/444590496 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c200b9650 0x7f5c2015a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f5c26f28640 1 --2- 172.21.15.118:0/444590496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200bcf10 0x7f5c2006ca80 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c100097a0 tx=0x7f5c1002b660 comp rx=0 tx=0).stop 2024-02-18T10:00:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f5c26f28640 1 -- 172.21.15.118:0/444590496 >> 172.21.15.118:0/444590496 conn(0x7f5c2006abe0 msgr2=0x7f5c2006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f5c26f28640 1 -- 172.21.15.118:0/444590496 shutdown_connections 2024-02-18T10:00:57.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f8b9f62a640 1 -- start start 2024-02-18T10:00:57.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 -- 172.21.15.118:0/2929227663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff254149840 msgr2=0x7ff254156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 --2- 172.21.15.118:0/2929227663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff254149840 0x7ff254156650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009d90 tx=0x7ff24c02be20 comp rx=0 tx=0).stop 2024-02-18T10:00:57.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 -- 172.21.15.118:0/2929227663 shutdown_connections 2024-02-18T10:00:57.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 --2- 172.21.15.118:0/2929227663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff254149840 0x7ff254156650 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 --2- 172.21.15.118:0/2929227663 >> v2:172.21.15.164:3300/0 conn(0x7ff25406bbe0 0x7ff254149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 -- 172.21.15.118:0/2929227663 >> 172.21.15.118:0/2929227663 conn(0x7ff2540c18e0 msgr2=0x7ff2540c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f1e4a49a640 1 Processor -- start 2024-02-18T10:00:57.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f3694d17640 1 Processor -- start 2024-02-18T10:00:57.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.625+0000 7f3694d17640 1 -- start start 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f3694d17640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f368803b230 0x7f3688034010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f3694d17640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36880ec280 0x7f3688030d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f3694d17640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688037900 0x7f36880eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f3694d17640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880308e0 con 0x7f36880ec280 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f3694d17640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3688034550 con 0x7f368803b230 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f3694d17640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3688188100 con 0x7f3688037900 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f368ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688037900 0x7f36880eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f368ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688037900 0x7f36880eb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:54386/0 (socket says 172.21.15.118:54386) 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f368ffff640 1 -- 172.21.15.118:0/1683129565 learned_addr learned my addr 172.21.15.118:0/1683129565 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.626+0000 7f368effd640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36880ec280 0x7f3688030d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f368ffff640 1 -- 172.21.15.118:0/1683129565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f368803b230 msgr2=0x7f3688034010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-18T10:00:57.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f368ffff640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f368803b230 0x7f3688034010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f5c26f28640 1 -- 172.21.15.118:0/444590496 wait complete. 2024-02-18T10:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f368ffff640 1 -- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36880ec280 msgr2=0x7f3688030d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f368ffff640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36880ec280 0x7f3688030d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f368ffff640 1 -- 172.21.15.118:0/1683129565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690074040 con 0x7f3688037900 2024-02-18T10:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f368effd640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36880ec280 0x7f3688030d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:57.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f368ffff640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688037900 0x7f36880eb6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f368400c3c0 tx=0x7f368400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f1e4a49a640 1 -- start start 2024-02-18T10:00:57.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f8b9f62a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b980b4360 0x7f8b98149e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f8b9f62a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b98072f30 0x7f8b98153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f8b9f62a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b980b2bd0 con 0x7f8b9814a390 2024-02-18T10:00:57.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f688e437640 1 --2- 172.21.15.118:0/1960838727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6888148900 0x7f6888148d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68880b9b70 tx=0x7f687802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88089320b5c67ff9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f8b9f62a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b98150140 con 0x7f8b98072f30 2024-02-18T10:00:57.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7f8b9f62a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98150420 con 0x7f8b980b4360 2024-02-18T10:00:57.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8b9d3c6640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b980b4360 0x7f8b98149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8b9dbc7640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8b9814a390 0x7f8b98153a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47032/0 (socket says 172.21.15.118:47032) 2024-02-18T10:00:57.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/4152279790 learned_addr learned my addr 172.21.15.118:0/4152279790 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:57.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840052d0 con 0x7f3688037900 2024-02-18T10:00:57.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f688cc34640 1 -- 172.21.15.118:0/1960838727 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687802f050 con 0x7f6888148900 2024-02-18T10:00:57.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684005430 con 0x7f3688037900 2024-02-18T10:00:57.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8568839640 1 Processor -- start 2024-02-18T10:00:57.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f688cc34640 1 -- 172.21.15.118:0/1960838727 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878031500 con 0x7f6888148900 2024-02-18T10:00:57.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684003830 con 0x7f3688037900 2024-02-18T10:00:57.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8568839640 1 -- start start 2024-02-18T10:00:57.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208667321 0 0) 0x7f8b88001110 con 0x7f8b9814a390 2024-02-18T10:00:57.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f688cc34640 1 -- 172.21.15.118:0/1960838727 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884001800 con 0x7f6888148900 2024-02-18T10:00:57.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b84003520 con 0x7f8b9814a390 2024-02-18T10:00:57.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f0ac4d65640 1 -- 172.21.15.118:0/2480022872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 msgr2=0x7f0ac0151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f0ac4d65640 1 --2- 172.21.15.118:0/2480022872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0151550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ac006bc10 tx=0x7f0ab002b960 comp rx=0 tx=0).stop 2024-02-18T10:00:57.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f1e4a49a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e440a6e60 0x7f1e441e9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f1e4a49a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4414bf20 0x7f1e4414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828317290 0 0) 0x7f8b84003520 con 0x7f8b9814a390 2024-02-18T10:00:57.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b980b4360 msgr2=0x7f8b98149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b980b4360 0x7f8b98149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 >> v2:172.21.15.118:3300/0 conn(0x7f8b98072f30 msgr2=0x7f8b98153520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-18T10:00:57.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 --2- 172.21.15.118:0/4152279790 >> v2:172.21.15.118:3300/0 conn(0x7f8b98072f30 0x7f8b98153520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e43fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e440a6e60 0x7f1e441e9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98150700 con 0x7f8b9814a390 2024-02-18T10:00:57.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e43fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e440a6e60 0x7f1e441e9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41080/0 (socket says 172.21.15.118:41080) 2024-02-18T10:00:57.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e4a49a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e441546d0 0x7f1e4414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e43fff640 1 -- 172.21.15.118:0/2919398590 learned_addr learned my addr 172.21.15.118:0/2919398590 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e441e95a0 con 0x7f1e4414bf20 2024-02-18T10:00:57.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f8b88001800 con 0x7f8b9814a390 2024-02-18T10:00:57.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 >> v1:172.21.15.118:6789/0 conn(0x7f8b9814a390 legacy=0x7f8b98153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4414fe90 con 0x7f1e440a6e60 2024-02-18T10:00:57.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4414d040 con 0x7f1e441546d0 2024-02-18T10:00:57.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84003970 0x7f8b84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e48a37640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e441546d0 0x7f1e4414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b840047c0 0x7f8b84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84005180 0x7f8b8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3688032050 con 0x7f3688037900 2024-02-18T10:00:57.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98150140 con 0x7f8b84003970 2024-02-18T10:00:57.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f1e437fe640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4414bf20 0x7f1e4414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98150420 con 0x7f8b84005180 2024-02-18T10:00:57.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f0ac4d65640 1 -- 172.21.15.118:0/2480022872 shutdown_connections 2024-02-18T10:00:57.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8400c030 con 0x7f8b840047c0 2024-02-18T10:00:57.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f0ac4d65640 1 --2- 172.21.15.118:0/2480022872 >> v2:172.21.15.118:3300/0 conn(0x7f0ac00a30f0 0x7f0ac014a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f0ac4d65640 1 --2- 172.21.15.118:0/2480022872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0151550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f0ac4d65640 1 -- 172.21.15.118:0/2480022872 >> 172.21.15.118:0/2480022872 conn(0x7f0ac00b9c30 msgr2=0x7f0ac00ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84005180 0x7f8b8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.628+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36880305a0 con 0x7f3688037900 2024-02-18T10:00:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 -- 172.21.15.118:0/2929227663 shutdown_connections 2024-02-18T10:00:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.627+0000 7ff25a655640 1 -- 172.21.15.118:0/2929227663 wait complete. 2024-02-18T10:00:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7ff25a655640 1 Processor -- start 2024-02-18T10:00:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7ff25a655640 1 -- start start 2024-02-18T10:00:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6888148900 msgr2=0x7f6888148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f688fe9a640 1 --2- 172.21.15.118:0/1960838727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6888148900 0x7f6888148d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68880b9b70 tx=0x7f687802b820 comp rx=0 tx=0).stop 2024-02-18T10:00:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f8568839640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f85641e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3688006fd0 con 0x7f3688037900 2024-02-18T10:00:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.629+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 shutdown_connections 2024-02-18T10:00:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f688fe9a640 1 --2- 172.21.15.118:0/1960838727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6888148900 0x7f6888148d50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f688fe9a640 1 --2- 172.21.15.118:0/1960838727 >> v2:172.21.15.118:3300/0 conn(0x7f68880b93f0 0x7f6888072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 >> 172.21.15.118:0/1960838727 conn(0x7f68880bb1d0 msgr2=0x7f68880bb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8568839640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85640b9770 0x7f85641e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b840047c0 msgr2=0x7f8b84004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-18T10:00:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b840047c0 0x7f8b84004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f1e43fff640 1 -- 172.21.15.118:0/2919398590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e441546d0 msgr2=0x7f1e4414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f1e43fff640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1e441546d0 0x7f1e4414e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f1e43fff640 1 -- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4414bf20 msgr2=0x7f1e4414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f5c26f28640 1 Processor -- start 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f5c26f28640 1 -- start start 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff25a655640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff25406bbe0 0x7ff2540a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff25a655640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2540bd2b0 0x7ff2540a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff25a655640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff254149840 0x7ff254140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff25a655640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540a4ba0 con 0x7ff2540bd2b0 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff25a655640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541400c0 con 0x7ff254149840 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff25a655640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540a6250 con 0x7ff25406bbe0 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff24bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2540bd2b0 0x7ff2540a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff24bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2540bd2b0 0x7ff2540a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57590/0 (socket says 172.21.15.118:57590) 2024-02-18T10:00:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff24bfff640 1 -- 172.21.15.118:0/3376936441 learned_addr learned my addr 172.21.15.118:0/3376936441 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f0ac4d65640 1 -- 172.21.15.118:0/2480022872 shutdown_connections 2024-02-18T10:00:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f0ac4d65640 1 -- 172.21.15.118:0/2480022872 wait complete. 2024-02-18T10:00:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/4152279790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84003970 msgr2=0x7f8b84003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b84003970 0x7f8b84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/4152279790 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84003520 con 0x7f8b84005180 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8568839640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f856415c4d0 0x7f85641536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f85641e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f85641e3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:54406/0 (socket says 172.21.15.118:54406) 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 -- 172.21.15.118:0/1829694910 learned_addr learned my addr 172.21.15.118:0/1829694910 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8568839640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85641e4350 con 0x7f85640b9770 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8568839640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85641e23c0 con 0x7f856415c4d0 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8562d9d640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f856415c4d0 0x7f85641536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f8568839640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85641e20e0 con 0x7f85640b8900 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f855bfff640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85640b9770 0x7f85641e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 shutdown_connections 2024-02-18T10:00:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f688fe9a640 1 -- 172.21.15.118:0/1960838727 wait complete. 2024-02-18T10:00:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff258bf2640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff254149840 0x7ff254140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7ff253fff640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff25406bbe0 0x7ff2540a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 -- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f856415c4d0 msgr2=0x7f85641536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f856415c4d0 0x7f85641536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 -- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85640b9770 msgr2=0x7f85641e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f85640b9770 0x7f85641e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.630+0000 7f856259c640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009400 con 0x7f85640b8900 2024-02-18T10:00:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c26f28640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200b9650 0x7f5c201e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c26f28640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c20150b70 0x7f5c2009be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7ff24bfff640 1 -- 172.21.15.118:0/3376936441 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff25406bbe0 msgr2=0x7ff2540a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7ff24bfff640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff25406bbe0 0x7ff2540a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7ff24bfff640 1 -- 172.21.15.118:0/3376936441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff254149840 msgr2=0x7ff254140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7ff24bfff640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff254149840 0x7ff254140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c26f28640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c20148330 0x7f5c201487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f1e43fff640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4414bf20 0x7f1e4414dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f1e43fff640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380094d0 con 0x7f1e440a6e60 2024-02-18T10:00:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c26f28640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c201e9a10 con 0x7f5c200b9650 2024-02-18T10:00:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f1e437fe640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e4414bf20 0x7f1e4414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c26f28640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2009c3c0 con 0x7f5c20150b70 2024-02-18T10:00:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c26f28640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c20148cf0 con 0x7f5c20148330 2024-02-18T10:00:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c20150b70 0x7f5c2009be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7ff24bfff640 1 -- 172.21.15.118:0/3376936441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c009a70 con 0x7ff2540bd2b0 2024-02-18T10:00:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84005180 0x7f8b8400b980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c190 tx=0x7f8b840057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6ef3b82acca942 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c20150b70 0x7f5c2009be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41118/0 (socket says 172.21.15.118:41118) 2024-02-18T10:00:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 -- 172.21.15.118:0/2998864546 learned_addr learned my addr 172.21.15.118:0/2998864546 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c26727640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c20148330 0x7f5c201487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25f26640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200b9650 0x7f5c201e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f1e43fff640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e440a6e60 0x7f1e441e9060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e9b0 tx=0x7f1e3800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88005ad0 con 0x7f8b84005180 2024-02-18T10:00:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88005c30 con 0x7f8b84005180 2024-02-18T10:00:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f8b8ffff640 1 -- 172.21.15.118:0/4152279790 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8802c7a0 con 0x7f8b84005180 2024-02-18T10:00:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f856259c640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f85641e3e10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8554034040 tx=0x7f85540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7ff24bfff640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2540bd2b0 0x7ff2540a6bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c4d0 tx=0x7ff23c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 -- 172.21.15.118:0/2998864546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c20148330 msgr2=0x7f5c201487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c20148330 0x7f5c201487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 -- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200b9650 msgr2=0x7f5c201e94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c200b9650 0x7f5c201e94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.631+0000 7f5c25725640 1 -- 172.21.15.118:0/2998864546 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10009400 con 0x7f5c20150b70 2024-02-18T10:00:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f5c26727640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c20148330 0x7f5c201487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f3684003990 con 0x7f3688037900 2024-02-18T10:00:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c005ce0 con 0x7ff2540bd2b0 2024-02-18T10:00:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f5c25725640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c20150b70 0x7f5c2009be80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c100098c0 tx=0x7f5c100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c005e40 con 0x7ff2540bd2b0 2024-02-18T10:00:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c007270 con 0x7ff2540bd2b0 2024-02-18T10:00:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2540a4410 con 0x7ff2540bd2b0 2024-02-18T10:00:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2540a7130 con 0x7ff2540bd2b0 2024-02-18T10:00:57.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f688fe9a640 1 Processor -- start 2024-02-18T10:00:57.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f0ac4d65640 1 Processor -- start 2024-02-18T10:00:57.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f5c167fc640 1 -- 172.21.15.118:0/2998864546 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10004230 con 0x7f5c20150b70 2024-02-18T10:00:57.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f8b9f62a640 1 -- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84005180 msgr2=0x7f8b8400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f8b9f62a640 1 --2- 172.21.15.118:0/4152279790 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b84005180 0x7f8b8400b980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c190 tx=0x7f8b840057f0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c201ea1b0 con 0x7f5c20150b70 2024-02-18T10:00:57.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800c9a0 con 0x7f1e440a6e60 2024-02-18T10:00:57.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3800cb00 con 0x7f1e440a6e60 2024-02-18T10:00:57.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800ce70 con 0x7f1e440a6e60 2024-02-18T10:00:57.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f688fe9a640 1 -- start start 2024-02-18T10:00:57.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c009a70 con 0x7f1e440a6e60 2024-02-18T10:00:57.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e440a2340 con 0x7f1e440a6e60 2024-02-18T10:00:57.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/4152279790 reap_dead start 2024-02-18T10:00:57.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e4406c960 con 0x7f1e440a6e60 2024-02-18T10:00:57.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c201e9bf0 con 0x7f5c20150b70 2024-02-18T10:00:57.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f5c167fc640 1 -- 172.21.15.118:0/2998864546 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c10004390 con 0x7f5c20150b70 2024-02-18T10:00:57.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f5c167fc640 1 -- 172.21.15.118:0/2998864546 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1003c820 con 0x7f5c20150b70 2024-02-18T10:00:57.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f367bfff640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f367406bcf0 0x7f367406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f368408a060 con 0x7f3688037900 2024-02-18T10:00:57.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f367bfff640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7f3674073f10 0x7f3674076330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 --> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36740769e0 con 0x7f3674073f10 2024-02-18T10:00:57.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.632+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368408a500 con 0x7f3688037900 2024-02-18T10:00:57.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f0ac4d65640 1 -- start start 2024-02-18T10:00:57.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f8b9f62a640 1 -- 172.21.15.118:0/4152279790 shutdown_connections 2024-02-18T10:00:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f8b9f62a640 1 -- 172.21.15.118:0/4152279790 >> 172.21.15.118:0/4152279790 conn(0x7f8b9809f3b0 msgr2=0x7f8b9809f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f8b9f62a640 1 -- 172.21.15.118:0/4152279790 shutdown_connections 2024-02-18T10:00:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f8b9f62a640 1 -- 172.21.15.118:0/4152279790 wait complete. 2024-02-18T10:00:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554003810 con 0x7f85640b8900 2024-02-18T10:00:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8554040070 con 0x7f85640b8900 2024-02-18T10:00:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.633+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554003bb0 con 0x7f85640b8900 2024-02-18T10:00:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f688fe9a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f688806e090 0x7f68880bd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f0ac4d65640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ac00a30f0 0x7f0ac00b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f1e38013470 con 0x7f1e440a6e60 2024-02-18T10:00:57.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f8568839640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85641e2d90 con 0x7f85640b8900 2024-02-18T10:00:57.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f0ac4d65640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ac014a550 0x7f0ac01e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f8568839640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85641543a0 con 0x7f85640b8900 2024-02-18T10:00:57.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f368f7fe640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f367406bcf0 0x7f367406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f8b9f62a640 1 Processor -- start 2024-02-18T10:00:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f5c167fc640 1 -- 172.21.15.118:0/2998864546 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f5c10039050 con 0x7f5c20150b70 2024-02-18T10:00:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f0abe59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ac00a30f0 0x7f0ac00b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f0abe59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ac00a30f0 0x7f0ac00b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:54448/0 (socket says 172.21.15.118:54448) 2024-02-18T10:00:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f0ac4d65640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f0ac4d65640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b5850 con 0x7f0ac014a550 2024-02-18T10:00:57.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff25406bfc0 con 0x7ff2540bd2b0 2024-02-18T10:00:57.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f1e40ff9640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1e3006bd70 0x7f1e3006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f0abed9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f5c167fc640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5c0406bd70 0x7f5c0406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f0abed9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41130/0 (socket says 172.21.15.118:41130) 2024-02-18T10:00:57.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f0abed9d640 1 -- 172.21.15.118:0/3513566828 learned_addr learned my addr 172.21.15.118:0/3513566828 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.634+0000 7f8b9f62a640 1 -- start start 2024-02-18T10:00:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f368f7fe640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f367406bcf0 0x7f367406e1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3688008430 tx=0x7f369009a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f5c167fc640 1 -- 172.21.15.118:0/2998864546 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c100abce0 con 0x7f5c20150b70 2024-02-18T10:00:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f5c25f26640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5c0406bd70 0x7f5c0406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f8b9f62a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b981e9740 0x7f8b980b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f8b9f62a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b981e9b20 0x7f8b98152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f8568839640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85640a2a50 con 0x7f85640b8900 2024-02-18T10:00:57.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f0ab7fff640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ac014a550 0x7f0ac01e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f8b9f62a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b98148f80 0x7f8b98149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f8b9f62a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980b5090 con 0x7f8b98148f80 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f8b9f62a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98152040 con 0x7f8b981e9b20 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f8b9f62a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980b6110 con 0x7f8b981e9740 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e3808ad00 con 0x7f1e440a6e60 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f1e40ff9640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7f1e30073ff0 0x7f1e30076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e30076ac0 con 0x7f1e30073ff0 2024-02-18T10:00:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e3808d320 con 0x7f1e440a6e60 2024-02-18T10:00:57.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f368effd640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7f3674073f10 0x7f3674076330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.635+0000 7f1e48a37640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7f1e30073ff0 0x7f1e30076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f1e437fe640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1e3006bd70 0x7f1e3006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9cbc5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b981e9b20 0x7f8b98152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7ff23c007490 con 0x7ff2540bd2b0 2024-02-18T10:00:57.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9cbc5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b981e9b20 0x7f8b98152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41132/0 (socket says 172.21.15.118:41132) 2024-02-18T10:00:57.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9cbc5640 1 -- 172.21.15.118:0/3327769033 learned_addr learned my addr 172.21.15.118:0/3327769033 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b98148f80 0x7f8b98149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f1e48a37640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7f1e30073ff0 0x7f1e30076410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f688fe9a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68880b93f0 0x7f68880a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f688fe9a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6888148900 0x7f68880a2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f688fe9a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888149c00 con 0x7f6888148900 2024-02-18T10:00:57.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f688fe9a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880bdd70 con 0x7f68880b93f0 2024-02-18T10:00:57.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f688fe9a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68880a1920 con 0x7f688806e090 2024-02-18T10:00:57.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f5c25f26640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5c0406bd70 0x7f5c0406e230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c000f60 tx=0x7f5c1c007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9d3c6640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b981e9740 0x7f8b980b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f1e437fe640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1e3006bd70 0x7f1e3006e230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e440a6400 tx=0x7f1e34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f368effd640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7f3674073f10 0x7f3674076330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f5c26f28640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f5c08001650 0x7f5c08003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7ff2517fa640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff23406bd40 0x7ff23406e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b981e9740 msgr2=0x7f8b980b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b981e9740 0x7f8b980b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b981e9b20 msgr2=0x7f8b98152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b981e9b20 0x7f8b98152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/3327769033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9814d950 con 0x7f8b98148f80 2024-02-18T10:00:57.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff23c089bc0 con 0x7ff2540bd2b0 2024-02-18T10:00:57.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f8b9dbc7640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b98148f80 0x7f8b98149430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b88031000 tx=0x7f8b88001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7ff2517fa640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7ff234073fc0 0x7ff2340763e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 --> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff234076a90 con 0x7ff234073fc0 2024-02-18T10:00:57.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff23c08e2a0 con 0x7ff2540bd2b0 2024-02-18T10:00:57.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 --> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c08006bb0 con 0x7f5c08001650 2024-02-18T10:00:57.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f5c26727640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f5c08001650 0x7f5c08003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== osd.0 v2:172.21.15.118:6808/2287683675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1e30076ac0 con 0x7f1e30073ff0 2024-02-18T10:00:57.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f5c26727640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f5c08001650 0x7f5c08003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7ff258bf2640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7ff234073fc0 0x7ff2340763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== osd.3 v2:172.21.15.118:6800/28144523 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f36740769e0 con 0x7f3674073f10 2024-02-18T10:00:57.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b5d10 con 0x7f0ac01538c0 2024-02-18T10:00:57.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.636+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01dc7b0 con 0x7f0ac00a30f0 2024-02-18T10:00:57.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8802c9a0 con 0x7f8b98148f80 2024-02-18T10:00:57.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f688d435640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68880b93f0 0x7f68880a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f688d435640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68880b93f0 0x7f68880a3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41134/0 (socket says 172.21.15.118:41134) 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f688d435640 1 -- 172.21.15.118:0/1762048642 learned_addr learned my addr 172.21.15.118:0/1762048642 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7ff253fff640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff23406bd40 0x7ff23406e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7ff258bf2640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7ff234073fc0 0x7ff2340763e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f0abed9d640 1 -- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ac00a30f0 msgr2=0x7f0ac00b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f0abed9d640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ac00a30f0 0x7f0ac00b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f0abed9d640 1 -- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ac014a550 msgr2=0x7f0ac01e5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f0abed9d640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ac014a550 0x7f0ac01e5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f0abed9d640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab0009400 con 0x7f0ac01538c0 2024-02-18T10:00:57.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b98151da0 con 0x7f8b98148f80 2024-02-18T10:00:57.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b98149970 con 0x7f8b98148f80 2024-02-18T10:00:57.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8802cb00 con 0x7f8b98148f80 2024-02-18T10:00:57.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8802ce70 con 0x7f8b98148f80 2024-02-18T10:00:57.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f688e437640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6888148900 0x7f68880a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f5c167fc640 1 -- 172.21.15.118:0/2998864546 <== osd.1 v2:172.21.15.118:6816/2284297691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5c08006bb0 con 0x7f5c08001650 2024-02-18T10:00:57.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== osd.2 v2:172.21.15.118:6817/1225011872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff234076a90 con 0x7ff234073fc0 2024-02-18T10:00:57.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7ff253fff640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff23406bd40 0x7ff23406e200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff24400aac0 tx=0x7ff244008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f0abed9d640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0146a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800cad0 tx=0x7f0ab800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800ac30 con 0x7f0ac01538c0 2024-02-18T10:00:57.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800ad90 con 0x7f0ac01538c0 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b78001030 con 0x7f8b98148f80 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.637+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f8554003d10 con 0x7f85640b8900 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f855affd640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f854406bd70 0x7f854406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8554042070 con 0x7f85640b8900 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f855affd640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f8544073ff0 0x7f8544076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8544076ac0 con 0x7f8544073ff0 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85540ad650 con 0x7f85640b8900 2024-02-18T10:00:57.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f855bfff640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f854406bd70 0x7f854406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.638+0000 7f688d435640 1 -- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f688806e090 msgr2=0x7f68880bd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688dc36640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f688806e090 0x7f68880bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688d435640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f688806e090 0x7f68880bd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688d435640 1 -- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6888148900 msgr2=0x7f68880a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688d435640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6888148900 0x7f68880a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688d435640 1 -- 172.21.15.118:0/1762048642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878009400 con 0x7f68880b93f0 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688dc36640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f688806e090 0x7f68880bd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688d435640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68880b93f0 0x7f68880a3d20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6880007fa0 tx=0x7f688000d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880003b90 con 0x7f68880b93f0 2024-02-18T10:00:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688000f040 con 0x7f68880b93f0 2024-02-18T10:00:57.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.639+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6888139620 con 0x7f68880b93f0 2024-02-18T10:00:57.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.640+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8012620 con 0x7f0ac01538c0 2024-02-18T10:00:57.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.640+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00b4ee0 con 0x7f0ac01538c0 2024-02-18T10:00:57.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.640+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac00b49c0 con 0x7f0ac01538c0 2024-02-18T10:00:57.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.640+0000 7f855bfff640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f854406bd70 0x7f854406e230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85641ebb10 tx=0x7f854c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.640+0000 7f8562d9d640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f8544073ff0 0x7f8544076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.640+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880004030 con 0x7f68880b93f0 2024-02-18T10:00:57.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.640+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68880a1ee0 con 0x7f68880b93f0 2024-02-18T10:00:57.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.642+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ac00bb010 con 0x7f0ac01538c0 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.641+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f8b88032070 con 0x7f8b98148f80 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.641+0000 7f8b8dffb640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b7c06bd70 0x7f8b7c06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.641+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b8803c070 con 0x7f8b98148f80 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.641+0000 7f8b8dffb640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f8b7c073ff0 0x7f8b7c076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.641+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 --> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b7c076ac0 con 0x7f8b7c073ff0 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.641+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b880abd70 con 0x7f8b98148f80 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.642+0000 7f8b9d3c6640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b7c06bd70 0x7f8b7c06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.642+0000 7f8b9d3c6640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b7c06bd70 0x7f8b7c06e230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009fd0 tx=0x7f8b9000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.641+0000 7f8562d9d640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f8544073ff0 0x7f8544076410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.642+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f6880004190 con 0x7f68880b93f0 2024-02-18T10:00:57.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.642+0000 7f687e7fc640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f686c06bd70 0x7f686c06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.642+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== osd.6 v2:172.21.15.164:6816/3123231040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8544076ac0 con 0x7f8544073ff0 2024-02-18T10:00:57.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f8b9cbc5640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f8b7c073ff0 0x7f8b7c076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f688dc36640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f686c06bd70 0x7f686c06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68880b9c40 con 0x7f68880b93f0 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f688dc36640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f686c06bd70 0x7f686c06e230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6884001370 tx=0x7f6884009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f688008a930 con 0x7f68880b93f0 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f687e7fc640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f686c073f70 0x7f686c076390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 --> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f686c076a40 con 0x7f686c073f70 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6880055230 con 0x7f68880b93f0 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f0ab8012780 con 0x7f0ac01538c0 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.643+0000 7f0ab6ffd640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0aa006bcc0 0x7f0aa006e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f0abe59c640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0aa006bcc0 0x7f0aa006e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f688e437640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f686c073f70 0x7f686c076390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ab8059270 con 0x7f0ac01538c0 2024-02-18T10:00:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f0ab6ffd640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7f0aa0074bb0 0x7f0aa0077050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0aa0077720 con 0x7f0aa0074bb0 2024-02-18T10:00:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ab8001b70 con 0x7f0ac01538c0 2024-02-18T10:00:57.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f8b9cbc5640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f8b7c073ff0 0x7f8b7c076410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f688e437640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f686c073f70 0x7f686c076390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f0ab7fff640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7f0aa0074bb0 0x7f0aa0077050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:57.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.644+0000 7f0abe59c640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0aa006bcc0 0x7f0aa006e180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0036000 tx=0x7f0ab003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.645+0000 7f0ab7fff640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7f0aa0074bb0 0x7f0aa0077050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.645+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== osd.5 v2:172.21.15.164:6800/2574652314 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8b7c076ac0 con 0x7f8b7c073ff0 2024-02-18T10:00:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.645+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== osd.7 v2:172.21.15.164:6824/3262371118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f686c076a40 con 0x7f686c073f70 2024-02-18T10:00:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.646+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== osd.4 v2:172.21.15.164:6802/748502063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0aa0077720 con 0x7f0aa0074bb0 2024-02-18T10:00:57.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.670+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 --> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e440bc380 con 0x7f1e30073ff0 2024-02-18T10:00:57.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.670+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 --> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3688006cf0 con 0x7f3674073f10 2024-02-18T10:00:57.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f367bfff640 1 -- 172.21.15.118:0/1683129565 <== osd.3 v2:172.21.15.118:6800/28144523 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f367c017040 con 0x7f3674073f10 2024-02-18T10:00:57.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7f3674073f10 msgr2=0x7f3674076330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f3694d17640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7f3674073f10 0x7f3674076330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f1e40ff9640 1 -- 172.21.15.118:0/2919398590 <== osd.0 v2:172.21.15.118:6808/2287683675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e3c034560 con 0x7f1e30073ff0 2024-02-18T10:00:57.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7f1e30073ff0 msgr2=0x7f1e30076410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f1e4a49a640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7f1e30073ff0 0x7f1e30076410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f367406bcf0 msgr2=0x7f367406e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f3694d17640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f367406bcf0 0x7f367406e1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3688008430 tx=0x7f369009a000 comp rx=0 tx=0).stop 2024-02-18T10:00:57.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688037900 msgr2=0x7f36880eb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f3694d17640 1 --2- 172.21.15.118:0/1683129565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3688037900 0x7f36880eb6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f368400c3c0 tx=0x7f368400c880 comp rx=0 tx=0).stop 2024-02-18T10:00:57.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f368ffff640 1 -- 172.21.15.118:0/1683129565 reap_dead start 2024-02-18T10:00:57.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 --> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5c08005c90 con 0x7f5c08001650 2024-02-18T10:00:57.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 shutdown_connections 2024-02-18T10:00:57.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 >> 172.21.15.118:0/1683129565 conn(0x7f3688005e80 msgr2=0x7f3688040270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1e3006bd70 msgr2=0x7f1e3006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f1e4a49a640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1e3006bd70 0x7f1e3006e230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e440a6400 tx=0x7f1e34009040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e440a6e60 msgr2=0x7f1e441e9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.671+0000 7f1e4a49a640 1 --2- 172.21.15.118:0/2919398590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e440a6e60 0x7f1e441e9060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e9b0 tx=0x7f1e3800ee70 comp rx=0 tx=0).stop 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f1e48a37640 1 -- 172.21.15.118:0/2919398590 reap_dead start 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 shutdown_connections 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 >> 172.21.15.118:0/2919398590 conn(0x7f1e440c15b0 msgr2=0x7f1e44145d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 shutdown_connections 2024-02-18T10:00:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 --> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2540bc250 con 0x7ff234073fc0 2024-02-18T10:00:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 shutdown_connections 2024-02-18T10:00:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f1e4a49a640 1 -- 172.21.15.118:0/2919398590 wait complete. 2024-02-18T10:00:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f3694d17640 1 -- 172.21.15.118:0/1683129565 wait complete. 2024-02-18T10:00:57.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.672+0000 7f5c167fc640 1 -- 172.21.15.118:0/2998864546 <== osd.1 v2:172.21.15.118:6816/2284297691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5c08005c90 con 0x7f5c08001650 2024-02-18T10:00:57.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.673+0000 7ff2517fa640 1 -- 172.21.15.118:0/3376936441 <== osd.2 v2:172.21.15.118:6817/1225011872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff24c009450 con 0x7ff234073fc0 2024-02-18T10:00:57.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.673+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f5c08001650 msgr2=0x7f5c08003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.673+0000 7f5c26f28640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f5c08001650 0x7f5c08003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.673+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7ff234073fc0 msgr2=0x7ff2340763e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.673+0000 7ff25a655640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7ff234073fc0 0x7ff2340763e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff23406bd40 msgr2=0x7ff23406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff23406bd40 0x7ff23406e200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff24400aac0 tx=0x7ff244008040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2540bd2b0 msgr2=0x7ff2540a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 --2- 172.21.15.118:0/3376936441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff2540bd2b0 0x7ff2540a6bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c4d0 tx=0x7ff23c00c990 comp rx=0 tx=0).stop 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff258bf2640 1 -- 172.21.15.118:0/3376936441 reap_dead start 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 shutdown_connections 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 >> 172.21.15.118:0/3376936441 conn(0x7ff2540c18e0 msgr2=0x7ff25414a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 shutdown_connections 2024-02-18T10:00:57.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7ff25a655640 1 -- 172.21.15.118:0/3376936441 wait complete. 2024-02-18T10:00:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5c0406bd70 msgr2=0x7f5c0406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7f5c26f28640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5c0406bd70 0x7f5c0406e230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c000f60 tx=0x7f5c1c007e00 comp rx=0 tx=0).stop 2024-02-18T10:00:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c20150b70 msgr2=0x7f5c2009be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7f5c26f28640 1 --2- 172.21.15.118:0/2998864546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c20150b70 0x7f5c2009be80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c100098c0 tx=0x7f5c100046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7f5c26727640 1 -- 172.21.15.118:0/2998864546 reap_dead start 2024-02-18T10:00:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 shutdown_connections 2024-02-18T10:00:57.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.674+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 >> 172.21.15.118:0/2998864546 conn(0x7f5c2006abe0 msgr2=0x7f5c2014a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.675+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 shutdown_connections 2024-02-18T10:00:57.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.675+0000 7f8568839640 1 -- 172.21.15.118:0/1829694910 --> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85640a2fa0 con 0x7f8544073ff0 2024-02-18T10:00:57.738 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.675+0000 7f5c26f28640 1 -- 172.21.15.118:0/2998864546 wait complete. 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.676+0000 7f855affd640 1 -- 172.21.15.118:0/1829694910 <== osd.6 v2:172.21.15.164:6816/3123231040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f855c00b800 con 0x7f8544073ff0 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8558ff9640 1 -- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f8544073ff0 msgr2=0x7f8544076410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8558ff9640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f8544073ff0 0x7f8544076410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8558ff9640 1 -- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f854406bd70 msgr2=0x7f854406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8558ff9640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f854406bd70 0x7f854406e230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85641ebb10 tx=0x7f854c009040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8558ff9640 1 -- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 msgr2=0x7f85641e3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8558ff9640 1 --2- 172.21.15.118:0/1829694910 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85640b8900 0x7f85641e3e10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8554034040 tx=0x7f85540046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8562d9d640 1 -- 172.21.15.118:0/1829694910 reap_dead start 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.677+0000 7f8558ff9640 1 -- 172.21.15.118:0/1829694910 shutdown_connections 2024-02-18T10:00:57.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f8558ff9640 1 -- 172.21.15.118:0/1829694910 >> 172.21.15.118:0/1829694910 conn(0x7f85640bd520 msgr2=0x7f85640bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 --> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b78002d30 con 0x7f8b7c073ff0 2024-02-18T10:00:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 --> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6888143070 con 0x7f686c073f70 2024-02-18T10:00:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f8558ff9640 1 -- 172.21.15.118:0/1829694910 shutdown_connections 2024-02-18T10:00:57.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f8558ff9640 1 -- 172.21.15.118:0/1829694910 wait complete. 2024-02-18T10:00:57.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 --> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ac0154420 con 0x7f0aa0074bb0 2024-02-18T10:00:57.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f8b8dffb640 1 -- 172.21.15.118:0/3327769033 <== osd.5 v2:172.21.15.164:6800/2574652314 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b78002d30 con 0x7f8b7c073ff0 2024-02-18T10:00:57.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.678+0000 7f687e7fc640 1 -- 172.21.15.118:0/1762048642 <== osd.7 v2:172.21.15.164:6824/3262371118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6878031910 con 0x7f686c073f70 2024-02-18T10:00:57.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f0ab6ffd640 1 -- 172.21.15.118:0/3513566828 <== osd.4 v2:172.21.15.164:6802/748502063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0aa8009890 con 0x7f0aa0074bb0 2024-02-18T10:00:57.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f8b7c073ff0 msgr2=0x7f8b7c076410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f8b7c073ff0 0x7f8b7c076410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b7c06bd70 msgr2=0x7f8b7c06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b7c06bd70 0x7f8b7c06e230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009fd0 tx=0x7f8b9000b040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b98148f80 msgr2=0x7f8b98149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 --2- 172.21.15.118:0/3327769033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b98148f80 0x7f8b98149430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b88031000 tx=0x7f8b88001ac0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9dbc7640 1 -- 172.21.15.118:0/3327769033 reap_dead start 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f686c073f70 msgr2=0x7f686c076390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f688fe9a640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f686c073f70 0x7f686c076390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 shutdown_connections 2024-02-18T10:00:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.679+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 >> 172.21.15.118:0/3327769033 conn(0x7f8b9809f3b0 msgr2=0x7f8b980bccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7f0aa0074bb0 msgr2=0x7f0aa0077050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0ac4d65640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7f0aa0074bb0 0x7f0aa0077050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0aa006bcc0 msgr2=0x7f0aa006e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0ac4d65640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0aa006bcc0 0x7f0aa006e180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0036000 tx=0x7f0ab003b040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 shutdown_connections 2024-02-18T10:00:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f8b9f62a640 1 -- 172.21.15.118:0/3327769033 wait complete. 2024-02-18T10:00:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f686c06bd70 msgr2=0x7f686c06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f686c06bd70 0x7f686c06e230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6884001370 tx=0x7f6884009040 comp rx=0 tx=0).stop 2024-02-18T10:00:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68880b93f0 msgr2=0x7f68880a3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 --2- 172.21.15.118:0/1762048642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f68880b93f0 0x7f68880a3d20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6880007fa0 tx=0x7f688000d560 comp rx=0 tx=0).stop 2024-02-18T10:00:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688e437640 1 -- 172.21.15.118:0/1762048642 reap_dead start 2024-02-18T10:00:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 msgr2=0x7f0ac0146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0ac4d65640 1 --2- 172.21.15.118:0/3513566828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ac01538c0 0x7f0ac0146a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800cad0 tx=0x7f0ab800cf90 comp rx=0 tx=0).stop 2024-02-18T10:00:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0abed9d640 1 -- 172.21.15.118:0/3513566828 reap_dead start 2024-02-18T10:00:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 shutdown_connections 2024-02-18T10:00:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 >> 172.21.15.118:0/1762048642 conn(0x7f68880bb1d0 msgr2=0x7f68881363c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 shutdown_connections 2024-02-18T10:00:57.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f688fe9a640 1 -- 172.21.15.118:0/1762048642 wait complete. 2024-02-18T10:00:57.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.680+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 shutdown_connections 2024-02-18T10:00:57.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.681+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 >> 172.21.15.118:0/3513566828 conn(0x7f0ac00b9c30 msgr2=0x7f0ac00bc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:57.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.681+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 shutdown_connections 2024-02-18T10:00:57.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.681+0000 7f0ac4d65640 1 -- 172.21.15.118:0/3513566828 wait complete. 2024-02-18T10:00:57.749 INFO:teuthology.orchestra.run.smithi118.stdout:55834574855 2024-02-18T10:00:57.749 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-02-18T10:00:57.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-18T10:00:57.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-18T10:00:57.751 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-02-18T10:00:57.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-18T10:00:57.752 INFO:teuthology.orchestra.run.smithi118.stdout:55834574855 2024-02-18T10:00:57.753 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-18T10:00:57.753 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:00:57.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-18T10:00:57.754 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-02-18T10:00:57.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-18T10:00:57.755 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:00:57.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-18T10:00:57.757 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:00:57.757 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-18T10:00:57.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.955+0000 7fa44b489640 1 Processor -- start 2024-02-18T10:00:58.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.955+0000 7fa44b489640 1 -- start start 2024-02-18T10:00:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.956+0000 7f402c22c640 1 Processor -- start 2024-02-18T10:00:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa44b489640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa444072130 0x7fa4440b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa44b489640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4440b2ea0 0x7fa44414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa44b489640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4440b98c0 con 0x7fa444150290 2024-02-18T10:00:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa44b489640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa444072510 con 0x7fa444072130 2024-02-18T10:00:58.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa44b489640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa444150bb0 con 0x7fa4440b2ea0 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.953+0000 7fa3be9ac640 1 Processor -- start 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.953+0000 7fa3be9ac640 1 -- start start 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be9ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142a80 0x7fa3b8148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be9ac640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3b8142ee0 0x7fa3b8149100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be9ac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b806e4d0 con 0x7fa3b80b9f30 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be9ac640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b806eac0 con 0x7fa3b8142ee0 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be9ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b806dba0 con 0x7fa3b8142a80 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be1ab640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3b8142ee0 0x7fa3b8149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be1ab640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3b8142ee0 0x7fa3b8149100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57630/0 (socket says 172.21.15.118:57630) 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.954+0000 7fa3be1ab640 1 -- 172.21.15.118:0/2231404633 learned_addr learned my addr 172.21.15.118:0/2231404633 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.955+0000 7fa3be1ab640 1 -- 172.21.15.118:0/2231404633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142a80 msgr2=0x7fa3b8148bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:00:58.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.955+0000 7fa3be1ab640 1 --2- 172.21.15.118:0/2231404633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142a80 0x7fa3b8148bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.955+0000 7fa3be1ab640 1 -- 172.21.15.118:0/2231404633 >> v1:172.21.15.164:6789/0 conn(0x7fa3b80b9f30 legacy=0x7fa3b8072900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.955+0000 7fa3be1ab640 1 -- 172.21.15.118:0/2231404633 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b806de80 con 0x7fa3b8142ee0 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.956+0000 7fa3be1ab640 1 --2- 172.21.15.118:0/2231404633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142ee0 0x7fa3b8149100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009870 tx=0x7fa3a802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d324f648f2d39b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.956+0000 7fa3bc9a8640 1 -- 172.21.15.118:0/2231404633 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8031750 con 0x7fa3b8142ee0 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.956+0000 7fa3bc9a8640 1 -- 172.21.15.118:0/2231404633 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a80318b0 con 0x7fa3b8142ee0 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa449c86640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4440b2ea0 0x7fa44414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa449c86640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa4440b2ea0 0x7fa44414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41136/0 (socket says 172.21.15.118:41136) 2024-02-18T10:00:58.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa449c86640 1 -- 172.21.15.118:0/2367856722 learned_addr learned my addr 172.21.15.118:0/2367856722 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.956+0000 7f402c22c640 1 -- start start 2024-02-18T10:00:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7f402c22c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40241538c0 0x7f4024151550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7f402c22c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4024158970 0x7f402415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7f402c22c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240b33c0 con 0x7f40240a30f0 2024-02-18T10:00:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7f402c22c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240b2a90 con 0x7f4024158970 2024-02-18T10:00:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7f402c22c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b2d70 con 0x7f40241538c0 2024-02-18T10:00:58.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7f1c8ecaa640 1 Processor -- start 2024-02-18T10:00:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa3be9ac640 1 -- 172.21.15.118:0/2231404633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142ee0 msgr2=0x7fa3b8149100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/2231404633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142ee0 0x7fa3b8149100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009870 tx=0x7fa3a802b7f0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa3be9ac640 1 -- 172.21.15.118:0/2231404633 shutdown_connections 2024-02-18T10:00:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/2231404633 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142ee0 0x7fa3b8149100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/2231404633 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142a80 0x7fa3b8148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa3be9ac640 1 -- 172.21.15.118:0/2231404633 >> 172.21.15.118:0/2231404633 conn(0x7fa3b806bcf0 msgr2=0x7fa3b806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f4029fc8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40241538c0 0x7f4024151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f4029fc8640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40241538c0 0x7f4024151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:54486/0 (socket says 172.21.15.118:54486) 2024-02-18T10:00:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f4029fc8640 1 -- 172.21.15.118:0/1745402300 learned_addr learned my addr 172.21.15.118:0/1745402300 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7fa3be9ac640 1 -- 172.21.15.118:0/2231404633 shutdown_connections 2024-02-18T10:00:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f402a7c9640 1 --2- 172.21.15.118:0/1745402300 >> v2:172.21.15.164:3300/0 conn(0x7f4024158970 0x7f402415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7fa3be9ac640 1 -- 172.21.15.118:0/2231404633 wait complete. 2024-02-18T10:00:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f97c329a640 1 Processor -- start 2024-02-18T10:00:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f4029fc8640 1 -- 172.21.15.118:0/1745402300 >> v2:172.21.15.164:3300/0 conn(0x7f4024158970 msgr2=0x7f402415ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f4029fc8640 1 --2- 172.21.15.118:0/1745402300 >> v2:172.21.15.164:3300/0 conn(0x7f4024158970 0x7f402415ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f4029fc8640 1 -- 172.21.15.118:0/1745402300 >> v1:172.21.15.118:6789/0 conn(0x7f40240a30f0 legacy=0x7f402414a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f4029fc8640 1 -- 172.21.15.118:0/1745402300 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240b3050 con 0x7f40241538c0 2024-02-18T10:00:58.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f402a7c9640 1 --2- 172.21.15.118:0/1745402300 >> v2:172.21.15.164:3300/0 conn(0x7f4024158970 0x7f402415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:58.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7f1c8ecaa640 1 -- start start 2024-02-18T10:00:58.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.958+0000 7f97c329a640 1 -- start start 2024-02-18T10:00:58.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7fee0502a640 1 Processor -- start 2024-02-18T10:00:58.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7fee0502a640 1 -- start start 2024-02-18T10:00:58.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa449c86640 1 -- 172.21.15.118:0/2367856722 >> v2:172.21.15.118:3300/0 conn(0x7fa444072130 msgr2=0x7fa4440b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa449c86640 1 --2- 172.21.15.118:0/2367856722 >> v2:172.21.15.118:3300/0 conn(0x7fa444072130 0x7fa4440b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa449c86640 1 -- 172.21.15.118:0/2367856722 >> v1:172.21.15.164:6789/0 conn(0x7fa444150290 legacy=0x7fa4441532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.957+0000 7fa449c86640 1 -- 172.21.15.118:0/2367856722 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44406d6f0 con 0x7fa4440b2ea0 2024-02-18T10:00:58.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7fa3be9ac640 1 Processor -- start 2024-02-18T10:00:58.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7f97c329a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc0bd2b0 0x7f97bc14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7f97c329a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f97bc14c510 0x7f97bc156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7fa449c86640 1 --2- 172.21.15.118:0/2367856722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4440b2ea0 0x7fa44414fd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa44406e550 tx=0x7fa43c02bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ad8b0eea55404f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ecaa640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1c880b9d20 0x7f1c8806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c329a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97bc0b4e10 con 0x7f97bc06bbe0 2024-02-18T10:00:58.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ecaa640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1c8814ba20 0x7f1c88145940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c329a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97bc0bdc20 con 0x7f97bc14c510 2024-02-18T10:00:58.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c329a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0bc5c0 con 0x7f97bc0bd2b0 2024-02-18T10:00:58.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c1837640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f97bc14c510 0x7f97bc156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c1837640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f97bc14c510 0x7f97bc156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57658/0 (socket says 172.21.15.118:57658) 2024-02-18T10:00:58.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fee0502a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee000b2fd0 0x7fee0014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fee0502a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0009de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa449485640 1 -- 172.21.15.118:0/2367856722 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c02cb10 con 0x7fa4440b2ea0 2024-02-18T10:00:58.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c1837640 1 -- 172.21.15.118:0/3993519092 learned_addr learned my addr 172.21.15.118:0/3993519092 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ecaa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c0835640 1 --2- 172.21.15.118:0/3993519092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc0bd2b0 0x7f97bc14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa449485640 1 -- 172.21.15.118:0/2367856722 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c02cc70 con 0x7fa4440b2ea0 2024-02-18T10:00:58.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ecaa640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8814f970 con 0x7f1c8814ba20 2024-02-18T10:00:58.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ecaa640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8814fe00 con 0x7f1c880b9d20 2024-02-18T10:00:58.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fee0502a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee000b3be0 con 0x7fee0009e3b0 2024-02-18T10:00:58.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fee0502a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0014f120 con 0x7fee000b2fd0 2024-02-18T10:00:58.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fee0502a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0014f400 con 0x7fee000b33b0 2024-02-18T10:00:58.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f4029fc8640 1 --2- 172.21.15.118:0/1745402300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40241538c0 0x7f4024151550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f401c009e80 tx=0x7f401c02bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6c75de37ac11a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ecaa640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8814f040 con 0x7f1c88145e80 2024-02-18T10:00:58.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ca46640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1c880b9d20 0x7f1c8806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fedf7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0009de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8d247640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fedfed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fee000b2fd0 0x7fee0014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ca46640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1c880b9d20 0x7f1c8806ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41152/0 (socket says 172.21.15.118:41152) 2024-02-18T10:00:58.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ca46640 1 -- 172.21.15.118:0/1248896334 learned_addr learned my addr 172.21.15.118:0/1248896334 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.959+0000 7fa3be9ac640 1 -- start start 2024-02-18T10:00:58.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fedf7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0009de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:54496/0 (socket says 172.21.15.118:54496) 2024-02-18T10:00:58.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fedf7fff640 1 -- 172.21.15.118:0/1444071868 learned_addr learned my addr 172.21.15.118:0/1444071868 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa3be9ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3b80b9f30 0x7fa3b81438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa3be9ac640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142a80 0x7fa3b81388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa3be9ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142ee0 0x7fa3b8140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f4028fc6640 1 -- 172.21.15.118:0/1745402300 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c02cb70 con 0x7f40241538c0 2024-02-18T10:00:58.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa3be9ac640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b81425c0 con 0x7fa3b8142a80 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f4028fc6640 1 -- 172.21.15.118:0/1745402300 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c02ccd0 con 0x7f40241538c0 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c87fff640 1 --2- 172.21.15.118:0/1248896334 >> v2:172.21.15.118:3300/0 conn(0x7f1c8814ba20 0x7f1c88145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ca46640 1 -- 172.21.15.118:0/1248896334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 msgr2=0x7f1c8806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ca46640 1 --2- 172.21.15.118:0/1248896334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ca46640 1 -- 172.21.15.118:0/1248896334 >> v2:172.21.15.118:3300/0 conn(0x7f1c8814ba20 msgr2=0x7f1c88145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f1c8ca46640 1 --2- 172.21.15.118:0/1248896334 >> v2:172.21.15.118:3300/0 conn(0x7f1c8814ba20 0x7f1c88145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7f1c8ca46640 1 -- 172.21.15.118:0/1248896334 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8814f320 con 0x7f1c880b9d20 2024-02-18T10:00:58.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7f1c87fff640 1 --2- 172.21.15.118:0/1248896334 >> v2:172.21.15.118:3300/0 conn(0x7f1c8814ba20 0x7f1c88145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa44b489640 1 -- 172.21.15.118:0/2367856722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4440b2ea0 msgr2=0x7fa44414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa44b489640 1 --2- 172.21.15.118:0/2367856722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4440b2ea0 0x7fa44414fd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa44406e550 tx=0x7fa43c02bf70 comp rx=0 tx=0).stop 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa44b489640 1 -- 172.21.15.118:0/2367856722 shutdown_connections 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa44b489640 1 --2- 172.21.15.118:0/2367856722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa4440b2ea0 0x7fa44414fd50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa44b489640 1 --2- 172.21.15.118:0/2367856722 >> v2:172.21.15.118:3300/0 conn(0x7fa444072130 0x7fa4440b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa44b489640 1 -- 172.21.15.118:0/2367856722 >> 172.21.15.118:0/2367856722 conn(0x7fa4440b9b90 msgr2=0x7fa4440b9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fa44b489640 1 -- 172.21.15.118:0/2367856722 shutdown_connections 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fa44b489640 1 -- 172.21.15.118:0/2367856722 wait complete. 2024-02-18T10:00:58.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c1837640 1 -- 172.21.15.118:0/3993519092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc0bd2b0 msgr2=0x7f97bc14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7f97c1837640 1 --2- 172.21.15.118:0/3993519092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc0bd2b0 0x7f97bc14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7f97c1837640 1 -- 172.21.15.118:0/3993519092 >> v1:172.21.15.118:6789/0 conn(0x7f97bc06bbe0 legacy=0x7f97bc149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7f97c1837640 1 -- 172.21.15.118:0/3993519092 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc14c980 con 0x7f97bc14c510 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f97c1837640 1 --2- 172.21.15.118:0/3993519092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc156650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009e50 tx=0x7f97b402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579b7998e22bd1b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa3be9ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8148720 con 0x7fa3b80b9f30 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.960+0000 7fa3be9ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8143e10 con 0x7fa3b8142ee0 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142a80 0x7fa3b81388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142a80 0x7fa3b81388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57676/0 (socket says 172.21.15.118:57676) 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 -- 172.21.15.118:0/186788906 learned_addr learned my addr 172.21.15.118:0/186788906 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd9aa640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3b80b9f30 0x7fa3b81438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 -- 172.21.15.118:0/186788906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142ee0 msgr2=0x7fa3b8140510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142ee0 0x7fa3b8140510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 -- 172.21.15.118:0/186788906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3b80b9f30 msgr2=0x7fa3b81438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3b80b9f30 0x7fa3b81438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fa3bd1a9640 1 -- 172.21.15.118:0/186788906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80094d0 con 0x7fa3b8142a80 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fa3bd1a9640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142a80 0x7fa3b81388a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400b450 tx=0x7fa3b400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fedfed9d640 1 -- 172.21.15.118:0/1444071868 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 msgr2=0x7fee0009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fedfed9d640 1 --2- 172.21.15.118:0/1444071868 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0009de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fedfed9d640 1 -- 172.21.15.118:0/1444071868 >> v1:172.21.15.164:6789/0 conn(0x7fee0009e3b0 legacy=0x7fee00145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fedfed9d640 1 -- 172.21.15.118:0/1444071868 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0014f6e0 con 0x7fee000b2fd0 2024-02-18T10:00:58.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fef56a64640 1 Processor -- start 2024-02-18T10:00:58.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7fef56a64640 1 -- start start 2024-02-18T10:00:58.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f1c8ca46640 1 --2- 172.21.15.118:0/1248896334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c880b9d20 0x7f1c8806ef90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c88073160 tx=0x7f1c7c02b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b9b17cfb82b58a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7f402c22c640 1 -- 172.21.15.118:0/1745402300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40241538c0 msgr2=0x7f4024151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.961+0000 7f402c22c640 1 --2- 172.21.15.118:0/1745402300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40241538c0 0x7f4024151550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f401c009e80 tx=0x7f401c02bfd0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f402c22c640 1 -- 172.21.15.118:0/1745402300 shutdown_connections 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f402c22c640 1 --2- 172.21.15.118:0/1745402300 >> v2:172.21.15.164:3300/0 conn(0x7f4024158970 0x7f402415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f402c22c640 1 --2- 172.21.15.118:0/1745402300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40241538c0 0x7f4024151550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f402c22c640 1 -- 172.21.15.118:0/1745402300 >> 172.21.15.118:0/1745402300 conn(0x7f40240b9c30 msgr2=0x7f40240ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f402c22c640 1 -- 172.21.15.118:0/1745402300 shutdown_connections 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f402c22c640 1 -- 172.21.15.118:0/1745402300 wait complete. 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef56a64640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fef48008df0 0x7fef4803f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef56a64640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fef480cf000 0x7fef480cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f5fe5de7640 1 Processor -- start 2024-02-18T10:00:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f5fe5de7640 1 -- start start 2024-02-18T10:00:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fedfed9d640 1 --2- 172.21.15.118:0/1444071868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee000b2fd0 0x7fee0014fc00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fedf00097a0 tx=0x7fedf002b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b435b69b93fb633 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef56a64640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef480d89b0 con 0x7fef480d53e0 2024-02-18T10:00:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef56a64640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480d8c90 con 0x7fef48008df0 2024-02-18T10:00:58.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef56a64640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480d8f70 con 0x7fef480cf000 2024-02-18T10:00:58.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fedfe59c640 1 -- 172.21.15.118:0/1444071868 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0030710 con 0x7fee000b2fd0 2024-02-18T10:00:58.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f1c877fe640 1 -- 172.21.15.118:0/1248896334 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c030850 con 0x7f1c880b9d20 2024-02-18T10:00:58.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f1c877fe640 1 -- 172.21.15.118:0/1248896334 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0309b0 con 0x7f1c880b9d20 2024-02-18T10:00:58.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7f1c877fe640 1 -- 172.21.15.118:0/1248896334 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c030d40 con 0x7f1c880b9d20 2024-02-18T10:00:58.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fedfe59c640 1 -- 172.21.15.118:0/1444071868 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf002e050 con 0x7fee000b2fd0 2024-02-18T10:00:58.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fedfe59c640 1 -- 172.21.15.118:0/1444071868 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0030ad0 con 0x7fee000b2fd0 2024-02-18T10:00:58.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef55001640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fef480d53e0 0x7fef480d5830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47044/0 (socket says 172.21.15.118:47044) 2024-02-18T10:00:58.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef55001640 1 -- 172.21.15.118:0/2997436929 learned_addr learned my addr 172.21.15.118:0/2997436929 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:58.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.963+0000 7f5fe5de7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.963+0000 7f5fe4de5640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5fe0145e50 0x7f5fe00b9c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:34102/0 (socket says 172.21.15.118:34102) 2024-02-18T10:00:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.963+0000 7fa44b489640 1 Processor -- start 2024-02-18T10:00:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.963+0000 7fee0502a640 1 -- 172.21.15.118:0/1444071868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee000b2fd0 msgr2=0x7fee0014fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.963+0000 7fee0502a640 1 --2- 172.21.15.118:0/1444071868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee000b2fd0 0x7fee0014fc00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fedf00097a0 tx=0x7fedf002b7b0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fa3ae7fc640 1 -- 172.21.15.118:0/186788906 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011890 con 0x7fa3b8142a80 2024-02-18T10:00:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.963+0000 7f5fe4de5640 1 -- 172.21.15.118:0/1328345262 learned_addr learned my addr 172.21.15.118:0/1328345262 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b8146820 con 0x7fa3b8142a80 2024-02-18T10:00:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fa3ae7fc640 1 -- 172.21.15.118:0/186788906 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4011a10 con 0x7fa3b8142a80 2024-02-18T10:00:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.963+0000 7f97b3fff640 1 -- 172.21.15.118:0/3993519092 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b402c9f0 con 0x7f97bc14c510 2024-02-18T10:00:58.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f97b3fff640 1 -- 172.21.15.118:0/3993519092 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b402cb50 con 0x7f97bc14c510 2024-02-18T10:00:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f97b3fff640 1 -- 172.21.15.118:0/3993519092 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b40343f0 con 0x7f97bc14c510 2024-02-18T10:00:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f402c22c640 1 Processor -- start 2024-02-18T10:00:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fee0502a640 1 -- 172.21.15.118:0/1444071868 shutdown_connections 2024-02-18T10:00:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fee0502a640 1 --2- 172.21.15.118:0/1444071868 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0009de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fee0502a640 1 --2- 172.21.15.118:0/1444071868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee000b2fd0 0x7fee0014fc00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fee0502a640 1 -- 172.21.15.118:0/1444071868 >> 172.21.15.118:0/1444071868 conn(0x7fee000b9c30 msgr2=0x7fee000ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.962+0000 7fef54800640 1 --2- 172.21.15.118:0/2997436929 >> v2:172.21.15.118:3300/0 conn(0x7fef48008df0 0x7fef4803f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/1328345262 >> v2:172.21.15.164:3300/0 conn(0x7f5fe014f5e0 0x7f5fe0156330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fa3ae7fc640 1 -- 172.21.15.118:0/186788906 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011dc0 con 0x7fa3b8142a80 2024-02-18T10:00:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b8139750 con 0x7fa3b8142a80 2024-02-18T10:00:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/1248896334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c880b9d20 msgr2=0x7f1c8806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/1248896334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c880b9d20 0x7f1c8806ef90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c88073160 tx=0x7f1c7c02b990 comp rx=0 tx=0).stop 2024-02-18T10:00:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe0072a90 con 0x7f5fe0145e50 2024-02-18T10:00:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe006dd70 con 0x7f5fe014f5e0 2024-02-18T10:00:58.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0146230 con 0x7f5fe0071100 2024-02-18T10:00:58.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f402c22c640 1 -- start start 2024-02-18T10:00:58.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fef4ffff640 1 --2- 172.21.15.118:0/2997436929 >> v2:172.21.15.164:3300/0 conn(0x7fef480cf000 0x7fef480cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fef54800640 1 -- 172.21.15.118:0/2997436929 >> v2:172.21.15.164:3300/0 conn(0x7fef480cf000 msgr2=0x7fef480cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f5fdffff640 1 --2- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fef54800640 1 --2- 172.21.15.118:0/2997436929 >> v2:172.21.15.164:3300/0 conn(0x7fef480cf000 0x7fef480cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fef54800640 1 -- 172.21.15.118:0/2997436929 >> v1:172.21.15.118:6789/0 conn(0x7fef480d53e0 legacy=0x7fef480d5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fef54800640 1 -- 172.21.15.118:0/2997436929 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef480d9250 con 0x7fef48008df0 2024-02-18T10:00:58.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/1248896334 shutdown_connections 2024-02-18T10:00:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/1248896334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/1248896334 >> v2:172.21.15.118:3300/0 conn(0x7f1c8814ba20 0x7f1c88145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/1248896334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c880b9d20 0x7f1c8806ef90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/1248896334 >> 172.21.15.118:0/1248896334 conn(0x7f1c8806bcf0 msgr2=0x7f1c8806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fee0502a640 1 -- 172.21.15.118:0/1444071868 shutdown_connections 2024-02-18T10:00:58.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/1248896334 shutdown_connections 2024-02-18T10:00:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f5fe55e6640 1 --2- 172.21.15.118:0/1328345262 >> v2:172.21.15.164:3300/0 conn(0x7f5fe014f5e0 0x7f5fe0156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7f5fdf7fe640 1 -- 172.21.15.118:0/1328345262 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879761595 0 0) 0x7f5fe0072a90 con 0x7f5fe0145e50 2024-02-18T10:00:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fa44b489640 1 -- start start 2024-02-18T10:00:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44b489640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa444072130 0x7fa4441ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44b489640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4440b2ea0 0x7fa44414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44b489640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa444150290 0x7fa4441538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44b489640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440a0b50 con 0x7fa4440b2ea0 2024-02-18T10:00:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44b489640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440a1c30 con 0x7fa444150290 2024-02-18T10:00:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44b489640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440a1f10 con 0x7fa444072130 2024-02-18T10:00:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44ac88640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa444150290 0x7fa4441538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44ac88640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa444150290 0x7fa4441538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41200/0 (socket says 172.21.15.118:41200) 2024-02-18T10:00:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa44ac88640 1 -- 172.21.15.118:0/105759216 learned_addr learned my addr 172.21.15.118:0/105759216 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b8146680 con 0x7fa3b8142a80 2024-02-18T10:00:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7fef54800640 1 --2- 172.21.15.118:0/2997436929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef48008df0 0x7fef4803f7f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef4803f230 tx=0x7fef4402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e057ef57d8eb3e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/1248896334 wait complete. 2024-02-18T10:00:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f5fe55e6640 1 -- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 msgr2=0x7f5fe014f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f5fe55e6640 1 --2- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe014f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f5fe55e6640 1 -- 172.21.15.118:0/1328345262 >> v1:172.21.15.164:6789/0 conn(0x7f5fe0145e50 legacy=0x7f5fe00b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f5fe55e6640 1 -- 172.21.15.118:0/1328345262 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe014fa70 con 0x7f5fe014f5e0 2024-02-18T10:00:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f402c22c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40240a30f0 0x7f40240713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f402c22c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40241538c0 0x7f4024072510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f402c22c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4024158970 0x7f402406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f402c22c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024138c40 con 0x7f40240a30f0 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f402c22c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024072150 con 0x7f40241538c0 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f402c22c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b4740 con 0x7f4024158970 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.964+0000 7fee0502a640 1 -- 172.21.15.118:0/1444071868 wait complete. 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f4029fc8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40240a30f0 0x7f40240713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f4029fc8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40240a30f0 0x7f40240713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57702/0 (socket says 172.21.15.118:57702) 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.965+0000 7f4029fc8640 1 -- 172.21.15.118:0/2066340524 learned_addr learned my addr 172.21.15.118:0/2066340524 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa449c86640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4440b2ea0 0x7fa44414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa44a487640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa444072130 0x7fa4441ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa44ac88640 1 -- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa444072130 msgr2=0x7fa4441ee060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa44ac88640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa444072130 0x7fa4441ee060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa44ac88640 1 -- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4440b2ea0 msgr2=0x7fa44414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa44ac88640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4440b2ea0 0x7fa44414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa44ac88640 1 -- 172.21.15.118:0/105759216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009b30 con 0x7fa444150290 2024-02-18T10:00:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f40297c7640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40241538c0 0x7f4024072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f402a7c9640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4024158970 0x7f402406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f97c329a640 1 -- 172.21.15.118:0/3993519092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 msgr2=0x7f97bc156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f97c329a640 1 --2- 172.21.15.118:0/3993519092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc156650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009e50 tx=0x7f97b402be50 comp rx=0 tx=0).stop 2024-02-18T10:00:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fef4f7fe640 1 -- 172.21.15.118:0/2997436929 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44030710 con 0x7fef48008df0 2024-02-18T10:00:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fef4f7fe640 1 -- 172.21.15.118:0/2997436929 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4402e050 con 0x7fef48008df0 2024-02-18T10:00:58.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fee0502a640 1 Processor -- start 2024-02-18T10:00:58.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f5fe55e6640 1 --2- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 0x7f5fe0156330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=543920d89453a512 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa44ac88640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa444150290 0x7fa4441538e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c3c0 tx=0x7fa44000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa3ae7fc640 1 -- 172.21.15.118:0/186788906 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fa3b401a400 con 0x7fa3b8142a80 2024-02-18T10:00:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f40297c7640 1 -- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4024158970 msgr2=0x7f402406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f40297c7640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4024158970 0x7f402406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f40297c7640 1 -- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40240a30f0 msgr2=0x7f40240713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f40297c7640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40240a30f0 0x7f40240713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fef4f7fe640 1 -- 172.21.15.118:0/2997436929 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44030a70 con 0x7fef48008df0 2024-02-18T10:00:58.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f40297c7640 1 -- 172.21.15.118:0/2066340524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c009b30 con 0x7f40241538c0 2024-02-18T10:00:58.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f5fdf7fe640 1 -- 172.21.15.118:0/1328345262 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd802cc50 con 0x7f5fe014f5e0 2024-02-18T10:00:58.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f40297c7640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40241538c0 0x7f4024072510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f401400c390 tx=0x7f401400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7f1c8ecaa640 1 Processor -- start 2024-02-18T10:00:58.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fa43affd640 1 -- 172.21.15.118:0/105759216 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400052d0 con 0x7fa444150290 2024-02-18T10:00:58.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f1c8ecaa640 1 -- start start 2024-02-18T10:00:58.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f5fdf7fe640 1 -- 172.21.15.118:0/1328345262 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd802cdb0 con 0x7f5fe014f5e0 2024-02-18T10:00:58.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f5fdf7fe640 1 -- 172.21.15.118:0/1328345262 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8034660 con 0x7f5fe014f5e0 2024-02-18T10:00:58.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4440a0da0 con 0x7fa444150290 2024-02-18T10:00:58.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4440a0240 con 0x7fa444150290 2024-02-18T10:00:58.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fa3ae7fc640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa39c06bc70 0x7fa39c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fa43affd640 1 -- 172.21.15.118:0/105759216 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440005450 con 0x7fa444150290 2024-02-18T10:00:58.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fef56a64640 1 -- 172.21.15.118:0/2997436929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef48008df0 msgr2=0x7fef4803f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fef56a64640 1 --2- 172.21.15.118:0/2997436929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef48008df0 0x7fef4803f7f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef4803f230 tx=0x7fef4402b710 comp rx=0 tx=0).stop 2024-02-18T10:00:58.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f97c329a640 1 -- 172.21.15.118:0/3993519092 shutdown_connections 2024-02-18T10:00:58.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f97c329a640 1 --2- 172.21.15.118:0/3993519092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc156650 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f97c329a640 1 --2- 172.21.15.118:0/3993519092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc0bd2b0 0x7f97bc14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f97c329a640 1 -- 172.21.15.118:0/3993519092 >> 172.21.15.118:0/3993519092 conn(0x7f97bc0c18e0 msgr2=0x7f97bc0c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fa3ae7fc640 1 -- 172.21.15.118:0/186788906 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3b4058980 con 0x7fa3b8142a80 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.966+0000 7fee0502a640 1 -- start start 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fee0502a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee0009e3b0 0x7fee00149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fee0502a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0014c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fee0502a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee00147930 0x7fee00148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fee0502a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0014c8f0 con 0x7fee00147930 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fee0502a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000b6d30 con 0x7fee0009e3b0 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fee0502a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee00146ee0 con 0x7fee000b33b0 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fedfed9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee0009e3b0 0x7fee00149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fedfed9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee0009e3b0 0x7fee00149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41220/0 (socket says 172.21.15.118:41220) 2024-02-18T10:00:58.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fedfed9d640 1 -- 172.21.15.118:0/724385264 learned_addr learned my addr 172.21.15.118:0/724385264 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7fedff59e640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee00147930 0x7fee00148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f401a7fc640 1 -- 172.21.15.118:0/2066340524 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40140052d0 con 0x7f40241538c0 2024-02-18T10:00:58.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.967+0000 7f401a7fc640 1 -- 172.21.15.118:0/2066340524 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4014005430 con 0x7f40241538c0 2024-02-18T10:00:58.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fef56a64640 1 -- 172.21.15.118:0/2997436929 shutdown_connections 2024-02-18T10:00:58.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fef56a64640 1 --2- 172.21.15.118:0/2997436929 >> v2:172.21.15.164:3300/0 conn(0x7fef480cf000 0x7fef480cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fef56a64640 1 --2- 172.21.15.118:0/2997436929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef48008df0 0x7fef4803f7f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fef56a64640 1 -- 172.21.15.118:0/2997436929 >> 172.21.15.118:0/2997436929 conn(0x7fef4803ffe0 msgr2=0x7fef480403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fa43affd640 1 -- 172.21.15.118:0/105759216 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440007260 con 0x7fa444150290 2024-02-18T10:00:58.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fedf7fff640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0014c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c8ecaa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c880b9d20 0x7f1c881419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 msgr2=0x7f5fe0156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 0x7f5fe0156330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009d90 tx=0x7f5fd802bea0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f401a7fc640 1 -- 172.21.15.118:0/2066340524 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014003810 con 0x7f40241538c0 2024-02-18T10:00:58.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4024138960 con 0x7f40241538c0 2024-02-18T10:00:58.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402415b3e0 con 0x7f40241538c0 2024-02-18T10:00:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c8ecaa640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8809f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fedff59e640 1 -- 172.21.15.118:0/724385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 msgr2=0x7fee0014c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fedff59e640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0014c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fedff59e640 1 -- 172.21.15.118:0/724385264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee0009e3b0 msgr2=0x7fee00149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fedff59e640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee0009e3b0 0x7fee00149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fedff59e640 1 -- 172.21.15.118:0/724385264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0009400 con 0x7fee00147930 2024-02-18T10:00:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fef56a64640 1 -- 172.21.15.118:0/2997436929 shutdown_connections 2024-02-18T10:00:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c8ecaa640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c8814ba20 0x7f1c8809e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fef56a64640 1 -- 172.21.15.118:0/2997436929 wait complete. 2024-02-18T10:00:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fedff59e640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee00147930 0x7fee00148220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c8d0 tx=0x7fedf800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c8ecaa640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c88141f00 con 0x7f1c880b9d20 2024-02-18T10:00:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c87fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8809f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c8ca46640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c880b9d20 0x7f1c881419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c8ca46640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c880b9d20 0x7f1c881419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57716/0 (socket says 172.21.15.118:57716) 2024-02-18T10:00:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7f1c8ca46640 1 -- 172.21.15.118:0/2329290719 learned_addr learned my addr 172.21.15.118:0/2329290719 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.968+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c005290 con 0x7fa444150290 2024-02-18T10:00:58.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c8d247640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c8814ba20 0x7f1c8809e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 shutdown_connections 2024-02-18T10:00:58.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 0x7f5fe0156330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/1328345262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe014f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 >> 172.21.15.118:0/1328345262 conn(0x7f5fe00bad40 msgr2=0x7f5fe00bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7fa3bd9aa640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa39c06bc70 0x7fa39c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f97c329a640 1 -- 172.21.15.118:0/3993519092 shutdown_connections 2024-02-18T10:00:58.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 shutdown_connections 2024-02-18T10:00:58.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f5fe5de7640 1 -- 172.21.15.118:0/1328345262 wait complete. 2024-02-18T10:00:58.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880a0490 con 0x7f1c8814ba20 2024-02-18T10:00:58.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c880bdb20 con 0x7f1c88145e80 2024-02-18T10:00:58.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f97c329a640 1 -- 172.21.15.118:0/3993519092 wait complete. 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7fa3bd9aa640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa39c06bc70 0x7fa39c06e130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0007410 tx=0x7fa3b0015040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c87fff640 1 -- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c8814ba20 msgr2=0x7f1c8809e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c87fff640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c8814ba20 0x7f1c8809e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c87fff640 1 -- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c880b9d20 msgr2=0x7f1c881419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c87fff640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c880b9d20 0x7f1c881419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c87fff640 1 -- 172.21.15.118:0/2329290719 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0094d0 con 0x7f1c88145e80 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c8ca46640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c880b9d20 0x7f1c881419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:58.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.969+0000 7f1c8d247640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c8814ba20 0x7f1c8809e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:58.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7f1c87fff640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8809f860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400c5e0 tx=0x7f1c7400caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402406fcb0 con 0x7f40241538c0 2024-02-18T10:00:58.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7fef56a64640 1 Processor -- start 2024-02-18T10:00:58.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7f1c857fa640 1 -- 172.21.15.118:0/2329290719 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74011800 con 0x7f1c88145e80 2024-02-18T10:00:58.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7fa43affd640 1 -- 172.21.15.118:0/105759216 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fa440007480 con 0x7fa444150290 2024-02-18T10:00:58.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7fef56a64640 1 -- start start 2024-02-18T10:00:58.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7f5fe5de7640 1 Processor -- start 2024-02-18T10:00:58.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7f5fe5de7640 1 -- start start 2024-02-18T10:00:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7fa43affd640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42806bd70 0x7fa42806e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7fa43affd640 1 -- 172.21.15.118:0/105759216 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa440089970 con 0x7fa444150290 2024-02-18T10:00:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7fa44a487640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42806bd70 0x7fa42806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7f97c329a640 1 Processor -- start 2024-02-18T10:00:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.970+0000 7f1c857fa640 1 -- 172.21.15.118:0/2329290719 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74011960 con 0x7f1c88145e80 2024-02-18T10:00:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f1c857fa640 1 -- 172.21.15.118:0/2329290719 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74011800 con 0x7f1c88145e80 2024-02-18T10:00:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c880a0be0 con 0x7f1c88145e80 2024-02-18T10:00:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c880bd840 con 0x7f1c88145e80 2024-02-18T10:00:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f401a7fc640 1 -- 172.21.15.118:0/2066340524 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f4014003970 con 0x7f40241538c0 2024-02-18T10:00:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7fef56a64640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008df0 0x7fef48161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7fef56a64640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef480cf000 0x7fef48160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f5fe5de7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe00a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7fef54800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008df0 0x7fef48161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f97c329a640 1 -- start start 2024-02-18T10:00:58.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f97c329a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc06bbe0 0x7f97bc147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f5fe5de7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe0145e50 0x7f5fe014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f5fe5de7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 0x7f5fe009de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7f5fe5de7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe014eb20 con 0x7f5fe0145e50 2024-02-18T10:00:58.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fe5de7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01e5380 con 0x7f5fe014f5e0 2024-02-18T10:00:58.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fe5de7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00a3280 con 0x7f5fe0071100 2024-02-18T10:00:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f401a7fc640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f400806bd40 0x7f400806e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c329a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97bc0bd2b0 0x7f97bc0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fe55e6640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 0x7f5fe009de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe0145e50 0x7f5fe014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe0145e50 0x7f5fe014e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57724/0 (socket says 172.21.15.118:57724) 2024-02-18T10:00:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 -- 172.21.15.118:0/790482906 learned_addr learned my addr 172.21.15.118:0/790482906 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f401a7fc640 1 -- 172.21.15.118:0/2066340524 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4014089be0 con 0x7f40241538c0 2024-02-18T10:00:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c1036640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc06bbe0 0x7f97bc147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c1036640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc06bbe0 0x7f97bc147f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:54580/0 (socket says 172.21.15.118:54580) 2024-02-18T10:00:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.971+0000 7fef54800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008df0 0x7fef48161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41242/0 (socket says 172.21.15.118:41242) 2024-02-18T10:00:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef4ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef480cf000 0x7fef48160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c329a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef4ffff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef480cf000 0x7fef48160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:54564/0 (socket says 172.21.15.118:54564) 2024-02-18T10:00:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef56a64640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef480d53e0 0x7fef4816b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c0835640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97bc0bd2b0 0x7f97bc0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c0835640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97bc0bd2b0 0x7f97bc0a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:41266/0 (socket says 172.21.15.118:41266) 2024-02-18T10:00:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef54800640 1 -- 172.21.15.118:0/2544075340 learned_addr learned my addr 172.21.15.118:0/2544075340 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48161950 con 0x7fef480d53e0 2024-02-18T10:00:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fe4de5640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe00a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 -- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 msgr2=0x7f5fe00a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c1837640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c1837640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc1409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57740/0 (socket says 172.21.15.118:57740) 2024-02-18T10:00:58.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c1036640 1 -- 172.21.15.118:0/2486429508 learned_addr learned my addr 172.21.15.118:0/2486429508 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:58.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe00a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 -- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 msgr2=0x7f5fe009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 0x7f5fe009de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 -- 172.21.15.118:0/790482906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009a70 con 0x7f5fe0145e50 2024-02-18T10:00:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0a7290 con 0x7f97bc14c510 2024-02-18T10:00:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fe4de5640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe00a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef55001640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef480d53e0 0x7fef4816b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c88075150 con 0x7f1c88145e80 2024-02-18T10:00:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4816ae20 con 0x7fef48008df0 2024-02-18T10:00:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc140540 con 0x7f97bc0bd2b0 2024-02-18T10:00:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc0a6cd0 con 0x7f97bc06bbe0 2024-02-18T10:00:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef48162650 con 0x7fef480cf000 2024-02-18T10:00:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.972+0000 7f5fdffff640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe0145e50 0x7f5fe014e5e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400e9b0 tx=0x7f5fd400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7fef54800640 1 -- 172.21.15.118:0/2544075340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef480cf000 msgr2=0x7fef48160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7fef54800640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef480cf000 0x7fef48160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7fef54800640 1 -- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef480d53e0 msgr2=0x7fef4816b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7fef54800640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef480d53e0 0x7fef4816b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7fef54800640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef440093a0 con 0x7fef48008df0 2024-02-18T10:00:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97c1036640 1 -- 172.21.15.118:0/2486429508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97bc0bd2b0 msgr2=0x7f97bc0a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97c1036640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97bc0bd2b0 0x7f97bc0a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97c1036640 1 -- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 msgr2=0x7f97bc1409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97c1036640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc1409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97c1036640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4009b30 con 0x7f97bc06bbe0 2024-02-18T10:00:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f4029fc8640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f400806bd40 0x7f400806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97c1036640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc06bbe0 0x7f97bc147f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f97b800b420 tx=0x7f97b800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7fef54800640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008df0 0x7fef48161410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c00 tx=0x7fef440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f1c857fa640 1 -- 172.21.15.118:0/2329290719 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f1c74011ad0 con 0x7f1c88145e80 2024-02-18T10:00:58.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7fa44a487640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42806bd70 0x7fa42806e230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa43400a7c0 tx=0x7fa434008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97b1ffb640 1 -- 172.21.15.118:0/2486429508 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8011830 con 0x7f97bc06bbe0 2024-02-18T10:00:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97b1ffb640 1 -- 172.21.15.118:0/2486429508 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b8011990 con 0x7f97bc06bbe0 2024-02-18T10:00:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.973+0000 7f97b1ffb640 1 -- 172.21.15.118:0/2486429508 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8011d40 con 0x7f97bc06bbe0 2024-02-18T10:00:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f4029fc8640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f400806bd40 0x7f400806e200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f401c02c010 tx=0x7f401c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97bc0a6fb0 con 0x7f97bc06bbe0 2024-02-18T10:00:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f1c857fa640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1c6c06bd00 0x7f1c6c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97bc0a6000 con 0x7f97bc06bbe0 2024-02-18T10:00:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f1c857fa640 1 -- 172.21.15.118:0/2329290719 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c7408a380 con 0x7f1c88145e80 2024-02-18T10:00:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f5fdd7fa640 1 -- 172.21.15.118:0/790482906 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4009670 con 0x7f5fe0145e50 2024-02-18T10:00:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7fedf77fe640 1 -- 172.21.15.118:0/724385264 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8003da0 con 0x7fee00147930 2024-02-18T10:00:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe01e45c0 con 0x7f5fe0145e50 2024-02-18T10:00:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7fa3ae7fc640 1 -- 172.21.15.118:0/186788906 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3b8146680 con 0x7fa3b8142a80 2024-02-18T10:00:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee00149420 con 0x7fee00147930 2024-02-18T10:00:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe01e4b80 con 0x7f5fe0145e50 2024-02-18T10:00:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee00147410 con 0x7fee00147930 2024-02-18T10:00:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7fedf77fe640 1 -- 172.21.15.118:0/724385264 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf8005070 con 0x7fee00147930 2024-02-18T10:00:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7fedf77fe640 1 -- 172.21.15.118:0/724385264 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80053e0 con 0x7fee00147930 2024-02-18T10:00:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.974+0000 7f5fdd7fa640 1 -- 172.21.15.118:0/790482906 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd400c9a0 con 0x7f5fe0145e50 2024-02-18T10:00:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.975+0000 7f5fdd7fa640 1 -- 172.21.15.118:0/790482906 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400cd10 con 0x7f5fe0145e50 2024-02-18T10:00:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.975+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97bc149990 con 0x7f97bc06bbe0 2024-02-18T10:00:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.975+0000 7f1c8ca46640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1c6c06bd00 0x7f1c6c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.975+0000 7f1c8ca46640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1c6c06bd00 0x7f1c6c06e1c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0090b0 tx=0x7f1c7c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.976+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede4005290 con 0x7fee00147930 2024-02-18T10:00:58.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.976+0000 7fa43affd640 1 -- 172.21.15.118:0/105759216 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa440054270 con 0x7fa444150290 2024-02-18T10:00:58.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.976+0000 7f5fdd7fa640 1 -- 172.21.15.118:0/790482906 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f5fd4005990 con 0x7f5fe0145e50 2024-02-18T10:00:58.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.977+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc0005290 con 0x7f5fe0145e50 2024-02-18T10:00:58.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.977+0000 7f5fdd7fa640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5fcc06bc70 0x7f5fcc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.977+0000 7f5fdd7fa640 1 -- 172.21.15.118:0/790482906 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fd408aa90 con 0x7f5fe0145e50 2024-02-18T10:00:58.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.977+0000 7fedf77fe640 1 -- 172.21.15.118:0/724385264 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fedf8005540 con 0x7fee00147930 2024-02-18T10:00:58.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.977+0000 7f5fe4de5640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5fcc06bc70 0x7f5fcc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.978+0000 7fedf77fe640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fede006bc70 0x7fede006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.978+0000 7f5fe4de5640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5fcc06bc70 0x7f5fcc06e130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0000f60 tx=0x7f5fd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.978+0000 7fedf77fe640 1 -- 172.21.15.118:0/724385264 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedf8089fe0 con 0x7fee00147930 2024-02-18T10:00:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.978+0000 7fedfed9d640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fede006bc70 0x7fede006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.978+0000 7fedfed9d640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fede006bc70 0x7fede006e130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fedf002b7f0 tx=0x7fedf0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.979+0000 7f1c857fa640 1 -- 172.21.15.118:0/2329290719 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c74054b70 con 0x7f1c88145e80 2024-02-18T10:00:58.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.980+0000 7fef4d7fa640 1 -- 172.21.15.118:0/2544075340 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44030710 con 0x7fef48008df0 2024-02-18T10:00:58.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.980+0000 7fef4d7fa640 1 -- 172.21.15.118:0/2544075340 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44030870 con 0x7fef48008df0 2024-02-18T10:00:58.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.980+0000 7fef4d7fa640 1 -- 172.21.15.118:0/2544075340 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44030c20 con 0x7fef48008df0 2024-02-18T10:00:58.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.980+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef48161b90 con 0x7fef48008df0 2024-02-18T10:00:58.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.980+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef480cb7d0 con 0x7fef48008df0 2024-02-18T10:00:58.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.981+0000 7f97b1ffb640 1 -- 172.21.15.118:0/2486429508 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f97b8004020 con 0x7f97bc06bbe0 2024-02-18T10:00:58.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.981+0000 7f401a7fc640 1 -- 172.21.15.118:0/2066340524 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f402406fcb0 con 0x7f40241538c0 2024-02-18T10:00:58.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.981+0000 7f97b1ffb640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f97a006bc70 0x7f97a006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.981+0000 7f97b1ffb640 1 -- 172.21.15.118:0/2486429508 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97b808ac80 con 0x7f97bc06bbe0 2024-02-18T10:00:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.982+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef480068d0 con 0x7fef48008df0 2024-02-18T10:00:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.982+0000 7f97c0835640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f97a006bc70 0x7f97a006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.982+0000 7f97c0835640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f97a006bc70 0x7f97a006e130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97bc075260 tx=0x7f97ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.983+0000 7f5fdd7fa640 1 -- 172.21.15.118:0/790482906 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5fd4055200 con 0x7f5fe0145e50 2024-02-18T10:00:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.983+0000 7fef4d7fa640 1 -- 172.21.15.118:0/2544075340 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fef44030d80 con 0x7fef48008df0 2024-02-18T10:00:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.984+0000 7f97b1ffb640 1 -- 172.21.15.118:0/2486429508 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f97b80554d0 con 0x7f97bc06bbe0 2024-02-18T10:00:58.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.984+0000 7fef4d7fa640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fef3c06bcc0 0x7fef3c06e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:58.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.984+0000 7fef4d7fa640 1 -- 172.21.15.118:0/2544075340 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef440ac5f0 con 0x7fef48008df0 2024-02-18T10:00:58.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.984+0000 7fef4ffff640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fef3c06bcc0 0x7fef3c06e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:58.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.985+0000 7fef4ffff640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fef3c06bcc0 0x7fef3c06e180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef48039b20 tx=0x7fef40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:58.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.988+0000 7fef4d7fa640 1 -- 172.21.15.118:0/2544075340 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef44076ff0 con 0x7fef48008df0 2024-02-18T10:00:58.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:57.988+0000 7fedf77fe640 1 -- 172.21.15.118:0/724385264 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fedf8054860 con 0x7fee00147930 2024-02-18T10:00:58.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.388+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa3b8146680 con 0x7fa3b8142a80 2024-02-18T10:00:58.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.389+0000 7fa3ae7fc640 1 -- 172.21.15.118:0/186788906 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3b8146680 con 0x7fa3b8142a80 2024-02-18T10:00:58.391 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:00:58.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa42c005540 con 0x7fa444150290 2024-02-18T10:00:58.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa39c06bc70 msgr2=0x7fa39c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa39c06bc70 0x7fa39c06e130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0007410 tx=0x7fa3b0015040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142a80 msgr2=0x7fa3b81388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142a80 0x7fa3b81388a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400b450 tx=0x7fa3b400b910 comp rx=0 tx=0).stop 2024-02-18T10:00:58.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 shutdown_connections 2024-02-18T10:00:58.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa39c06bc70 0x7fa39c06e130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3b8142ee0 0x7fa3b8140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3b8142a80 0x7fa3b81388a0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400b450 tx=0x7fa3b400b910 comp rx=0 tx=0).stop 2024-02-18T10:00:58.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 --2- 172.21.15.118:0/186788906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3b80b9f30 0x7fa3b81438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 >> 172.21.15.118:0/186788906 conn(0x7fa3b806bcf0 msgr2=0x7fa3b806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 shutdown_connections 2024-02-18T10:00:58.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.392+0000 7fa3be9ac640 1 -- 172.21.15.118:0/186788906 wait complete. 2024-02-18T10:00:58.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.393+0000 7fa43affd640 1 -- 172.21.15.118:0/105759216 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa440057930 con 0x7fa444150290 2024-02-18T10:00:58.396 INFO:teuthology.orchestra.run.smithi118.stdout:55834574852 2024-02-18T10:00:58.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.394+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97bc074af0 con 0x7f97bc06bbe0 2024-02-18T10:00:58.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.394+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f402406fcb0 con 0x7f40241538c0 2024-02-18T10:00:58.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.394+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1c88074af0 con 0x7f1c88145e80 2024-02-18T10:00:58.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.394+0000 7f401a7fc640 1 -- 172.21.15.118:0/2066340524 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4014017020 con 0x7f40241538c0 2024-02-18T10:00:58.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.394+0000 7f1c857fa640 1 -- 172.21.15.118:0/2329290719 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c74058230 con 0x7f1c88145e80 2024-02-18T10:00:58.397 INFO:teuthology.orchestra.run.smithi118.stdout:55834574851 2024-02-18T10:00:58.398 INFO:teuthology.orchestra.run.smithi118.stdout:55834574852 2024-02-18T10:00:58.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.394+0000 7f97b1ffb640 1 -- 172.21.15.118:0/2486429508 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97b8058b90 con 0x7f97bc06bbe0 2024-02-18T10:00:58.398 INFO:teuthology.orchestra.run.smithi118.stdout:55834574852 2024-02-18T10:00:58.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.395+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5fc0005540 con 0x7f5fe0145e50 2024-02-18T10:00:58.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.396+0000 7f5fdd7fa640 1 -- 172.21.15.118:0/790482906 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fd4017020 con 0x7f5fe0145e50 2024-02-18T10:00:58.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42806bd70 msgr2=0x7fa42806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42806bd70 0x7fa42806e230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa43400a7c0 tx=0x7fa434008040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa444150290 msgr2=0x7fa4441538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa444150290 0x7fa4441538e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c3c0 tx=0x7fa44000c880 comp rx=0 tx=0).stop 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 shutdown_connections 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa42806bd70 0x7fa42806e230 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa43400a7c0 tx=0x7fa434008040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa444150290 0x7fa4441538e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4440b2ea0 0x7fa44414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 --2- 172.21.15.118:0/105759216 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa444072130 0x7fa4441ee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 >> 172.21.15.118:0/105759216 conn(0x7fa4440b9b90 msgr2=0x7fa444148b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 shutdown_connections 2024-02-18T10:00:58.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.397+0000 7fa44b489640 1 -- 172.21.15.118:0/105759216 wait complete. 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f97a006bc70 msgr2=0x7f97a006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f97a006bc70 0x7f97a006e130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97bc075260 tx=0x7f97ac008040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc06bbe0 msgr2=0x7f97bc147f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc06bbe0 0x7f97bc147f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f97b800b420 tx=0x7f97b800b8e0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1c6c06bd00 msgr2=0x7f1c6c06e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1c6c06bd00 0x7f1c6c06e1c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0090b0 tx=0x7f1c7c03b040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 msgr2=0x7f1c8809f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8809f860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400c5e0 tx=0x7f1c7400caa0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 shutdown_connections 2024-02-18T10:00:58.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1c6c06bd00 0x7f1c6c06e1c0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0090b0 tx=0x7f1c7c03b040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c8814ba20 0x7f1c8809e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c88145e80 0x7f1c8809f860 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 --2- 172.21.15.118:0/2329290719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c880b9d20 0x7f1c881419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 >> 172.21.15.118:0/2329290719 conn(0x7f1c8806bcf0 msgr2=0x7f1c880a2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.402 INFO:teuthology.orchestra.run.smithi118.stdout:55834574851 2024-02-18T10:00:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f400806bd40 msgr2=0x7f400806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f400806bd40 0x7f400806e200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f401c02c010 tx=0x7f401c030000 comp rx=0 tx=0).stop 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40241538c0 msgr2=0x7f4024072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40241538c0 0x7f4024072510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f401400c390 tx=0x7f401400c850 comp rx=0 tx=0).stop 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 shutdown_connections 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f400806bd40 0x7f400806e200 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f401c02c010 tx=0x7f401c030000 comp rx=0 tx=0).stop 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4024158970 0x7f402406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40241538c0 0x7f4024072510 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 --2- 172.21.15.118:0/2066340524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40240a30f0 0x7f40240713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 >> 172.21.15.118:0/2066340524 conn(0x7f40240b9c30 msgr2=0x7f40240bb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 shutdown_connections 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f97a006bc70 0x7f97a006e130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97bc14c510 0x7f97bc1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97bc0bd2b0 0x7f97bc0a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 --2- 172.21.15.118:0/2486429508 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f97bc06bbe0 0x7f97bc147f90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 >> 172.21.15.118:0/2486429508 conn(0x7f97bc0c18e0 msgr2=0x7f97bc0c0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 shutdown_connections 2024-02-18T10:00:58.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f97c329a640 1 -- 172.21.15.118:0/2486429508 wait complete. 2024-02-18T10:00:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 shutdown_connections 2024-02-18T10:00:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f1c8ecaa640 1 -- 172.21.15.118:0/2329290719 wait complete. 2024-02-18T10:00:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 shutdown_connections 2024-02-18T10:00:58.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.398+0000 7f402c22c640 1 -- 172.21.15.118:0/2066340524 wait complete. 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.399+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5fcc06bc70 msgr2=0x7f5fcc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.399+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5fcc06bc70 0x7f5fcc06e130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0000f60 tx=0x7f5fd0009040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.399+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe0145e50 msgr2=0x7f5fe014e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.399+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe0145e50 0x7f5fe014e5e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400e9b0 tx=0x7f5fd400ee70 comp rx=0 tx=0).stop 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 shutdown_connections 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5fcc06bc70 0x7f5fcc06e130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe014f5e0 0x7f5fe009de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fe0145e50 0x7f5fe014e5e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 --2- 172.21.15.118:0/790482906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5fe0071100 0x7f5fe00a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 >> 172.21.15.118:0/790482906 conn(0x7f5fe00bad40 msgr2=0x7f5fe00b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 shutdown_connections 2024-02-18T10:00:58.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.400+0000 7f5fe5de7640 1 -- 172.21.15.118:0/790482906 wait complete. 2024-02-18T10:00:58.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.403+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fef48005810 con 0x7fef48008df0 2024-02-18T10:00:58.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.403+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fede4005540 con 0x7fee00147930 2024-02-18T10:00:58.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.404+0000 7fef4d7fa640 1 -- 172.21.15.118:0/2544075340 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef4407a6b0 con 0x7fef48008df0 2024-02-18T10:00:58.408 INFO:teuthology.orchestra.run.smithi118.stdout:55834574851 2024-02-18T10:00:58.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.404+0000 7fedf77fe640 1 -- 172.21.15.118:0/724385264 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedf8017090 con 0x7fee00147930 2024-02-18T10:00:58.408 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:00:58.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.407+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fef3c06bcc0 msgr2=0x7fef3c06e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.407+0000 7fef56a64640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fef3c06bcc0 0x7fef3c06e180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef48039b20 tx=0x7fef40008040 comp rx=0 tx=0).stop 2024-02-18T10:00:58.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.407+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008df0 msgr2=0x7fef48161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.407+0000 7fef56a64640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008df0 0x7fef48161410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c00 tx=0x7fef440046c0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 shutdown_connections 2024-02-18T10:00:58.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fef3c06bcc0 0x7fef3c06e180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fef480d53e0 0x7fef4816b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef480cf000 0x7fef48160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 --2- 172.21.15.118:0/2544075340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef48008df0 0x7fef48161410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 >> 172.21.15.118:0/2544075340 conn(0x7fef4803ffe0 msgr2=0x7fef480403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fede006bc70 msgr2=0x7fede006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 shutdown_connections 2024-02-18T10:00:58.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fede006bc70 0x7fede006e130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fedf002b7f0 tx=0x7fedf0008030 comp rx=0 tx=0).stop 2024-02-18T10:00:58.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee00147930 msgr2=0x7fee00148220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:58.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee00147930 0x7fee00148220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c8d0 tx=0x7fedf800cd90 comp rx=0 tx=0).stop 2024-02-18T10:00:58.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fef56a64640 1 -- 172.21.15.118:0/2544075340 wait complete. 2024-02-18T10:00:58.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 shutdown_connections 2024-02-18T10:00:58.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fede006bc70 0x7fede006e130 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fedf002b7f0 tx=0x7fedf0008030 comp rx=0 tx=0).stop 2024-02-18T10:00:58.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee00147930 0x7fee00148220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee000b33b0 0x7fee0014c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 --2- 172.21.15.118:0/724385264 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee0009e3b0 0x7fee00149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:58.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.408+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 >> 172.21.15.118:0/724385264 conn(0x7fee000b9c30 msgr2=0x7fee000b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:58.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.409+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 shutdown_connections 2024-02-18T10:00:58.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:58.409+0000 7fee0502a640 1 -- 172.21.15.118:0/724385264 wait complete. 2024-02-18T10:00:58.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-02-18T10:00:58.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2024-02-18T10:00:58.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.7 2024-02-18T10:00:58.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2024-02-18T10:00:58.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.1 2024-02-18T10:00:58.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2024-02-18T10:00:58.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.6 2024-02-18T10:00:58.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-02-18T10:00:59.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-18T10:00:59.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-18T10:00:59.425 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-18T10:00:59.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-18T10:00:59.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-18T10:00:59.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-18T10:00:59.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-18T10:00:59.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-18T10:00:59.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.580+0000 7f540ae40640 1 Processor -- start 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.580+0000 7f540ae40640 1 -- start start 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f540ae40640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f53fc03fab0 0x7f53fc041950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f540ae40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc041e90 0x7f53fc0e0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f540ae40640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0422e0 con 0x7f53fc008e30 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f540ae40640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc03e570 con 0x7f53fc03fab0 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f540ae40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc03efe0 con 0x7f53fc041e90 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f54093dd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc041e90 0x7f53fc0e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f54093dd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc041e90 0x7f53fc0e0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:56002/0 (socket says 172.21.15.118:56002) 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.581+0000 7f54093dd640 1 -- 172.21.15.118:0/2714984079 learned_addr learned my addr 172.21.15.118:0/2714984079 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.582+0000 7f54093dd640 1 -- 172.21.15.118:0/2714984079 >> v2:172.21.15.164:3300/0 conn(0x7f53fc03fab0 msgr2=0x7f53fc041950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-18T10:00:59.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.582+0000 7f54093dd640 1 --2- 172.21.15.118:0/2714984079 >> v2:172.21.15.164:3300/0 conn(0x7f53fc03fab0 0x7f53fc041950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.582+0000 7f54093dd640 1 -- 172.21.15.118:0/2714984079 >> v1:172.21.15.118:6789/0 conn(0x7f53fc008e30 legacy=0x7f53fc0d9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.582+0000 7f54093dd640 1 -- 172.21.15.118:0/2714984079 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc03f2c0 con 0x7f53fc041e90 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.584+0000 7f54093dd640 1 --2- 172.21.15.118:0/2714984079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc041e90 0x7f53fc0e0010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5404069150 tx=0x7f54040a6af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937d8b13e077d29d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.584+0000 7f54037fe640 1 -- 172.21.15.118:0/2714984079 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040a8970 con 0x7f53fc041e90 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.585+0000 7f54037fe640 1 -- 172.21.15.118:0/2714984079 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040a8ad0 con 0x7f53fc041e90 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.586+0000 7f540ae40640 1 -- 172.21.15.118:0/2714984079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc041e90 msgr2=0x7f53fc0e0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.586+0000 7f540ae40640 1 --2- 172.21.15.118:0/2714984079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc041e90 0x7f53fc0e0010 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5404069150 tx=0x7f54040a6af0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.586+0000 7f540ae40640 1 -- 172.21.15.118:0/2714984079 shutdown_connections 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.586+0000 7f540ae40640 1 --2- 172.21.15.118:0/2714984079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc041e90 0x7f53fc0e0010 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.586+0000 7f540ae40640 1 --2- 172.21.15.118:0/2714984079 >> v2:172.21.15.164:3300/0 conn(0x7f53fc03fab0 0x7f53fc041950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.586+0000 7f540ae40640 1 -- 172.21.15.118:0/2714984079 >> 172.21.15.118:0/2714984079 conn(0x7f53fc00a530 msgr2=0x7f53fc00a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.586+0000 7f540ae40640 1 -- 172.21.15.118:0/2714984079 shutdown_connections 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.587+0000 7f540ae40640 1 -- 172.21.15.118:0/2714984079 wait complete. 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.588+0000 7f540ae40640 1 Processor -- start 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.588+0000 7f540ae40640 1 -- start start 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.589+0000 7f540ae40640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc008e30 0x7f53fc027e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.589+0000 7f540ae40640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc03c690 0x7f53fc038530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.589+0000 7f540ae40640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53fc038a70 0x7f53fc03af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.589+0000 7f540ae40640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc038110 con 0x7f53fc008e30 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.589+0000 7f540ae40640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc028340 con 0x7f53fc038a70 2024-02-18T10:00:59.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.590+0000 7f540ae40640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc038ef0 con 0x7f53fc03c690 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.590+0000 7f5408bdc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc008e30 0x7f53fc027e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.590+0000 7f5408bdc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc008e30 0x7f53fc027e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42892/0 (socket says 172.21.15.118:42892) 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.590+0000 7f5408bdc640 1 -- 172.21.15.118:0/501541825 learned_addr learned my addr 172.21.15.118:0/501541825 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.590+0000 7f5408bdc640 1 -- 172.21.15.118:0/501541825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc03c690 msgr2=0x7f53fc038530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.591+0000 7f5408bdc640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc03c690 0x7f53fc038530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.591+0000 7f5408bdc640 1 -- 172.21.15.118:0/501541825 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53fc038a70 msgr2=0x7f53fc03af60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.591+0000 7f5408bdc640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53fc038a70 0x7f53fc03af60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.591+0000 7f5408bdc640 1 -- 172.21.15.118:0/501541825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404074040 con 0x7f53fc008e30 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.591+0000 7f5408bdc640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc008e30 0x7f53fc027e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c780 tx=0x7f53f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.592+0000 7f54017fa640 1 -- 172.21.15.118:0/501541825 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80050d0 con 0x7f53fc008e30 2024-02-18T10:00:59.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.592+0000 7f540ae40640 1 -- 172.21.15.118:0/501541825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc043340 con 0x7f53fc008e30 2024-02-18T10:00:59.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.593+0000 7f540ae40640 1 -- 172.21.15.118:0/501541825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc039a90 con 0x7f53fc008e30 2024-02-18T10:00:59.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.595+0000 7f54017fa640 1 -- 172.21.15.118:0/501541825 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f8005230 con 0x7f53fc008e30 2024-02-18T10:00:59.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.595+0000 7f54017fa640 1 -- 172.21.15.118:0/501541825 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800a640 con 0x7f53fc008e30 2024-02-18T10:00:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.596+0000 7f54017fa640 1 -- 172.21.15.118:0/501541825 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f53f800a860 con 0x7f53fc008e30 2024-02-18T10:00:59.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.597+0000 7f54017fa640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f53e806bd70 0x7f53e806e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.597+0000 7f5403fff640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f53e806bd70 0x7f53e806e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.598+0000 7f5403fff640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f53e806bd70 0x7f53e806e230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53f0006fd0 tx=0x7f53f0006b40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.599+0000 7f54017fa640 1 -- 172.21.15.118:0/501541825 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53f808a320 con 0x7f53fc008e30 2024-02-18T10:00:59.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.599+0000 7f540ae40640 1 -- 172.21.15.118:0/501541825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e4005290 con 0x7f53fc008e30 2024-02-18T10:00:59.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.608+0000 7f54017fa640 1 -- 172.21.15.118:0/501541825 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53f8054b80 con 0x7f53fc008e30 2024-02-18T10:00:59.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.634+0000 7fd06ca39640 1 Processor -- start 2024-02-18T10:00:59.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.634+0000 7fd06ca39640 1 -- start start 2024-02-18T10:00:59.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.634+0000 7f88edfb9640 1 Processor -- start 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd06ca39640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060008e30 0x7fd0600d9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd06ca39640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd06003fab0 0x7fd0600d9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd06ca39640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd060041950 0x7fd060041de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd06ca39640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06003e570 con 0x7fd060041950 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd06ca39640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd060042320 con 0x7fd06003fab0 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd06ca39640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06003efe0 con 0x7fd060008e30 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd066d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd060041950 0x7fd060041de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd066d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd060041950 0x7fd060041de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42904/0 (socket says 172.21.15.118:42904) 2024-02-18T10:00:59.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7fd066d9d640 1 -- 172.21.15.118:0/3806175562 learned_addr learned my addr 172.21.15.118:0/3806175562 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.635+0000 7f88edfb9640 1 -- start start 2024-02-18T10:00:59.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f5742853640 1 Processor -- start 2024-02-18T10:00:59.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f463114b640 1 Processor -- start 2024-02-18T10:00:59.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88edfb9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f88e0008e30 0x7f88e00ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88edfb9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 0x7f88e00cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88edfb9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88e00cb910 0x7f88e00d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7fd065d9b640 1 --2- 172.21.15.118:0/3806175562 >> v2:172.21.15.164:3300/0 conn(0x7fd06003fab0 0x7fd0600d9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7fd066d9d640 1 -- 172.21.15.118:0/3806175562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060008e30 msgr2=0x7fd0600d9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7fd066d9d640 1 --2- 172.21.15.118:0/3806175562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060008e30 0x7fd0600d9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7fd066d9d640 1 -- 172.21.15.118:0/3806175562 >> v2:172.21.15.164:3300/0 conn(0x7fd06003fab0 msgr2=0x7fd0600d9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7fd066d9d640 1 --2- 172.21.15.118:0/3806175562 >> v2:172.21.15.164:3300/0 conn(0x7fd06003fab0 0x7fd0600d9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7fd066d9d640 1 -- 172.21.15.118:0/3806175562 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06003f2c0 con 0x7fd060041950 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88e7fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88e00cb910 0x7f88e00d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88e7fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88e00cb910 0x7f88e00d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42920/0 (socket says 172.21.15.118:42920) 2024-02-18T10:00:59.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f463114b640 1 -- start start 2024-02-18T10:00:59.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88e7fff640 1 -- 172.21.15.118:0/3955311383 learned_addr learned my addr 172.21.15.118:0/3955311383 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e003f370 con 0x7f88e00cb910 2024-02-18T10:00:59.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f236dc38640 1 Processor -- start 2024-02-18T10:00:59.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f2400cc0640 1 Processor -- start 2024-02-18T10:00:59.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f236dc38640 1 -- start start 2024-02-18T10:00:59.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f5742853640 1 -- start start 2024-02-18T10:00:59.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5742853640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f573c14b0b0 0x7f573c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f463114b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f463114b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f462c0b5270 0x7f462c149450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f2400cc0640 1 -- start start 2024-02-18T10:00:59.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7fd066d9d640 1 --2- 172.21.15.118:0/3806175562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060041950 0x7fd060041de0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd068069150 tx=0x7fd0680a6ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea5e5d3e092ab9e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e00ce220 con 0x7f88e0008e30 2024-02-18T10:00:59.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.636+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e003e3c0 con 0x7f88e003dea0 2024-02-18T10:00:59.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f88e77fe640 1 --2- 172.21.15.118:0/3955311383 >> v2:172.21.15.164:3300/0 conn(0x7f88e0008e30 0x7f88e00ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f88e7fff640 1 -- 172.21.15.118:0/3955311383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 msgr2=0x7f88e00cb3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f88e7fff640 1 --2- 172.21.15.118:0/3955311383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 0x7f88e00cb3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f88e7fff640 1 -- 172.21.15.118:0/3955311383 >> v2:172.21.15.164:3300/0 conn(0x7f88e0008e30 msgr2=0x7f88e00ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f88e7fff640 1 --2- 172.21.15.118:0/3955311383 >> v2:172.21.15.164:3300/0 conn(0x7f88e0008e30 0x7f88e00ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f88e7fff640 1 -- 172.21.15.118:0/3955311383 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e003e6a0 con 0x7f88e00cb910 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f88e77fe640 1 --2- 172.21.15.118:0/3955311383 >> v2:172.21.15.164:3300/0 conn(0x7f88e0008e30 0x7f88e00ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5742853640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f573c0b3be0 0x7f573c14b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f462a59c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f462c0b5270 0x7f462c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5742853640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c070530 con 0x7f573c0ba680 2024-02-18T10:00:59.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5741851640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f573c14b0b0 0x7f573c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f462b59e640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f462c071000 0x7f462c071490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38654/0 (socket says 172.21.15.118:38654) 2024-02-18T10:00:59.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5742853640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c14c050 con 0x7f573c0b3be0 2024-02-18T10:00:59.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5742853640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0b7c30 con 0x7f573c14b0b0 2024-02-18T10:00:59.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5741851640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f573c14b0b0 0x7f573c0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:58280/0 (socket says 172.21.15.118:58280) 2024-02-18T10:00:59.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5741851640 1 -- 172.21.15.118:0/3517430238 learned_addr learned my addr 172.21.15.118:0/3517430238 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f5742052640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f573c0ba680 0x7f573c0b8710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:52354/0 (socket says 172.21.15.118:52354) 2024-02-18T10:00:59.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7fd06559a640 1 -- 172.21.15.118:0/3806175562 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680a8930 con 0x7fd060041950 2024-02-18T10:00:59.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7fd06559a640 1 -- 172.21.15.118:0/3806175562 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680a8a90 con 0x7fd060041950 2024-02-18T10:00:59.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7fbfadfeb640 1 Processor -- start 2024-02-18T10:00:59.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7fbfadfeb640 1 -- start start 2024-02-18T10:00:59.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236dc38640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f236806c040 0x7f23680b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236dc38640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2368066960 0x7f23680b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236dc38640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236814e930 con 0x7f2368066dc0 2024-02-18T10:00:59.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236dc38640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23680b90a0 con 0x7f2368066960 2024-02-18T10:00:59.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236dc38640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b2e20 con 0x7f236806c040 2024-02-18T10:00:59.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236cc36640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f236806c040 0x7f23680b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f2400cc0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23fc0bd990 0x7f23fc14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f2367fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2368066960 0x7f23680b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236cc36640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f236806c040 0x7f23680b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:56036/0 (socket says 172.21.15.118:56036) 2024-02-18T10:00:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f236cc36640 1 -- 172.21.15.118:0/2086354088 learned_addr learned my addr 172.21.15.118:0/2086354088 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f2400cc0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc0c07b0 con 0x7f23fc0ba9a0 2024-02-18T10:00:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f2400cc0640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc0c0d70 con 0x7f23fc06c870 2024-02-18T10:00:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f2400cc0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c1200 con 0x7f23fc0bd990 2024-02-18T10:00:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f23fa59c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f23fc0ba9a0 0x7f23fc06b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38664/0 (socket says 172.21.15.118:38664) 2024-02-18T10:00:59.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f23fa59c640 1 -- 172.21.15.118:0/866213107 learned_addr learned my addr 172.21.15.118:0/866213107 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:59.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7fd06ca39640 1 -- 172.21.15.118:0/3806175562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060041950 msgr2=0x7fd060041de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7fd06ca39640 1 --2- 172.21.15.118:0/3806175562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060041950 0x7fd060041de0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd068069150 tx=0x7fd0680a6ab0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f463114b640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c148a80 con 0x7f462c071000 2024-02-18T10:00:59.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f462b59e640 1 -- 172.21.15.118:0/1538915241 learned_addr learned my addr 172.21.15.118:0/1538915241 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:00:59.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f463114b640 1 -- 172.21.15.118:0/1538915241 --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462c0bac90 con 0x7f462c0b5270 2024-02-18T10:00:59.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f463114b640 1 -- 172.21.15.118:0/1538915241 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0b4e40 con 0x7f462c0b4a60 2024-02-18T10:00:59.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.637+0000 7f4629d9b640 1 -- 172.21.15.118:0/1538915241 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385543686 0 0) 0x7f462c148a80 con 0x7f462c071000 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f4629d9b640 1 -- 172.21.15.118:0/1538915241 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4614005730 con 0x7f462c071000 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f462ad9d640 1 --2- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f462a59c640 1 -- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 msgr2=0x7f462c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f462a59c640 1 --2- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f462a59c640 1 -- 172.21.15.118:0/1538915241 >> v1:172.21.15.118:6789/0 conn(0x7f462c071000 legacy=0x7f462c071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fd06ca39640 1 -- 172.21.15.118:0/3806175562 shutdown_connections 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fd06ca39640 1 --2- 172.21.15.118:0/3806175562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060041950 0x7fd060041de0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fd06ca39640 1 --2- 172.21.15.118:0/3806175562 >> v2:172.21.15.164:3300/0 conn(0x7fd06003fab0 0x7fd0600d9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fd06ca39640 1 --2- 172.21.15.118:0/3806175562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060008e30 0x7fd0600d9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fd06ca39640 1 -- 172.21.15.118:0/3806175562 >> 172.21.15.118:0/3806175562 conn(0x7fd06000a530 msgr2=0x7fd06000a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfadfeb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbfa80a11b0 0x7fbfa80b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfadfeb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f5741851640 1 -- 172.21.15.118:0/3517430238 >> v2:172.21.15.118:3300/0 conn(0x7f573c0b3be0 msgr2=0x7f573c14b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f9d9b640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23fc0bd990 0x7f23fc14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfadfeb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa80b8840 con 0x7fbfa806e200 2024-02-18T10:00:59.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfadfeb640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa80b9210 con 0x7fbfa80a11b0 2024-02-18T10:00:59.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfadfeb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80b7f10 con 0x7fbfa8147c50 2024-02-18T10:00:59.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f462a59c640 1 -- 172.21.15.118:0/1538915241 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0b9e20 con 0x7f462c0b5270 2024-02-18T10:00:59.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799195054 0 0) 0x7f23fc0c0d70 con 0x7f23fc06c870 2024-02-18T10:00:59.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e4003520 con 0x7f23fc06c870 2024-02-18T10:00:59.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfa7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfa7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa814c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:56052/0 (socket says 172.21.15.118:56052) 2024-02-18T10:00:59.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfa7fff640 1 -- 172.21.15.118:0/1134644305 learned_addr learned my addr 172.21.15.118:0/1134644305 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f236cc36640 1 -- 172.21.15.118:0/2086354088 >> v2:172.21.15.118:3300/0 conn(0x7f2368066960 msgr2=0x7f23680b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f236cc36640 1 --2- 172.21.15.118:0/2086354088 >> v2:172.21.15.118:3300/0 conn(0x7f2368066960 0x7f23680b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f236cc36640 1 -- 172.21.15.118:0/2086354088 >> v1:172.21.15.164:6789/0 conn(0x7f2368066dc0 legacy=0x7f236814bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f236cc36640 1 -- 172.21.15.118:0/2086354088 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680b4a70 con 0x7f236806c040 2024-02-18T10:00:59.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f88e7fff640 1 --2- 172.21.15.118:0/3955311383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e00cb910 0x7f88e00d13f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009ad0 tx=0x7f88dc0342f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b5c598f8aad99e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f5741851640 1 --2- 172.21.15.118:0/3517430238 >> v2:172.21.15.118:3300/0 conn(0x7f573c0b3be0 0x7f573c14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f5741851640 1 -- 172.21.15.118:0/3517430238 >> v1:172.21.15.164:6789/0 conn(0x7f573c0ba680 legacy=0x7f573c0b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.638+0000 7f5741851640 1 -- 172.21.15.118:0/3517430238 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0b7f10 con 0x7f573c14b0b0 2024-02-18T10:00:59.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fbfa6ffd640 1 --2- 172.21.15.118:0/1134644305 >> v2:172.21.15.118:3300/0 conn(0x7fbfa80a11b0 0x7fbfa80b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fd06ca39640 1 -- 172.21.15.118:0/3806175562 shutdown_connections 2024-02-18T10:00:59.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 250769308 0 0) 0x7f23e4003520 con 0x7f23fc06c870 2024-02-18T10:00:59.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23fc0bd990 msgr2=0x7f23fc14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23fc0bd990 0x7f23fc14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 >> v1:172.21.15.118:6789/0 conn(0x7f23fc0ba9a0 legacy=0x7f23fc06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0bd290 con 0x7f23fc06c870 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f23f40019f0 con 0x7f23fc06c870 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 >> v1:172.21.15.164:6789/0 conn(0x7f23fc06c870 legacy=0x7f23fc1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4003970 0x7f23e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23e40047c0 0x7f23e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e4005180 0x7f23e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e400bf70 con 0x7f23e4005180 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e400c0e0 con 0x7f23e40047c0 2024-02-18T10:00:59.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e400c2a0 con 0x7f23e4003970 2024-02-18T10:00:59.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7fbfa7fff640 1 -- 172.21.15.118:0/1134644305 >> v2:172.21.15.118:3300/0 conn(0x7fbfa80a11b0 msgr2=0x7fbfa80b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7fbfa7fff640 1 --2- 172.21.15.118:0/1134644305 >> v2:172.21.15.118:3300/0 conn(0x7fbfa80a11b0 0x7fbfa80b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7fbfa7fff640 1 -- 172.21.15.118:0/1134644305 >> v1:172.21.15.164:6789/0 conn(0x7fbfa806e200 legacy=0x7fbfa80b3a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:00:59.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7fbfa7fff640 1 -- 172.21.15.118:0/1134644305 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80b81f0 con 0x7fbfa8147c50 2024-02-18T10:00:59.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23f9d9b640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23e40047c0 0x7f23e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f462a59c640 1 --2- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c0b5270 0x7f462c149450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8122d1ee257fc8cd server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23fad9d640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e4005180 0x7f23e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f5741851640 1 --2- 172.21.15.118:0/3517430238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c14b0b0 0x7f573c0b36a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f573c0679e0 tx=0x7f573802df20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5deeeb5269b6da8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f88e67fc640 1 -- 172.21.15.118:0/3955311383 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc034e90 con 0x7f88e00cb910 2024-02-18T10:00:59.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f88e67fc640 1 -- 172.21.15.118:0/3955311383 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc03c440 con 0x7f88e00cb910 2024-02-18T10:00:59.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f88e67fc640 1 -- 172.21.15.118:0/3955311383 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc03c7d0 con 0x7f88e00cb910 2024-02-18T10:00:59.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f4629d9b640 1 -- 172.21.15.118:0/1538915241 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240019f0 con 0x7f462c0b5270 2024-02-18T10:00:59.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f4629d9b640 1 -- 172.21.15.118:0/1538915241 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462002e050 con 0x7f462c0b5270 2024-02-18T10:00:59.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f4629d9b640 1 -- 172.21.15.118:0/1538915241 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620030730 con 0x7f462c0b5270 2024-02-18T10:00:59.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f236cc36640 1 --2- 172.21.15.118:0/2086354088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f236806c040 0x7f23680b28e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2360009e50 tx=0x7f236002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e49bb1bbc0f80f54 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.639+0000 7fd06ca39640 1 -- 172.21.15.118:0/3806175562 wait complete. 2024-02-18T10:00:59.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f574084f640 1 -- 172.21.15.118:0/3517430238 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573802ec50 con 0x7f573c14b0b0 2024-02-18T10:00:59.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f574084f640 1 -- 172.21.15.118:0/3517430238 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573802edb0 con 0x7f573c14b0b0 2024-02-18T10:00:59.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f574084f640 1 -- 172.21.15.118:0/3517430238 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738036660 con 0x7f573c14b0b0 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23677fe640 1 -- 172.21.15.118:0/2086354088 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236002ca80 con 0x7f236806c040 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23677fe640 1 -- 172.21.15.118:0/2086354088 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236002cbe0 con 0x7f236806c040 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23677fe640 1 -- 172.21.15.118:0/2086354088 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23600343f0 con 0x7f236806c040 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23fa59c640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4003970 0x7f23e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23fad9d640 1 -- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4003970 msgr2=0x7f23e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23fad9d640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4003970 0x7f23e4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23fad9d640 1 -- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23e40047c0 msgr2=0x7f23e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23fad9d640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23e40047c0 0x7f23e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.640+0000 7f23fad9d640 1 -- 172.21.15.118:0/866213107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4003520 con 0x7f23e4005180 2024-02-18T10:00:59.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e00cb910 msgr2=0x7f88e00d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 --2- 172.21.15.118:0/3955311383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e00cb910 0x7f88e00d13f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009ad0 tx=0x7f88dc0342f0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f463114b640 1 -- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c0b5270 msgr2=0x7f462c149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f5742853640 1 -- 172.21.15.118:0/3517430238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c14b0b0 msgr2=0x7f573c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f5742853640 1 --2- 172.21.15.118:0/3517430238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c14b0b0 0x7f573c0b36a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f573c0679e0 tx=0x7f573802df20 comp rx=0 tx=0).stop 2024-02-18T10:00:59.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f463114b640 1 --2- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c0b5270 0x7f462c149450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b6b0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 shutdown_connections 2024-02-18T10:00:59.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f23fad9d640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e4005180 0x7f23e400b980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c490 tx=0x7f23e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c4e920a637bb3e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 --2- 172.21.15.118:0/3955311383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e00cb910 0x7f88e00d13f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 --2- 172.21.15.118:0/3955311383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 0x7f88e00cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 --2- 172.21.15.118:0/3955311383 >> v2:172.21.15.164:3300/0 conn(0x7f88e0008e30 0x7f88e00ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 >> 172.21.15.118:0/3955311383 conn(0x7f88e000a530 msgr2=0x7f88e000a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f463114b640 1 -- 172.21.15.118:0/1538915241 shutdown_connections 2024-02-18T10:00:59.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f463114b640 1 --2- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c0b5270 0x7f462c149450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f463114b640 1 --2- 172.21.15.118:0/1538915241 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f463114b640 1 -- 172.21.15.118:0/1538915241 >> 172.21.15.118:0/1538915241 conn(0x7f462c0bebc0 msgr2=0x7f462c06bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 shutdown_connections 2024-02-18T10:00:59.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f88edfb9640 1 -- 172.21.15.118:0/3955311383 wait complete. 2024-02-18T10:00:59.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4006d50 con 0x7f23e4005180 2024-02-18T10:00:59.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f236dc38640 1 -- 172.21.15.118:0/2086354088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f236806c040 msgr2=0x7f23680b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7f236dc38640 1 --2- 172.21.15.118:0/2086354088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f236806c040 0x7f23680b28e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2360009e50 tx=0x7f236002bee0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7fd06ca39640 1 Processor -- start 2024-02-18T10:00:59.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.641+0000 7fd06ca39640 1 -- start start 2024-02-18T10:00:59.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f236dc38640 1 -- 172.21.15.118:0/2086354088 shutdown_connections 2024-02-18T10:00:59.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f236dc38640 1 --2- 172.21.15.118:0/2086354088 >> v2:172.21.15.118:3300/0 conn(0x7f2368066960 0x7f23680b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f236dc38640 1 --2- 172.21.15.118:0/2086354088 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f236806c040 0x7f23680b28e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f236dc38640 1 -- 172.21.15.118:0/2086354088 >> 172.21.15.118:0/2086354088 conn(0x7f23680ba3c0 msgr2=0x7f23680ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f402ca40 con 0x7f23e4005180 2024-02-18T10:00:59.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f236dc38640 1 -- 172.21.15.118:0/2086354088 shutdown_connections 2024-02-18T10:00:59.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f236dc38640 1 -- 172.21.15.118:0/2086354088 wait complete. 2024-02-18T10:00:59.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f23f959a640 1 -- 172.21.15.118:0/866213107 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f402cdf0 con 0x7f23e4005180 2024-02-18T10:00:59.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f463114b640 1 -- 172.21.15.118:0/1538915241 shutdown_connections 2024-02-18T10:00:59.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f5742853640 1 -- 172.21.15.118:0/3517430238 shutdown_connections 2024-02-18T10:00:59.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f5742853640 1 --2- 172.21.15.118:0/3517430238 >> v2:172.21.15.118:3300/0 conn(0x7f573c0b3be0 0x7f573c14b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f5742853640 1 --2- 172.21.15.118:0/3517430238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c14b0b0 0x7f573c0b36a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f5742853640 1 -- 172.21.15.118:0/3517430238 >> 172.21.15.118:0/3517430238 conn(0x7f573c0b9b90 msgr2=0x7f573c0b9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fbfa7fff640 1 --2- 172.21.15.118:0/1134644305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa814c4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009e50 tx=0x7fbfa002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50a1cf849bf8231b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fd06ca39640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060008e30 0x7fd0600cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fd06ca39640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060041950 0x7fd0600d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7f463114b640 1 -- 172.21.15.118:0/1538915241 wait complete. 2024-02-18T10:00:59.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fbfa67fc640 1 -- 172.21.15.118:0/1134644305 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa002ca80 con 0x7fbfa8147c50 2024-02-18T10:00:59.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fbfa67fc640 1 -- 172.21.15.118:0/1134644305 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa002cbe0 con 0x7fbfa8147c50 2024-02-18T10:00:59.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fbfa67fc640 1 -- 172.21.15.118:0/1134644305 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00343f0 con 0x7fbfa8147c50 2024-02-18T10:00:59.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f2400cc0640 1 -- 172.21.15.118:0/866213107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e4005180 msgr2=0x7f23e400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f2400cc0640 1 --2- 172.21.15.118:0/866213107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23e4005180 0x7f23e400b980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c490 tx=0x7f23e40057f0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f23fad9d640 1 -- 172.21.15.118:0/866213107 reap_dead start 2024-02-18T10:00:59.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f236dc38640 1 Processor -- start 2024-02-18T10:00:59.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f88edfb9640 1 Processor -- start 2024-02-18T10:00:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f2400cc0640 1 -- 172.21.15.118:0/866213107 shutdown_connections 2024-02-18T10:00:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f2400cc0640 1 -- 172.21.15.118:0/866213107 >> 172.21.15.118:0/866213107 conn(0x7f23fc0c1530 msgr2=0x7f23fc0c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f2400cc0640 1 -- 172.21.15.118:0/866213107 shutdown_connections 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fd06ca39640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd06003c7c0 0x7fd06003cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fd06ca39640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06003d190 con 0x7fd060008e30 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fd06ca39640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06016e200 con 0x7fd06003c7c0 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.642+0000 7fd06ca39640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06003af40 con 0x7fd060041950 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd06003c7c0 0x7fd06003cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd06003c7c0 0x7fd06003cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:58298/0 (socket says 172.21.15.118:58298) 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 -- 172.21.15.118:0/692004565 learned_addr learned my addr 172.21.15.118:0/692004565 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd065d9b640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060041950 0x7fd0600d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd06659c640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060008e30 0x7fd0600cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 -- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060041950 msgr2=0x7fd0600d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060041950 0x7fd0600d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 -- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060008e30 msgr2=0x7fd0600cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060008e30 0x7fd0600cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd066d9d640 1 -- 172.21.15.118:0/692004565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068074040 con 0x7fd06003c7c0 2024-02-18T10:00:59.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7fd06659c640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060008e30 0x7fd0600cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:59.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fbfadfeb640 1 -- 172.21.15.118:0/1134644305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 msgr2=0x7fbfa814c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/1134644305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa814c4f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009e50 tx=0x7fbfa002bee0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f5742853640 1 -- 172.21.15.118:0/3517430238 shutdown_connections 2024-02-18T10:00:59.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f5742853640 1 -- 172.21.15.118:0/3517430238 wait complete. 2024-02-18T10:00:59.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fbfadfeb640 1 -- 172.21.15.118:0/1134644305 shutdown_connections 2024-02-18T10:00:59.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/1134644305 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa814c4f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/1134644305 >> v2:172.21.15.118:3300/0 conn(0x7fbfa80a11b0 0x7fbfa80b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fbfadfeb640 1 -- 172.21.15.118:0/1134644305 >> 172.21.15.118:0/1134644305 conn(0x7fbfa80b9c30 msgr2=0x7fbfa80ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:00:59.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f236dc38640 1 -- start start 2024-02-18T10:00:59.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fd066d9d640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd06003c7c0 0x7fd06003cc50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd06806aa60 tx=0x7fd068069980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f88edfb9640 1 -- start start 2024-02-18T10:00:59.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f236dc38640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2368066960 0x7f236809a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f88edfb9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e0008e30 0x7f88e00c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f463114b640 1 Processor -- start 2024-02-18T10:00:59.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f88edfb9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 0x7f88e0035e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f236dc38640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2368066dc0 0x7f23680a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f463114b640 1 -- start start 2024-02-18T10:00:59.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f236dc38640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f236806c040 0x7f236809bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f236cc36640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2368066960 0x7f236809a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fd056ffd640 1 -- 172.21.15.118:0/692004565 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680b6040 con 0x7fd06003c7c0 2024-02-18T10:00:59.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f236cc36640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2368066960 0x7f236809a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:58300/0 (socket says 172.21.15.118:58300) 2024-02-18T10:00:59.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.643+0000 7f2400cc0640 1 -- 172.21.15.118:0/866213107 wait complete. 2024-02-18T10:00:59.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7fd056ffd640 1 -- 172.21.15.118:0/692004565 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680bd860 con 0x7fd06003c7c0 2024-02-18T10:00:59.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7fd056ffd640 1 -- 172.21.15.118:0/692004565 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680bdbd0 con 0x7fd06003c7c0 2024-02-18T10:00:59.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7fbfadfeb640 1 -- 172.21.15.118:0/1134644305 shutdown_connections 2024-02-18T10:00:59.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7fbfadfeb640 1 -- 172.21.15.118:0/1134644305 wait complete. 2024-02-18T10:00:59.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.644+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e0008e30 0x7f88e00c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236d437640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f236806c040 0x7f236809bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236d437640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f236806c040 0x7f236809bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42964/0 (socket says 172.21.15.118:42964) 2024-02-18T10:00:59.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f2367fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2368066dc0 0x7f23680a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f2367fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2368066dc0 0x7f23680a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:56072/0 (socket says 172.21.15.118:56072) 2024-02-18T10:00:59.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236cc36640 1 -- 172.21.15.118:0/1164118413 learned_addr learned my addr 172.21.15.118:0/1164118413 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f2400cc0640 1 Processor -- start 2024-02-18T10:00:59.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236809ac40 con 0x7f236806c040 2024-02-18T10:00:59.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680a3560 con 0x7f2368066960 2024-02-18T10:00:59.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236814ac30 con 0x7f2368066dc0 2024-02-18T10:00:59.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f88e77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e0008e30 0x7f88e00c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42962/0 (socket says 172.21.15.118:42962) 2024-02-18T10:00:59.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f463114b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c071000 0x7f462c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236d437640 1 -- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2368066dc0 msgr2=0x7f23680a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f463114b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c09c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236d437640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2368066dc0 0x7f23680a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f463114b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f462c0b5270 0x7f462c1e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462ad9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c071000 0x7f462c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462ad9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c071000 0x7f462c0b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:58306/0 (socket says 172.21.15.118:58306) 2024-02-18T10:00:59.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f463114b640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0b7650 con 0x7f462c0b5270 2024-02-18T10:00:59.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462ad9d640 1 -- 172.21.15.118:0/4285178141 learned_addr learned my addr 172.21.15.118:0/4285178141 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f463114b640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c09ba90 con 0x7f462c071000 2024-02-18T10:00:59.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f463114b640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c09de60 con 0x7f462c0b4a60 2024-02-18T10:00:59.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462a59c640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c09c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236d437640 1 -- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2368066960 msgr2=0x7f236809a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236d437640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2368066960 0x7f236809a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236d437640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360009b30 con 0x7f236806c040 2024-02-18T10:00:59.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462b59e640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f462c0b5270 0x7f462c1e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f236d437640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f236806c040 0x7f236809bbe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f236809d4b0 tx=0x7f235800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f2367fff640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2368066dc0 0x7f23680a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:00:59.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f2400cc0640 1 -- start start 2024-02-18T10:00:59.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f2400cc0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4005180 0x7f23fc0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.645+0000 7f236cc36640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2368066960 0x7f236809a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:59.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f88edfb9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88e00cb910 0x7f88e00363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f2400cc0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc0a4d10 0x7f23fc0a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f23657fa640 1 -- 172.21.15.118:0/1164118413 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580052d0 con 0x7f236806c040 2024-02-18T10:00:59.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f23657fa640 1 -- 172.21.15.118:0/1164118413 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358005430 con 0x7f236806c040 2024-02-18T10:00:59.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f88edfb9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c71b0 con 0x7f88e0008e30 2024-02-18T10:00:59.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f23657fa640 1 -- 172.21.15.118:0/1164118413 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358007220 con 0x7f236806c040 2024-02-18T10:00:59.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f88edfb9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c61f0 con 0x7f88e00cb910 2024-02-18T10:00:59.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f88edfb9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c73a0 con 0x7f88e003dea0 2024-02-18T10:00:59.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f88e7fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88e00cb910 0x7f88e00363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f88e7fff640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88e00cb910 0x7f88e00363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:58314/0 (socket says 172.21.15.118:58314) 2024-02-18T10:00:59.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236809b460 con 0x7f236806c040 2024-02-18T10:00:59.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f88e7fff640 1 -- 172.21.15.118:0/1811858404 learned_addr learned my addr 172.21.15.118:0/1811858404 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f5742853640 1 Processor -- start 2024-02-18T10:00:59.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236809b6c0 con 0x7f236806c040 2024-02-18T10:00:59.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7fbfadfeb640 1 Processor -- start 2024-02-18T10:00:59.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f5742853640 1 -- start start 2024-02-18T10:00:59.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462b59e640 1 -- 172.21.15.118:0/4285178141 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 msgr2=0x7f462c09c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462b59e640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c09c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462b59e640 1 -- 172.21.15.118:0/4285178141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c071000 msgr2=0x7f462c0b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462b59e640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c071000 0x7f462c0b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f462b59e640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620009400 con 0x7f462c0b5270 2024-02-18T10:00:59.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.646+0000 7f23fa59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4005180 0x7f23fc0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f23fa59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4005180 0x7f23fc0b8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:56088/0 (socket says 172.21.15.118:56088) 2024-02-18T10:00:59.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7fbfadfeb640 1 -- start start 2024-02-18T10:00:59.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f462b59e640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f462c0b5270 0x7f462c1e97b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f462400cac0 tx=0x7f462400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f23fa59c640 1 -- 172.21.15.118:0/3157264744 learned_addr learned my addr 172.21.15.118:0/3157264744 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f88e7fff640 1 -- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 msgr2=0x7f88e0035e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-18T10:00:59.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f2400cc0640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23fc0a5190 0x7f23fc0a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f88e6ffd640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 0x7f88e0035e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f88e7fff640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 0x7f88e0035e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f88e7fff640 1 -- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e0008e30 msgr2=0x7f88e00c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f88e7fff640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e0008e30 0x7f88e00c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f88e7fff640 1 -- 172.21.15.118:0/1811858404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0094d0 con 0x7f88e00cb910 2024-02-18T10:00:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0b91d0 con 0x7f23fc0a5190 2024-02-18T10:00:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0a5700 con 0x7f23fc0a4d10 2024-02-18T10:00:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0b9c90 con 0x7f23e4005180 2024-02-18T10:00:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f23fad9d640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23fc0a5190 0x7f23fc0a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7f88e77fe640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e0008e30 0x7f88e00c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd060043340 con 0x7fd06003c7c0 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.647+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd060035de0 con 0x7fd06003c7c0 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23f9d9b640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc0a4d10 0x7f23fc0a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23fa59c640 1 -- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc0a4d10 msgr2=0x7f23fc0a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23fa59c640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc0a4d10 0x7f23fc0a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23fa59c640 1 -- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23fc0a5190 msgr2=0x7f23fc0a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23fa59c640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23fc0a5190 0x7f23fc0a6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23fa59c640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0b9f70 con 0x7f23e4005180 2024-02-18T10:00:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7fbfadfeb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa806e200 0x7fbfa80bbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5742853640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f573c0b3be0 0x7f573c142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5742853640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c0ba680 0x7f573c0a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7fbfadfeb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfa80a11b0 0x7fbfa80b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23fad9d640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23fc0a5190 0x7f23fc0a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:00:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23f9d9b640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc0a4d10 0x7f23fc0a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:00:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23fa59c640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4005180 0x7f23fc0b8c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23ec005880 tx=0x7f23ec00dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5741851640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f573c0b3be0 0x7f573c142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5741851640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f573c0b3be0 0x7f573c142980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:56096/0 (socket says 172.21.15.118:56096) 2024-02-18T10:00:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5741851640 1 -- 172.21.15.118:0/2036807882 learned_addr learned my addr 172.21.15.118:0/2036807882 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5742853640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f573c14b0b0 0x7f573c0a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c142ec0 con 0x7f573c14b0b0 2024-02-18T10:00:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23eaffd640 1 -- 172.21.15.118:0/3157264744 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec005ab0 con 0x7f23e4005180 2024-02-18T10:00:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7fbfa77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa806e200 0x7fbfa80bbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7fbfa77fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa806e200 0x7fbfa80bbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43008/0 (socket says 172.21.15.118:43008) 2024-02-18T10:00:59.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7fbfa77fe640 1 -- 172.21.15.118:0/167095789 learned_addr learned my addr 172.21.15.118:0/167095789 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:00:59.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23eaffd640 1 -- 172.21.15.118:0/3157264744 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec005c10 con 0x7f23e4005180 2024-02-18T10:00:59.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa80b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f23eaffd640 1 -- 172.21.15.118:0/3157264744 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec007070 con 0x7f23e4005180 2024-02-18T10:00:59.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5742052640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f573c14b0b0 0x7f573c0a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23680a15f0 con 0x7f236806c040 2024-02-18T10:00:59.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c1442b0 con 0x7f573c0ba680 2024-02-18T10:00:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5741050640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c0ba680 0x7f573c0a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c144590 con 0x7f573c0b3be0 2024-02-18T10:00:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f46137fe640 1 -- 172.21.15.118:0/4285178141 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400a7c0 con 0x7f462c0b5270 2024-02-18T10:00:59.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7fbfa6ffd640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfa80a11b0 0x7fbfa80b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f46137fe640 1 -- 172.21.15.118:0/4285178141 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462400a920 con 0x7f462c0b5270 2024-02-18T10:00:59.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f46137fe640 1 -- 172.21.15.118:0/4285178141 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462400ac90 con 0x7f462c0b5270 2024-02-18T10:00:59.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f463114b640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c09b7b0 con 0x7f462c0b5270 2024-02-18T10:00:59.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa81453e0 con 0x7fbfa806e200 2024-02-18T10:00:59.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0600057d0 con 0x7fd06003c7c0 2024-02-18T10:00:59.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80bc190 con 0x7fbfa80a11b0 2024-02-18T10:00:59.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc0ba250 con 0x7f23e4005180 2024-02-18T10:00:59.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80b4960 con 0x7fbfa8147c50 2024-02-18T10:00:59.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f463114b640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c0b7de0 con 0x7f462c0b5270 2024-02-18T10:00:59.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc0b47d0 con 0x7f23e4005180 2024-02-18T10:00:59.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.648+0000 7f88e7fff640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88e00cb910 0x7f88e00363d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034830 tx=0x7f88dc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfa7fff640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa80b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f5742052640 1 -- 172.21.15.118:0/2036807882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f573c0b3be0 msgr2=0x7f573c142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f5742052640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f573c0b3be0 0x7f573c142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f5742052640 1 -- 172.21.15.118:0/2036807882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c0ba680 msgr2=0x7f573c0a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f5742052640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c0ba680 0x7f573c0a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f5742052640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573800b770 con 0x7f573c14b0b0 2024-02-18T10:00:59.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7f5742052640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f573c14b0b0 0x7f573c0a1c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f573400c890 tx=0x7f573400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfa77fe640 1 -- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 msgr2=0x7fbfa80b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfa77fe640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa80b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfa77fe640 1 -- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfa80a11b0 msgr2=0x7fbfa80b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:00:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfa77fe640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfa80a11b0 0x7fbfa80b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:00:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.649+0000 7fbfa77fe640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009b30 con 0x7fbfa806e200 2024-02-18T10:00:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7fbfa77fe640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa806e200 0x7fbfa80bbc50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800b3e0 tx=0x7fbf9800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7fd056ffd640 1 -- 172.21.15.118:0/692004565 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fd0680b9070 con 0x7fd06003c7c0 2024-02-18T10:00:59.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7f88d3fff640 1 -- 172.21.15.118:0/1811858404 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc03a8f0 con 0x7f88e00cb910 2024-02-18T10:00:59.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7f88d3fff640 1 -- 172.21.15.118:0/1811858404 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc03aa50 con 0x7f88e00cb910 2024-02-18T10:00:59.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7f88d3fff640 1 -- 172.21.15.118:0/1811858404 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc03adc0 con 0x7f88e00cb910 2024-02-18T10:00:59.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e003ae80 con 0x7f88e00cb910 2024-02-18T10:00:59.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e00c7640 con 0x7f88e00cb910 2024-02-18T10:00:59.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7fd056ffd640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd04806bcf0 0x7fd04806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7fd056ffd640 1 -- 172.21.15.118:0/692004565 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd068127b70 con 0x7fd06003c7c0 2024-02-18T10:00:59.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.650+0000 7f23657fa640 1 -- 172.21.15.118:0/1164118413 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f2358007380 con 0x7f236806c040 2024-02-18T10:00:59.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4604005290 con 0x7f462c0b5270 2024-02-18T10:00:59.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7f23657fa640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f235406bd70 0x7f235406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7fbf8ffff640 1 -- 172.21.15.118:0/167095789 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011830 con 0x7fbfa806e200 2024-02-18T10:00:59.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa8145100 con 0x7fbfa806e200 2024-02-18T10:00:59.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7f23657fa640 1 -- 172.21.15.118:0/1164118413 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2358089900 con 0x7f236806c040 2024-02-18T10:00:59.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7f236cc36640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f235406bd70 0x7f235406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa8155560 con 0x7fbfa806e200 2024-02-18T10:00:59.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.651+0000 7f46137fe640 1 -- 172.21.15.118:0/4285178141 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f4624007150 con 0x7f462c0b5270 2024-02-18T10:00:59.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e00057d0 con 0x7f88e00cb910 2024-02-18T10:00:59.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f236cc36640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f235406bd70 0x7f235406e230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2360009e50 tx=0x7f2360030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f46137fe640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f461806bc70 0x7f461806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f57327fc640 1 -- 172.21.15.118:0/2036807882 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400a640 con 0x7f573c14b0b0 2024-02-18T10:00:59.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f46137fe640 1 -- 172.21.15.118:0/4285178141 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4624089f70 con 0x7f462c0b5270 2024-02-18T10:00:59.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f462ad9d640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f461806bc70 0x7f461806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c0b9120 con 0x7f573c14b0b0 2024-02-18T10:00:59.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc068130 con 0x7f23e4005180 2024-02-18T10:00:59.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.652+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c143640 con 0x7f573c14b0b0 2024-02-18T10:00:59.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7fd06659c640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd04806bcf0 0x7fd04806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa8068130 con 0x7fbfa806e200 2024-02-18T10:00:59.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7f462ad9d640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f461806bc70 0x7f461806e130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f461c006fd0 tx=0x7f461c00f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7f23eaffd640 1 -- 172.21.15.118:0/3157264744 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f23ec0071d0 con 0x7f23e4005180 2024-02-18T10:00:59.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7fd06659c640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd04806bcf0 0x7fd04806e1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009890 tx=0x7fd05c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7f23eaffd640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f23dc06bd70 0x7f23dc06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7f23eaffd640 1 -- 172.21.15.118:0/3157264744 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23ec08a5f0 con 0x7f23e4005180 2024-02-18T10:00:59.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.653+0000 7f23f9d9b640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f23dc06bd70 0x7f23dc06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.654+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c0671d0 con 0x7f573c14b0b0 2024-02-18T10:00:59.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.654+0000 7f23f9d9b640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f23dc06bd70 0x7f23dc06e230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0b9670 tx=0x7f23f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.655+0000 7fd056ffd640 1 -- 172.21.15.118:0/692004565 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0680f2430 con 0x7fd06003c7c0 2024-02-18T10:00:59.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.657+0000 7f57327fc640 1 -- 172.21.15.118:0/2036807882 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400a7a0 con 0x7f573c14b0b0 2024-02-18T10:00:59.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.657+0000 7f57327fc640 1 -- 172.21.15.118:0/2036807882 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400ab50 con 0x7f573c14b0b0 2024-02-18T10:00:59.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.657+0000 7f23657fa640 1 -- 172.21.15.118:0/1164118413 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23680a15f0 con 0x7f236806c040 2024-02-18T10:00:59.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.657+0000 7fbf8ffff640 1 -- 172.21.15.118:0/167095789 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf98011990 con 0x7fbfa806e200 2024-02-18T10:00:59.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.657+0000 7fbf8ffff640 1 -- 172.21.15.118:0/167095789 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98011d60 con 0x7fbfa806e200 2024-02-18T10:00:59.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.657+0000 7f88d3fff640 1 -- 172.21.15.118:0/1811858404 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f88dc043040 con 0x7f88e00cb910 2024-02-18T10:00:59.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.657+0000 7f88d3fff640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f88cc06bd40 0x7f88cc06e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.658+0000 7f88d3fff640 1 -- 172.21.15.118:0/1811858404 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88dc0b5400 con 0x7f88e00cb910 2024-02-18T10:00:59.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.658+0000 7f88e77fe640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f88cc06bd40 0x7f88cc06e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.658+0000 7f23eaffd640 1 -- 172.21.15.118:0/3157264744 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23ec054e40 con 0x7f23e4005180 2024-02-18T10:00:59.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.659+0000 7f88e77fe640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f88cc06bd40 0x7f88cc06e200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88e8073e30 tx=0x7f88e806e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.660+0000 7f88d3fff640 1 -- 172.21.15.118:0/1811858404 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f88dc07fbc0 con 0x7f88e00cb910 2024-02-18T10:00:59.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.663+0000 7f46137fe640 1 -- 172.21.15.118:0/4285178141 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46240547f0 con 0x7f462c0b5270 2024-02-18T10:00:59.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.665+0000 7fbf8ffff640 1 -- 172.21.15.118:0/167095789 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fbf9801a400 con 0x7fbfa806e200 2024-02-18T10:00:59.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.666+0000 7f57327fc640 1 -- 172.21.15.118:0/2036807882 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f573400acb0 con 0x7f573c14b0b0 2024-02-18T10:00:59.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.667+0000 7f57327fc640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f572006bc70 0x7f572006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.668+0000 7fbf8ffff640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbf9406bc70 0x7fbf9406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:00:59.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.668+0000 7f57327fc640 1 -- 172.21.15.118:0/2036807882 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f573408a6b0 con 0x7f573c14b0b0 2024-02-18T10:00:59.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.668+0000 7fbf8ffff640 1 -- 172.21.15.118:0/167095789 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf9808ae10 con 0x7fbfa806e200 2024-02-18T10:00:59.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.668+0000 7f5741851640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f572006bc70 0x7f572006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.669+0000 7fbfa6ffd640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbf9406bc70 0x7fbf9406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:00:59.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.669+0000 7fbfa6ffd640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbf9406bc70 0x7fbf9406e130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c006fd0 tx=0x7fbf9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.670+0000 7f5741851640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f572006bc70 0x7f572006e130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5738000c00 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:00:59.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.672+0000 7fbf8ffff640 1 -- 172.21.15.118:0/167095789 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf98055640 con 0x7fbfa806e200 2024-02-18T10:00:59.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:00:59.681+0000 7f57327fc640 1 -- 172.21.15.118:0/2036807882 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5734054df0 con 0x7f573c14b0b0 2024-02-18T10:01:00.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.006+0000 7f540ae40640 1 -- 172.21.15.118:0/501541825 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f53e4005540 con 0x7f53fc008e30 2024-02-18T10:01:00.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.007+0000 7f54017fa640 1 -- 172.21.15.118:0/501541825 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53f80581c0 con 0x7f53fc008e30 2024-02-18T10:01:00.009 INFO:teuthology.orchestra.run.smithi118.stdout:55834574855 2024-02-18T10:01:00.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.010+0000 7f53eeffd640 1 -- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f53e806bd70 msgr2=0x7f53e806e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.010+0000 7f53eeffd640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f53e806bd70 0x7f53e806e230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53f0006fd0 tx=0x7f53f0006b40 comp rx=0 tx=0).stop 2024-02-18T10:01:00.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.010+0000 7f53eeffd640 1 -- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc008e30 msgr2=0x7f53fc027e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.010+0000 7f53eeffd640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc008e30 0x7f53fc027e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c780 tx=0x7f53f800cc40 comp rx=0 tx=0).stop 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 -- 172.21.15.118:0/501541825 shutdown_connections 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f53e806bd70 0x7f53e806e230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53fc038a70 0x7f53fc03af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f53fc03c690 0x7f53fc038530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 --2- 172.21.15.118:0/501541825 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc008e30 0x7f53fc027e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 -- 172.21.15.118:0/501541825 >> 172.21.15.118:0/501541825 conn(0x7f53fc00a530 msgr2=0x7f53fc0d7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 -- 172.21.15.118:0/501541825 shutdown_connections 2024-02-18T10:01:00.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.011+0000 7f53eeffd640 1 -- 172.21.15.118:0/501541825 wait complete. 2024-02-18T10:01:00.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-02-18T10:01:00.031 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.042+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f23680a15f0 con 0x7f236806c040 2024-02-18T10:01:00.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.042+0000 7f23657fa640 1 -- 172.21.15.118:0/1164118413 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23680a15f0 con 0x7f236806c040 2024-02-18T10:01:00.045 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:01:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.044+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f235406bd70 msgr2=0x7f235406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.044+0000 7f236dc38640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f235406bd70 0x7f235406e230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2360009e50 tx=0x7f2360030000 comp rx=0 tx=0).stop 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.044+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f236806c040 msgr2=0x7f236809bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.044+0000 7f236dc38640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f236806c040 0x7f236809bbe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f236809d4b0 tx=0x7f235800c820 comp rx=0 tx=0).stop 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 shutdown_connections 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f235406bd70 0x7f235406e230 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f236806c040 0x7f236809bbe0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2368066dc0 0x7f23680a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 --2- 172.21.15.118:0/1164118413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2368066960 0x7f236809a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 >> 172.21.15.118:0/1164118413 conn(0x7f23680ba3c0 msgr2=0x7f236809d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 shutdown_connections 2024-02-18T10:01:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.045+0000 7f236dc38640 1 -- 172.21.15.118:0/1164118413 wait complete. 2024-02-18T10:01:00.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.046+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd06000b120 con 0x7fd06003c7c0 2024-02-18T10:01:00.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.047+0000 7fd056ffd640 1 -- 172.21.15.118:0/692004565 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0680f5af0 con 0x7fd06003c7c0 2024-02-18T10:01:00.050 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd04806bcf0 msgr2=0x7fd04806e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd04806bcf0 0x7fd04806e1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009890 tx=0x7fd05c008040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd06003c7c0 msgr2=0x7fd06003cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd06003c7c0 0x7fd06003cc50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd06806aa60 tx=0x7fd068069980 comp rx=0 tx=0).stop 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 shutdown_connections 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd04806bcf0 0x7fd04806e1b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd06003c7c0 0x7fd06003cc50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd060041950 0x7fd0600d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 --2- 172.21.15.118:0/692004565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd060008e30 0x7fd0600cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 >> 172.21.15.118:0/692004565 conn(0x7fd06000a530 msgr2=0x7fd0600059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 shutdown_connections 2024-02-18T10:01:00.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.050+0000 7fd06ca39640 1 -- 172.21.15.118:0/692004565 wait complete. 2024-02-18T10:01:00.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-02-18T10:01:00.059 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-02-18T10:01:00.069 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.068+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23fc0b9dd0 con 0x7f23e4005180 2024-02-18T10:01:00.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.069+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbfa80b5020 con 0x7fbfa806e200 2024-02-18T10:01:00.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.069+0000 7f23eaffd640 1 -- 172.21.15.118:0/3157264744 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23fc0b9dd0 con 0x7f23e4005180 2024-02-18T10:01:00.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.069+0000 7fbf8ffff640 1 -- 172.21.15.118:0/167095789 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf98015090 con 0x7fbfa806e200 2024-02-18T10:01:00.072 INFO:teuthology.orchestra.run.smithi118.stdout:55834574855 2024-02-18T10:01:00.072 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-02-18T10:01:00.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4604005540 con 0x7f462c0b5270 2024-02-18T10:01:00.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbf9406bc70 msgr2=0x7fbf9406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbf9406bc70 0x7fbf9406e130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c006fd0 tx=0x7fbf9c008040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa806e200 msgr2=0x7fbfa80bbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa806e200 0x7fbfa80bbc50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800b3e0 tx=0x7fbf9800b8a0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 shutdown_connections 2024-02-18T10:01:00.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbf9406bc70 0x7fbf9406e130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7f46137fe640 1 -- 172.21.15.118:0/4285178141 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4624057eb0 con 0x7f462c0b5270 2024-02-18T10:01:00.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfa8147c50 0x7fbfa80b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfa80a11b0 0x7fbfa80b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 --2- 172.21.15.118:0/167095789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa806e200 0x7fbfa80bbc50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.071+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 >> 172.21.15.118:0/167095789 conn(0x7fbfa80b9c30 msgr2=0x7fbfa80a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.075 INFO:teuthology.orchestra.run.smithi118.stdout:55834574853 2024-02-18T10:01:00.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 shutdown_connections 2024-02-18T10:01:00.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7fbfadfeb640 1 -- 172.21.15.118:0/167095789 wait complete. 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f23dc06bd70 msgr2=0x7f23dc06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f23dc06bd70 0x7f23dc06e230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0b9670 tx=0x7f23f0008040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4005180 msgr2=0x7f23fc0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4005180 0x7f23fc0b8c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23ec005880 tx=0x7f23ec00dc00 comp rx=0 tx=0).stop 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 shutdown_connections 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f23dc06bd70 0x7f23dc06e230 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f23fc0a5190 0x7f23fc0a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc0a4d10 0x7f23fc0a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 --2- 172.21.15.118:0/3157264744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f23e4005180 0x7f23fc0b8c90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 >> 172.21.15.118:0/3157264744 conn(0x7f23fc0c1530 msgr2=0x7f23fc1d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 shutdown_connections 2024-02-18T10:01:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.072+0000 7f2400cc0640 1 -- 172.21.15.118:0/3157264744 wait complete. 2024-02-18T10:01:00.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f461806bc70 msgr2=0x7f461806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f461806bc70 0x7f461806e130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f461c006fd0 tx=0x7f461c00f040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f462c0b5270 msgr2=0x7f462c1e97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f462c0b5270 0x7f462c1e97b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f462400cac0 tx=0x7f462400cf80 comp rx=0 tx=0).stop 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 shutdown_connections 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f461806bc70 0x7f461806e130 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f462c0b5270 0x7f462c1e97b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f462c0b4a60 0x7f462c09c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 --2- 172.21.15.118:0/4285178141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f462c071000 0x7f462c0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 >> 172.21.15.118:0/4285178141 conn(0x7f462c0bebc0 msgr2=0x7f462c071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 shutdown_connections 2024-02-18T10:01:00.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.074+0000 7f46117fa640 1 -- 172.21.15.118:0/4285178141 wait complete. 2024-02-18T10:01:00.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.076+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f88e00294a0 con 0x7f88e00cb910 2024-02-18T10:01:00.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.077+0000 7f88d3fff640 1 -- 172.21.15.118:0/1811858404 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88dc04c020 con 0x7f88e00cb910 2024-02-18T10:01:00.080 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-02-18T10:01:00.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f88cc06bd40 msgr2=0x7f88cc06e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f88cc06bd40 0x7f88cc06e200 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88e8073e30 tx=0x7f88e806e040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88e00cb910 msgr2=0x7f88e00363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88e00cb910 0x7f88e00363d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034830 tx=0x7f88dc0046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 shutdown_connections 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f88cc06bd40 0x7f88cc06e200 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f88e00cb910 0x7f88e00363d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f88e003dea0 0x7f88e0035e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 --2- 172.21.15.118:0/1811858404 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e0008e30 0x7f88e00c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 >> 172.21.15.118:0/1811858404 conn(0x7f88e000a530 msgr2=0x7f88e0023970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 shutdown_connections 2024-02-18T10:01:00.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.079+0000 7f88edfb9640 1 -- 172.21.15.118:0/1811858404 wait complete. 2024-02-18T10:01:00.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.083+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f573c0a1440 con 0x7f573c14b0b0 2024-02-18T10:01:00.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.084+0000 7f57327fc640 1 -- 172.21.15.118:0/2036807882 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f573c0a1440 con 0x7f573c14b0b0 2024-02-18T10:01:00.086 INFO:teuthology.orchestra.run.smithi118.stdout:55834574854 2024-02-18T10:01:00.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-02-18T10:01:00.088 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-02-18T10:01:00.089 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f572006bc70 msgr2=0x7f572006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f572006bc70 0x7f572006e130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5738000c00 tx=0x7f5738008040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f573c14b0b0 msgr2=0x7f573c0a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f573c14b0b0 0x7f573c0a1c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f573400c890 tx=0x7f573400cd50 comp rx=0 tx=0).stop 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 shutdown_connections 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f572006bc70 0x7f572006e130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f573c14b0b0 0x7f573c0a1c60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f573c0ba680 0x7f573c0a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.087+0000 7f5742853640 1 --2- 172.21.15.118:0/2036807882 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f573c0b3be0 0x7f573c142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.088+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 >> 172.21.15.118:0/2036807882 conn(0x7f573c0b9b90 msgr2=0x7f573c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.088+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 shutdown_connections 2024-02-18T10:01:00.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.088+0000 7f5742853640 1 -- 172.21.15.118:0/2036807882 wait complete. 2024-02-18T10:01:00.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-02-18T10:01:00.096 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-02-18T10:01:00.096 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-02-18T10:01:00.101 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:00.102 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-18T10:01:00.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:01:00.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.239+0000 7fea015a0640 1 Processor -- start 2024-02-18T10:01:00.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.239+0000 7fea015a0640 1 -- start start 2024-02-18T10:01:00.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.239+0000 7fea015a0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc06b7e0 0x7fe9fc14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.239+0000 7fea015a0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9fc0bd090 0x7fe9fc14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.239+0000 7fea015a0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc0bc190 con 0x7fe9fc0a66a0 2024-02-18T10:01:00.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.239+0000 7fea015a0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0c07b0 con 0x7fe9fc0bd090 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.239+0000 7fea015a0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0c0a50 con 0x7fe9fc06b7e0 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fb7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9fc0bd090 0x7fe9fc14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fea00d9f640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe9fc0a66a0 0x7fe9fc0a6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38674/0 (socket says 172.21.15.118:38674) 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fb7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe9fc0bd090 0x7fe9fc14c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43024/0 (socket says 172.21.15.118:43024) 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fea00d9f640 1 -- 172.21.15.118:0/1841205422 learned_addr learned my addr 172.21.15.118:0/1841205422 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fb7fe640 1 -- 172.21.15.118:0/1841205422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc06b7e0 msgr2=0x7fe9fc14bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fbfff640 1 --2- 172.21.15.118:0/1841205422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc06b7e0 0x7fe9fc14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fb7fe640 1 --2- 172.21.15.118:0/1841205422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc06b7e0 0x7fe9fc14bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fb7fe640 1 -- 172.21.15.118:0/1841205422 >> v1:172.21.15.118:6789/0 conn(0x7fe9fc0a66a0 legacy=0x7fe9fc0a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9faffd640 1 -- 172.21.15.118:0/1841205422 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351525763 0 0) 0x7fe9fc0bc190 con 0x7fe9fc0a66a0 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fb7fe640 1 -- 172.21.15.118:0/1841205422 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0c0d30 con 0x7fe9fc0bd090 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.240+0000 7fe9fbfff640 1 --2- 172.21.15.118:0/1841205422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc06b7e0 0x7fe9fc14bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fe9fb7fe640 1 --2- 172.21.15.118:0/1841205422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc14c1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00097a0 tx=0x7fe9f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2e95c4321e499e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fe9faffd640 1 -- 172.21.15.118:0/1841205422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f002e070 con 0x7fe9fc0bd090 2024-02-18T10:01:00.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fe9faffd640 1 -- 172.21.15.118:0/1841205422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f00315a0 con 0x7fe9fc0bd090 2024-02-18T10:01:00.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fe9faffd640 1 -- 172.21.15.118:0/1841205422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0031930 con 0x7fe9fc0bd090 2024-02-18T10:01:00.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 -- 172.21.15.118:0/1841205422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 msgr2=0x7fe9fc14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 --2- 172.21.15.118:0/1841205422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc14c1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00097a0 tx=0x7fe9f002b840 comp rx=0 tx=0).stop 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 -- 172.21.15.118:0/1841205422 shutdown_connections 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 --2- 172.21.15.118:0/1841205422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc14c1d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 --2- 172.21.15.118:0/1841205422 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc06b7e0 0x7fe9fc14bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 -- 172.21.15.118:0/1841205422 >> 172.21.15.118:0/1841205422 conn(0x7fe9fc0c1330 msgr2=0x7fe9fc0c1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 -- 172.21.15.118:0/1841205422 shutdown_connections 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.241+0000 7fea015a0640 1 -- 172.21.15.118:0/1841205422 wait complete. 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.242+0000 7fea015a0640 1 Processor -- start 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.242+0000 7fea015a0640 1 -- start start 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea015a0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9fc06b7e0 0x7fe9fc0bb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea015a0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc0a66a0 0x7fe9fc0b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea015a0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc0b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea015a0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc09cc30 con 0x7fe9fc0bd090 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea015a0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc1e5340 con 0x7fe9fc06b7e0 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea015a0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc1e5620 con 0x7fe9fc0a66a0 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc0b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc0b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43026/0 (socket says 172.21.15.118:43026) 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 -- 172.21.15.118:0/1699510714 learned_addr learned my addr 172.21.15.118:0/1699510714 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fe9fbfff640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9fc06b7e0 0x7fe9fc0bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fe9fb7fe640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc0a66a0 0x7fe9fc0b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 -- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc0a66a0 msgr2=0x7fe9fc0b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc0a66a0 0x7fe9fc0b86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 -- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9fc06b7e0 msgr2=0x7fe9fc0bb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9fc06b7e0 0x7fe9fc0bb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fea00d9f640 1 -- 172.21.15.118:0/1699510714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f0009400 con 0x7fe9fc0bd090 2024-02-18T10:01:00.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fe9fbfff640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9fc06b7e0 0x7fe9fc0bb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.243+0000 7fe9fb7fe640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc0a66a0 0x7fe9fc0b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.244+0000 7fea00d9f640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc0b8c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c7a0 tx=0x7fe9f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.244+0000 7fe9f8ff9640 1 -- 172.21.15.118:0/1699510714 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400a640 con 0x7fe9fc0bd090 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.244+0000 7fe9f8ff9640 1 -- 172.21.15.118:0/1699510714 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400a7a0 con 0x7fe9fc0bd090 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.244+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc1e5900 con 0x7fe9fc0bd090 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.244+0000 7fe9f8ff9640 1 -- 172.21.15.118:0/1699510714 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400abd0 con 0x7fe9fc0bd090 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.244+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc0a0560 con 0x7fe9fc0bd090 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.245+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc1e51a0 con 0x7fe9fc0bd090 2024-02-18T10:01:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.245+0000 7fe9f8ff9640 1 -- 172.21.15.118:0/1699510714 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe9f400ad30 con 0x7fe9fc0bd090 2024-02-18T10:01:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.245+0000 7fe9f8ff9640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe9e806bc70 0x7fe9e806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.246+0000 7fe9f8ff9640 1 -- 172.21.15.118:0/1699510714 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f408a080 con 0x7fe9fc0bd090 2024-02-18T10:01:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.246+0000 7fe9fbfff640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe9e806bc70 0x7fe9e806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.246+0000 7fe9fbfff640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe9e806bc70 0x7fe9e806e130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006fd0 tx=0x7fe9ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.250+0000 7fe9f8ff9640 1 -- 172.21.15.118:0/1699510714 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9fc1e51a0 con 0x7fe9fc0bd090 2024-02-18T10:01:00.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.417+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9fc1e54b0 con 0x7fe9e806bc70 2024-02-18T10:01:00.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.423+0000 7fe9f8ff9640 1 -- 172.21.15.118:0/1699510714 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7fe9fc1e54b0 con 0x7fe9e806bc70 2024-02-18T10:01:00.428 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:00.430 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:01:00.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe9e806bc70 msgr2=0x7fe9e806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe9e806bc70 0x7fe9e806e130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006fd0 tx=0x7fe9ec008040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 msgr2=0x7fe9fc0b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc0b8c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c7a0 tx=0x7fe9f400cc60 comp rx=0 tx=0).stop 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 shutdown_connections 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe9e806bc70 0x7fe9e806e130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe9fc0bd090 0x7fe9fc0b8c00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9fc0a66a0 0x7fe9fc0b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 --2- 172.21.15.118:0/1699510714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9fc06b7e0 0x7fe9fc0bb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 >> 172.21.15.118:0/1699510714 conn(0x7fe9fc0c1330 msgr2=0x7fe9fc0a42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 shutdown_connections 2024-02-18T10:01:00.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.426+0000 7fea015a0640 1 -- 172.21.15.118:0/1699510714 wait complete. 2024-02-18T10:01:00.439 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-18T10:00:59.280056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235724,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738996,"statfs":{"total":773094113280,"available":772852731904,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002158"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086380+0000","last_change":"2024-02-18T10:00:48.762372+0000","last_active":"2024-02-18T10:00:51.086380+0000","last_peered":"2024-02-18T10:00:51.086380+0000","last_clean":"2024-02-18T10:00:51.086380+0000","last_became_active":"2024-02-18T10:00:48.762116+0000","last_became_peered":"2024-02-18T10:00:48.762116+0000","last_unstale":"2024-02-18T10:00:51.086380+0000","last_undegraded":"2024-02-18T10:00:51.086380+0000","last_fullsized":"2024-02-18T10:00:51.086380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736363+0000","last_change":"2024-02-18T10:00:48.749144+0000","last_active":"2024-02-18T10:00:49.736363+0000","last_peered":"2024-02-18T10:00:49.736363+0000","last_clean":"2024-02-18T10:00:49.736363+0000","last_became_active":"2024-02-18T10:00:48.748769+0000","last_became_peered":"2024-02-18T10:00:48.748769+0000","last_unstale":"2024-02-18T10:00:49.736363+0000","last_undegraded":"2024-02-18T10:00:49.736363+0000","last_fullsized":"2024-02-18T10:00:49.736363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085421+0000","last_change":"2024-02-18T10:00:48.746009+0000","last_active":"2024-02-18T10:00:51.085421+0000","last_peered":"2024-02-18T10:00:51.085421+0000","last_clean":"2024-02-18T10:00:51.085421+0000","last_became_active":"2024-02-18T10:00:48.745723+0000","last_became_peered":"2024-02-18T10:00:48.745723+0000","last_unstale":"2024-02-18T10:00:51.085421+0000","last_undegraded":"2024-02-18T10:00:51.085421+0000","last_fullsized":"2024-02-18T10:00:51.085421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086634+0000","last_change":"2024-02-18T10:00:48.765838+0000","last_active":"2024-02-18T10:00:51.086634+0000","last_peered":"2024-02-18T10:00:51.086634+0000","last_clean":"2024-02-18T10:00:51.086634+0000","last_became_active":"2024-02-18T10:00:48.765603+0000","last_became_peered":"2024-02-18T10:00:48.765603+0000","last_unstale":"2024-02-18T10:00:51.086634+0000","last_undegraded":"2024-02-18T10:00:51.086634+0000","last_fullsized":"2024-02-18T10:00:51.086634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086270+0000","last_change":"2024-02-18T10:00:48.756241+0000","last_active":"2024-02-18T10:00:51.086270+0000","last_peered":"2024-02-18T10:00:51.086270+0000","last_clean":"2024-02-18T10:00:51.086270+0000","last_became_active":"2024-02-18T10:00:48.755053+0000","last_became_peered":"2024-02-18T10:00:48.755053+0000","last_unstale":"2024-02-18T10:00:51.086270+0000","last_undegraded":"2024-02-18T10:00:51.086270+0000","last_fullsized":"2024-02-18T10:00:51.086270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086826+0000","last_change":"2024-02-18T10:00:48.752872+0000","last_active":"2024-02-18T10:00:51.086826+0000","last_peered":"2024-02-18T10:00:51.086826+0000","last_clean":"2024-02-18T10:00:51.086826+0000","last_became_active":"2024-02-18T10:00:48.752303+0000","last_became_peered":"2024-02-18T10:00:48.752303+0000","last_unstale":"2024-02-18T10:00:51.086826+0000","last_undegraded":"2024-02-18T10:00:51.086826+0000","last_fullsized":"2024-02-18T10:00:51.086826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085945+0000","last_change":"2024-02-18T10:00:48.761872+0000","last_active":"2024-02-18T10:00:51.085945+0000","last_peered":"2024-02-18T10:00:51.085945+0000","last_clean":"2024-02-18T10:00:51.085945+0000","last_became_active":"2024-02-18T10:00:48.761571+0000","last_became_peered":"2024-02-18T10:00:48.761571+0000","last_unstale":"2024-02-18T10:00:51.085945+0000","last_undegraded":"2024-02-18T10:00:51.085945+0000","last_fullsized":"2024-02-18T10:00:51.085945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172589+0000","last_change":"2024-02-18T10:00:48.769207+0000","last_active":"2024-02-18T10:00:50.172589+0000","last_peered":"2024-02-18T10:00:50.172589+0000","last_clean":"2024-02-18T10:00:50.172589+0000","last_became_active":"2024-02-18T10:00:48.768911+0000","last_became_peered":"2024-02-18T10:00:48.768911+0000","last_unstale":"2024-02-18T10:00:50.172589+0000","last_undegraded":"2024-02-18T10:00:50.172589+0000","last_fullsized":"2024-02-18T10:00:50.172589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086809+0000","last_change":"2024-02-18T10:00:48.767470+0000","last_active":"2024-02-18T10:00:51.086809+0000","last_peered":"2024-02-18T10:00:51.086809+0000","last_clean":"2024-02-18T10:00:51.086809+0000","last_became_active":"2024-02-18T10:00:48.767204+0000","last_became_peered":"2024-02-18T10:00:48.767204+0000","last_unstale":"2024-02-18T10:00:51.086809+0000","last_undegraded":"2024-02-18T10:00:51.086809+0000","last_fullsized":"2024-02-18T10:00:51.086809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:44.598357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738102+0000","last_change":"2024-02-18T10:00:48.767769+0000","last_active":"2024-02-18T10:00:49.738102+0000","last_peered":"2024-02-18T10:00:49.738102+0000","last_clean":"2024-02-18T10:00:49.738102+0000","last_became_active":"2024-02-18T10:00:48.767502+0000","last_became_peered":"2024-02-18T10:00:48.767502+0000","last_unstale":"2024-02-18T10:00:49.738102+0000","last_undegraded":"2024-02-18T10:00:49.738102+0000","last_fullsized":"2024-02-18T10:00:49.738102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737554+0000","last_change":"2024-02-18T10:00:48.766859+0000","last_active":"2024-02-18T10:00:49.737554+0000","last_peered":"2024-02-18T10:00:49.737554+0000","last_clean":"2024-02-18T10:00:49.737554+0000","last_became_active":"2024-02-18T10:00:48.766595+0000","last_became_peered":"2024-02-18T10:00:48.766595+0000","last_unstale":"2024-02-18T10:00:49.737554+0000","last_undegraded":"2024-02-18T10:00:49.737554+0000","last_fullsized":"2024-02-18T10:00:49.737554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:45:13.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738472+0000","last_change":"2024-02-18T10:00:48.755535+0000","last_active":"2024-02-18T10:00:49.738472+0000","last_peered":"2024-02-18T10:00:49.738472+0000","last_clean":"2024-02-18T10:00:49.738472+0000","last_became_active":"2024-02-18T10:00:48.755267+0000","last_became_peered":"2024-02-18T10:00:48.755267+0000","last_unstale":"2024-02-18T10:00:49.738472+0000","last_undegraded":"2024-02-18T10:00:49.738472+0000","last_fullsized":"2024-02-18T10:00:49.738472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:49.765437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172950+0000","last_change":"2024-02-18T10:00:48.750469+0000","last_active":"2024-02-18T10:00:50.172950+0000","last_peered":"2024-02-18T10:00:50.172950+0000","last_clean":"2024-02-18T10:00:50.172950+0000","last_became_active":"2024-02-18T10:00:48.750226+0000","last_became_peered":"2024-02-18T10:00:48.750226+0000","last_unstale":"2024-02-18T10:00:50.172950+0000","last_undegraded":"2024-02-18T10:00:50.172950+0000","last_fullsized":"2024-02-18T10:00:50.172950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:16:25.495152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085186+0000","last_change":"2024-02-18T10:00:48.750924+0000","last_active":"2024-02-18T10:00:51.085186+0000","last_peered":"2024-02-18T10:00:51.085186+0000","last_clean":"2024-02-18T10:00:51.085186+0000","last_became_active":"2024-02-18T10:00:48.750592+0000","last_became_peered":"2024-02-18T10:00:48.750592+0000","last_unstale":"2024-02-18T10:00:51.085186+0000","last_undegraded":"2024-02-18T10:00:51.085186+0000","last_fullsized":"2024-02-18T10:00:51.085186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:27:13.111020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736200+0000","last_change":"2024-02-18T10:00:48.746265+0000","last_active":"2024-02-18T10:00:49.736200+0000","last_peered":"2024-02-18T10:00:49.736200+0000","last_clean":"2024-02-18T10:00:49.736200+0000","last_became_active":"2024-02-18T10:00:48.746015+0000","last_became_peered":"2024-02-18T10:00:48.746015+0000","last_unstale":"2024-02-18T10:00:49.736200+0000","last_undegraded":"2024-02-18T10:00:49.736200+0000","last_fullsized":"2024-02-18T10:00:49.736200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086113+0000","last_change":"2024-02-18T10:00:48.753217+0000","last_active":"2024-02-18T10:00:51.086113+0000","last_peered":"2024-02-18T10:00:51.086113+0000","last_clean":"2024-02-18T10:00:51.086113+0000","last_became_active":"2024-02-18T10:00:48.752488+0000","last_became_peered":"2024-02-18T10:00:48.752488+0000","last_unstale":"2024-02-18T10:00:51.086113+0000","last_undegraded":"2024-02-18T10:00:51.086113+0000","last_fullsized":"2024-02-18T10:00:51.086113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087297+0000","last_change":"2024-02-18T10:00:48.763358+0000","last_active":"2024-02-18T10:00:51.087297+0000","last_peered":"2024-02-18T10:00:51.087297+0000","last_clean":"2024-02-18T10:00:51.087297+0000","last_became_active":"2024-02-18T10:00:48.762822+0000","last_became_peered":"2024-02-18T10:00:48.762822+0000","last_unstale":"2024-02-18T10:00:51.087297+0000","last_undegraded":"2024-02-18T10:00:51.087297+0000","last_fullsized":"2024-02-18T10:00:51.087297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:18.873439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584653+0000","last_change":"2024-02-18T10:00:48.751879+0000","last_active":"2024-02-18T10:00:50.584653+0000","last_peered":"2024-02-18T10:00:50.584653+0000","last_clean":"2024-02-18T10:00:50.584653+0000","last_became_active":"2024-02-18T10:00:48.751596+0000","last_became_peered":"2024-02-18T10:00:48.751596+0000","last_unstale":"2024-02-18T10:00:50.584653+0000","last_undegraded":"2024-02-18T10:00:50.584653+0000","last_fullsized":"2024-02-18T10:00:50.584653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:58:39.082250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086833+0000","last_change":"2024-02-18T10:00:48.756771+0000","last_active":"2024-02-18T10:00:51.086833+0000","last_peered":"2024-02-18T10:00:51.086833+0000","last_clean":"2024-02-18T10:00:51.086833+0000","last_became_active":"2024-02-18T10:00:48.756506+0000","last_became_peered":"2024-02-18T10:00:48.756506+0000","last_unstale":"2024-02-18T10:00:51.086833+0000","last_undegraded":"2024-02-18T10:00:51.086833+0000","last_fullsized":"2024-02-18T10:00:51.086833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:40:48.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737843+0000","last_change":"2024-02-18T10:00:48.763478+0000","last_active":"2024-02-18T10:00:49.737843+0000","last_peered":"2024-02-18T10:00:49.737843+0000","last_clean":"2024-02-18T10:00:49.737843+0000","last_became_active":"2024-02-18T10:00:48.762974+0000","last_became_peered":"2024-02-18T10:00:48.762974+0000","last_unstale":"2024-02-18T10:00:49.737843+0000","last_undegraded":"2024-02-18T10:00:49.737843+0000","last_fullsized":"2024-02-18T10:00:49.737843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085325+0000","last_change":"2024-02-18T10:00:48.755841+0000","last_active":"2024-02-18T10:00:51.085325+0000","last_peered":"2024-02-18T10:00:51.085325+0000","last_clean":"2024-02-18T10:00:51.085325+0000","last_became_active":"2024-02-18T10:00:48.755563+0000","last_became_peered":"2024-02-18T10:00:48.755563+0000","last_unstale":"2024-02-18T10:00:51.085325+0000","last_undegraded":"2024-02-18T10:00:51.085325+0000","last_fullsized":"2024-02-18T10:00:51.085325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:55:44.537624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086926+0000","last_change":"2024-02-18T10:00:48.763939+0000","last_active":"2024-02-18T10:00:51.086926+0000","last_peered":"2024-02-18T10:00:51.086926+0000","last_clean":"2024-02-18T10:00:51.086926+0000","last_became_active":"2024-02-18T10:00:48.763645+0000","last_became_peered":"2024-02-18T10:00:48.763645+0000","last_unstale":"2024-02-18T10:00:51.086926+0000","last_undegraded":"2024-02-18T10:00:51.086926+0000","last_fullsized":"2024-02-18T10:00:51.086926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172661+0000","last_change":"2024-02-18T10:00:48.746911+0000","last_active":"2024-02-18T10:00:50.172661+0000","last_peered":"2024-02-18T10:00:50.172661+0000","last_clean":"2024-02-18T10:00:50.172661+0000","last_became_active":"2024-02-18T10:00:48.746634+0000","last_became_peered":"2024-02-18T10:00:48.746634+0000","last_unstale":"2024-02-18T10:00:50.172661+0000","last_undegraded":"2024-02-18T10:00:50.172661+0000","last_fullsized":"2024-02-18T10:00:50.172661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086406+0000","last_change":"2024-02-18T10:00:48.757610+0000","last_active":"2024-02-18T10:00:51.086406+0000","last_peered":"2024-02-18T10:00:51.086406+0000","last_clean":"2024-02-18T10:00:51.086406+0000","last_became_active":"2024-02-18T10:00:48.757334+0000","last_became_peered":"2024-02-18T10:00:48.757334+0000","last_unstale":"2024-02-18T10:00:51.086406+0000","last_undegraded":"2024-02-18T10:00:51.086406+0000","last_fullsized":"2024-02-18T10:00:51.086406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172992+0000","last_change":"2024-02-18T10:00:48.746788+0000","last_active":"2024-02-18T10:00:50.172992+0000","last_peered":"2024-02-18T10:00:50.172992+0000","last_clean":"2024-02-18T10:00:50.172992+0000","last_became_active":"2024-02-18T10:00:48.746523+0000","last_became_peered":"2024-02-18T10:00:48.746523+0000","last_unstale":"2024-02-18T10:00:50.172992+0000","last_undegraded":"2024-02-18T10:00:50.172992+0000","last_fullsized":"2024-02-18T10:00:50.172992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738283+0000","last_change":"2024-02-18T10:00:48.756429+0000","last_active":"2024-02-18T10:00:49.738283+0000","last_peered":"2024-02-18T10:00:49.738283+0000","last_clean":"2024-02-18T10:00:49.738283+0000","last_became_active":"2024-02-18T10:00:48.756141+0000","last_became_peered":"2024-02-18T10:00:48.756141+0000","last_unstale":"2024-02-18T10:00:49.738283+0000","last_undegraded":"2024-02-18T10:00:49.738283+0000","last_fullsized":"2024-02-18T10:00:49.738283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736343+0000","last_change":"2024-02-18T10:00:48.742514+0000","last_active":"2024-02-18T10:00:49.736343+0000","last_peered":"2024-02-18T10:00:49.736343+0000","last_clean":"2024-02-18T10:00:49.736343+0000","last_became_active":"2024-02-18T10:00:48.742264+0000","last_became_peered":"2024-02-18T10:00:48.742264+0000","last_unstale":"2024-02-18T10:00:49.736343+0000","last_undegraded":"2024-02-18T10:00:49.736343+0000","last_fullsized":"2024-02-18T10:00:49.736343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172990+0000","last_change":"2024-02-18T10:00:48.746831+0000","last_active":"2024-02-18T10:00:50.172990+0000","last_peered":"2024-02-18T10:00:50.172990+0000","last_clean":"2024-02-18T10:00:50.172990+0000","last_became_active":"2024-02-18T10:00:48.746574+0000","last_became_peered":"2024-02-18T10:00:48.746574+0000","last_unstale":"2024-02-18T10:00:50.172990+0000","last_undegraded":"2024-02-18T10:00:50.172990+0000","last_fullsized":"2024-02-18T10:00:50.172990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085359+0000","last_change":"2024-02-18T10:00:48.752619+0000","last_active":"2024-02-18T10:00:51.085359+0000","last_peered":"2024-02-18T10:00:51.085359+0000","last_clean":"2024-02-18T10:00:51.085359+0000","last_became_active":"2024-02-18T10:00:48.752114+0000","last_became_peered":"2024-02-18T10:00:48.752114+0000","last_unstale":"2024-02-18T10:00:51.085359+0000","last_undegraded":"2024-02-18T10:00:51.085359+0000","last_fullsized":"2024-02-18T10:00:51.085359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:45:13.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087086+0000","last_change":"2024-02-18T10:00:48.766940+0000","last_active":"2024-02-18T10:00:51.087086+0000","last_peered":"2024-02-18T10:00:51.087086+0000","last_clean":"2024-02-18T10:00:51.087086+0000","last_became_active":"2024-02-18T10:00:48.766671+0000","last_became_peered":"2024-02-18T10:00:48.766671+0000","last_unstale":"2024-02-18T10:00:51.087086+0000","last_undegraded":"2024-02-18T10:00:51.087086+0000","last_fullsized":"2024-02-18T10:00:51.087086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584567+0000","last_change":"2024-02-18T10:00:48.758455+0000","last_active":"2024-02-18T10:00:50.584567+0000","last_peered":"2024-02-18T10:00:50.584567+0000","last_clean":"2024-02-18T10:00:50.584567+0000","last_became_active":"2024-02-18T10:00:48.758160+0000","last_became_peered":"2024-02-18T10:00:48.758160+0000","last_unstale":"2024-02-18T10:00:50.584567+0000","last_undegraded":"2024-02-18T10:00:50.584567+0000","last_fullsized":"2024-02-18T10:00:50.584567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:27:13.111020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737885+0000","last_change":"2024-02-18T10:00:48.751567+0000","last_active":"2024-02-18T10:00:49.737885+0000","last_peered":"2024-02-18T10:00:49.737885+0000","last_clean":"2024-02-18T10:00:49.737885+0000","last_became_active":"2024-02-18T10:00:48.751213+0000","last_became_peered":"2024-02-18T10:00:48.751213+0000","last_unstale":"2024-02-18T10:00:49.737885+0000","last_undegraded":"2024-02-18T10:00:49.737885+0000","last_fullsized":"2024-02-18T10:00:49.737885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738361+0000","last_change":"2024-02-18T10:00:48.744508+0000","last_active":"2024-02-18T10:00:49.738361+0000","last_peered":"2024-02-18T10:00:49.738361+0000","last_clean":"2024-02-18T10:00:49.738361+0000","last_became_active":"2024-02-18T10:00:48.744189+0000","last_became_peered":"2024-02-18T10:00:48.744189+0000","last_unstale":"2024-02-18T10:00:49.738361+0000","last_undegraded":"2024-02-18T10:00:49.738361+0000","last_fullsized":"2024-02-18T10:00:49.738361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:08.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.173009+0000","last_change":"2024-02-18T10:00:47.748736+0000","last_active":"2024-02-18T10:00:50.173009+0000","last_peered":"2024-02-18T10:00:50.173009+0000","last_clean":"2024-02-18T10:00:50.173009+0000","last_became_active":"2024-02-18T10:00:47.748495+0000","last_became_peered":"2024-02-18T10:00:47.748495+0000","last_unstale":"2024-02-18T10:00:50.173009+0000","last_undegraded":"2024-02-18T10:00:50.173009+0000","last_fullsized":"2024-02-18T10:00:50.173009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:08:15.620449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085495+0000","last_change":"2024-02-18T10:00:48.751693+0000","last_active":"2024-02-18T10:00:51.085495+0000","last_peered":"2024-02-18T10:00:51.085495+0000","last_clean":"2024-02-18T10:00:51.085495+0000","last_became_active":"2024-02-18T10:00:48.750387+0000","last_became_peered":"2024-02-18T10:00:48.750387+0000","last_unstale":"2024-02-18T10:00:51.085495+0000","last_undegraded":"2024-02-18T10:00:51.085495+0000","last_fullsized":"2024-02-18T10:00:51.085495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737442+0000","last_change":"2024-02-18T10:00:47.747048+0000","last_active":"2024-02-18T10:00:49.737442+0000","last_peered":"2024-02-18T10:00:49.737442+0000","last_clean":"2024-02-18T10:00:49.737442+0000","last_became_active":"2024-02-18T10:00:47.745420+0000","last_became_peered":"2024-02-18T10:00:47.745420+0000","last_unstale":"2024-02-18T10:00:49.737442+0000","last_undegraded":"2024-02-18T10:00:49.737442+0000","last_fullsized":"2024-02-18T10:00:49.737442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172667+0000","last_change":"2024-02-18T10:00:47.747163+0000","last_active":"2024-02-18T10:00:50.172667+0000","last_peered":"2024-02-18T10:00:50.172667+0000","last_clean":"2024-02-18T10:00:50.172667+0000","last_became_active":"2024-02-18T10:00:47.746804+0000","last_became_peered":"2024-02-18T10:00:47.746804+0000","last_unstale":"2024-02-18T10:00:50.172667+0000","last_undegraded":"2024-02-18T10:00:50.172667+0000","last_fullsized":"2024-02-18T10:00:50.172667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172651+0000","last_change":"2024-02-18T10:00:48.748557+0000","last_active":"2024-02-18T10:00:50.172651+0000","last_peered":"2024-02-18T10:00:50.172651+0000","last_clean":"2024-02-18T10:00:50.172651+0000","last_became_active":"2024-02-18T10:00:48.748261+0000","last_became_peered":"2024-02-18T10:00:48.748261+0000","last_unstale":"2024-02-18T10:00:50.172651+0000","last_undegraded":"2024-02-18T10:00:50.172651+0000","last_fullsized":"2024-02-18T10:00:50.172651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086460+0000","last_change":"2024-02-18T10:00:47.753258+0000","last_active":"2024-02-18T10:00:51.086460+0000","last_peered":"2024-02-18T10:00:51.086460+0000","last_clean":"2024-02-18T10:00:51.086460+0000","last_became_active":"2024-02-18T10:00:47.752682+0000","last_became_peered":"2024-02-18T10:00:47.752682+0000","last_unstale":"2024-02-18T10:00:51.086460+0000","last_undegraded":"2024-02-18T10:00:51.086460+0000","last_fullsized":"2024-02-18T10:00:51.086460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736477+0000","last_change":"2024-02-18T10:00:48.741101+0000","last_active":"2024-02-18T10:00:49.736477+0000","last_peered":"2024-02-18T10:00:49.736477+0000","last_clean":"2024-02-18T10:00:49.736477+0000","last_became_active":"2024-02-18T10:00:48.740821+0000","last_became_peered":"2024-02-18T10:00:48.740821+0000","last_unstale":"2024-02-18T10:00:49.736477+0000","last_undegraded":"2024-02-18T10:00:49.736477+0000","last_fullsized":"2024-02-18T10:00:49.736477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737973+0000","last_change":"2024-02-18T10:00:47.750376+0000","last_active":"2024-02-18T10:00:49.737973+0000","last_peered":"2024-02-18T10:00:49.737973+0000","last_clean":"2024-02-18T10:00:49.737973+0000","last_became_active":"2024-02-18T10:00:47.749941+0000","last_became_peered":"2024-02-18T10:00:47.749941+0000","last_unstale":"2024-02-18T10:00:49.737973+0000","last_undegraded":"2024-02-18T10:00:49.737973+0000","last_fullsized":"2024-02-18T10:00:49.737973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087243+0000","last_change":"2024-02-18T10:00:48.765815+0000","last_active":"2024-02-18T10:00:51.087243+0000","last_peered":"2024-02-18T10:00:51.087243+0000","last_clean":"2024-02-18T10:00:51.087243+0000","last_became_active":"2024-02-18T10:00:48.765552+0000","last_became_peered":"2024-02-18T10:00:48.765552+0000","last_unstale":"2024-02-18T10:00:51.087243+0000","last_undegraded":"2024-02-18T10:00:51.087243+0000","last_fullsized":"2024-02-18T10:00:51.087243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:27.370397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087167+0000","last_change":"2024-02-18T10:00:47.750861+0000","last_active":"2024-02-18T10:00:51.087167+0000","last_peered":"2024-02-18T10:00:51.087167+0000","last_clean":"2024-02-18T10:00:51.087167+0000","last_became_active":"2024-02-18T10:00:47.749726+0000","last_became_peered":"2024-02-18T10:00:47.749726+0000","last_unstale":"2024-02-18T10:00:51.087167+0000","last_undegraded":"2024-02-18T10:00:51.087167+0000","last_fullsized":"2024-02-18T10:00:51.087167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085615+0000","last_change":"2024-02-18T10:00:48.754488+0000","last_active":"2024-02-18T10:00:51.085615+0000","last_peered":"2024-02-18T10:00:51.085615+0000","last_clean":"2024-02-18T10:00:51.085615+0000","last_became_active":"2024-02-18T10:00:48.753912+0000","last_became_peered":"2024-02-18T10:00:48.753912+0000","last_unstale":"2024-02-18T10:00:51.085615+0000","last_undegraded":"2024-02-18T10:00:51.085615+0000","last_fullsized":"2024-02-18T10:00:51.085615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736254+0000","last_change":"2024-02-18T10:00:47.757202+0000","last_active":"2024-02-18T10:00:49.736254+0000","last_peered":"2024-02-18T10:00:49.736254+0000","last_clean":"2024-02-18T10:00:49.736254+0000","last_became_active":"2024-02-18T10:00:47.756943+0000","last_became_peered":"2024-02-18T10:00:47.756943+0000","last_unstale":"2024-02-18T10:00:49.736254+0000","last_undegraded":"2024-02-18T10:00:49.736254+0000","last_fullsized":"2024-02-18T10:00:49.736254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738548+0000","last_change":"2024-02-18T10:00:48.756580+0000","last_active":"2024-02-18T10:00:49.738548+0000","last_peered":"2024-02-18T10:00:49.738548+0000","last_clean":"2024-02-18T10:00:49.738548+0000","last_became_active":"2024-02-18T10:00:48.755023+0000","last_became_peered":"2024-02-18T10:00:48.755023+0000","last_unstale":"2024-02-18T10:00:49.738548+0000","last_undegraded":"2024-02-18T10:00:49.738548+0000","last_fullsized":"2024-02-18T10:00:49.738548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:15.426726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737938+0000","last_change":"2024-02-18T10:00:47.745417+0000","last_active":"2024-02-18T10:00:49.737938+0000","last_peered":"2024-02-18T10:00:49.737938+0000","last_clean":"2024-02-18T10:00:49.737938+0000","last_became_active":"2024-02-18T10:00:47.745037+0000","last_became_peered":"2024-02-18T10:00:47.745037+0000","last_unstale":"2024-02-18T10:00:49.737938+0000","last_undegraded":"2024-02-18T10:00:49.737938+0000","last_fullsized":"2024-02-18T10:00:49.737938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086528+0000","last_change":"2024-02-18T10:00:48.757256+0000","last_active":"2024-02-18T10:00:51.086528+0000","last_peered":"2024-02-18T10:00:51.086528+0000","last_clean":"2024-02-18T10:00:51.086528+0000","last_became_active":"2024-02-18T10:00:48.756024+0000","last_became_peered":"2024-02-18T10:00:48.756024+0000","last_unstale":"2024-02-18T10:00:51.086528+0000","last_undegraded":"2024-02-18T10:00:51.086528+0000","last_fullsized":"2024-02-18T10:00:51.086528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:04:20.542014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085539+0000","last_change":"2024-02-18T10:00:47.743984+0000","last_active":"2024-02-18T10:00:51.085539+0000","last_peered":"2024-02-18T10:00:51.085539+0000","last_clean":"2024-02-18T10:00:51.085539+0000","last_became_active":"2024-02-18T10:00:47.743265+0000","last_became_peered":"2024-02-18T10:00:47.743265+0000","last_unstale":"2024-02-18T10:00:51.085539+0000","last_undegraded":"2024-02-18T10:00:51.085539+0000","last_fullsized":"2024-02-18T10:00:51.085539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:08:15.620449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085266+0000","last_change":"2024-02-18T10:00:48.753376+0000","last_active":"2024-02-18T10:00:51.085266+0000","last_peered":"2024-02-18T10:00:51.085266+0000","last_clean":"2024-02-18T10:00:51.085266+0000","last_became_active":"2024-02-18T10:00:48.752989+0000","last_became_peered":"2024-02-18T10:00:48.752989+0000","last_unstale":"2024-02-18T10:00:51.085266+0000","last_undegraded":"2024-02-18T10:00:51.085266+0000","last_fullsized":"2024-02-18T10:00:51.085266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:21:14.163404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086987+0000","last_change":"2024-02-18T10:00:47.754739+0000","last_active":"2024-02-18T10:00:51.086987+0000","last_peered":"2024-02-18T10:00:51.086987+0000","last_clean":"2024-02-18T10:00:51.086987+0000","last_became_active":"2024-02-18T10:00:47.754464+0000","last_became_peered":"2024-02-18T10:00:47.754464+0000","last_unstale":"2024-02-18T10:00:51.086987+0000","last_undegraded":"2024-02-18T10:00:51.086987+0000","last_fullsized":"2024-02-18T10:00:51.086987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086959+0000","last_change":"2024-02-18T10:00:48.765437+0000","last_active":"2024-02-18T10:00:51.086959+0000","last_peered":"2024-02-18T10:00:51.086959+0000","last_clean":"2024-02-18T10:00:51.086959+0000","last_became_active":"2024-02-18T10:00:48.765097+0000","last_became_peered":"2024-02-18T10:00:48.765097+0000","last_unstale":"2024-02-18T10:00:51.086959+0000","last_undegraded":"2024-02-18T10:00:51.086959+0000","last_fullsized":"2024-02-18T10:00:51.086959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:08:37.437332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737570+0000","last_change":"2024-02-18T10:00:47.746081+0000","last_active":"2024-02-18T10:00:49.737570+0000","last_peered":"2024-02-18T10:00:49.737570+0000","last_clean":"2024-02-18T10:00:49.737570+0000","last_became_active":"2024-02-18T10:00:47.745764+0000","last_became_peered":"2024-02-18T10:00:47.745764+0000","last_unstale":"2024-02-18T10:00:49.737570+0000","last_undegraded":"2024-02-18T10:00:49.737570+0000","last_fullsized":"2024-02-18T10:00:49.737570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737642+0000","last_change":"2024-02-18T10:00:48.751734+0000","last_active":"2024-02-18T10:00:49.737642+0000","last_peered":"2024-02-18T10:00:49.737642+0000","last_clean":"2024-02-18T10:00:49.737642+0000","last_became_active":"2024-02-18T10:00:48.751254+0000","last_became_peered":"2024-02-18T10:00:48.751254+0000","last_unstale":"2024-02-18T10:00:49.737642+0000","last_undegraded":"2024-02-18T10:00:49.737642+0000","last_fullsized":"2024-02-18T10:00:49.737642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584421+0000","last_change":"2024-02-18T10:00:47.743876+0000","last_active":"2024-02-18T10:00:50.584421+0000","last_peered":"2024-02-18T10:00:50.584421+0000","last_clean":"2024-02-18T10:00:50.584421+0000","last_became_active":"2024-02-18T10:00:47.743205+0000","last_became_peered":"2024-02-18T10:00:47.743205+0000","last_unstale":"2024-02-18T10:00:50.584421+0000","last_undegraded":"2024-02-18T10:00:50.584421+0000","last_fullsized":"2024-02-18T10:00:50.584421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086006+0000","last_change":"2024-02-18T10:00:48.765053+0000","last_active":"2024-02-18T10:00:51.086006+0000","last_peered":"2024-02-18T10:00:51.086006+0000","last_clean":"2024-02-18T10:00:51.086006+0000","last_became_active":"2024-02-18T10:00:48.764751+0000","last_became_peered":"2024-02-18T10:00:48.764751+0000","last_unstale":"2024-02-18T10:00:51.086006+0000","last_undegraded":"2024-02-18T10:00:51.086006+0000","last_fullsized":"2024-02-18T10:00:51.086006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738191+0000","last_change":"2024-02-18T10:00:47.749664+0000","last_active":"2024-02-18T10:00:49.738191+0000","last_peered":"2024-02-18T10:00:49.738191+0000","last_clean":"2024-02-18T10:00:49.738191+0000","last_became_active":"2024-02-18T10:00:47.749355+0000","last_became_peered":"2024-02-18T10:00:47.749355+0000","last_unstale":"2024-02-18T10:00:49.738191+0000","last_undegraded":"2024-02-18T10:00:49.738191+0000","last_fullsized":"2024-02-18T10:00:49.738191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:12:10.356826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086559+0000","last_change":"2024-02-18T10:00:48.764166+0000","last_active":"2024-02-18T10:00:51.086559+0000","last_peered":"2024-02-18T10:00:51.086559+0000","last_clean":"2024-02-18T10:00:51.086559+0000","last_became_active":"2024-02-18T10:00:48.763233+0000","last_became_peered":"2024-02-18T10:00:48.763233+0000","last_unstale":"2024-02-18T10:00:51.086559+0000","last_undegraded":"2024-02-18T10:00:51.086559+0000","last_fullsized":"2024-02-18T10:00:51.086559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:15.703316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584556+0000","last_change":"2024-02-18T10:00:47.746336+0000","last_active":"2024-02-18T10:00:50.584556+0000","last_peered":"2024-02-18T10:00:50.584556+0000","last_clean":"2024-02-18T10:00:50.584556+0000","last_became_active":"2024-02-18T10:00:47.746080+0000","last_became_peered":"2024-02-18T10:00:47.746080+0000","last_unstale":"2024-02-18T10:00:50.584556+0000","last_undegraded":"2024-02-18T10:00:50.584556+0000","last_fullsized":"2024-02-18T10:00:50.584556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086647+0000","last_change":"2024-02-18T10:00:48.764919+0000","last_active":"2024-02-18T10:00:51.086647+0000","last_peered":"2024-02-18T10:00:51.086647+0000","last_clean":"2024-02-18T10:00:51.086647+0000","last_became_active":"2024-02-18T10:00:48.764631+0000","last_became_peered":"2024-02-18T10:00:48.764631+0000","last_unstale":"2024-02-18T10:00:51.086647+0000","last_undegraded":"2024-02-18T10:00:51.086647+0000","last_fullsized":"2024-02-18T10:00:51.086647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:18.873439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736349+0000","last_change":"2024-02-18T10:00:47.744202+0000","last_active":"2024-02-18T10:00:49.736349+0000","last_peered":"2024-02-18T10:00:49.736349+0000","last_clean":"2024-02-18T10:00:49.736349+0000","last_became_active":"2024-02-18T10:00:47.743927+0000","last_became_peered":"2024-02-18T10:00:47.743927+0000","last_unstale":"2024-02-18T10:00:49.736349+0000","last_undegraded":"2024-02-18T10:00:49.736349+0000","last_fullsized":"2024-02-18T10:00:49.736349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086559+0000","last_change":"2024-02-18T10:00:48.762138+0000","last_active":"2024-02-18T10:00:51.086559+0000","last_peered":"2024-02-18T10:00:51.086559+0000","last_clean":"2024-02-18T10:00:51.086559+0000","last_became_active":"2024-02-18T10:00:48.761841+0000","last_became_peered":"2024-02-18T10:00:48.761841+0000","last_unstale":"2024-02-18T10:00:51.086559+0000","last_undegraded":"2024-02-18T10:00:51.086559+0000","last_fullsized":"2024-02-18T10:00:51.086559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:16:25.495152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584531+0000","last_change":"2024-02-18T10:00:47.750440+0000","last_active":"2024-02-18T10:00:50.584531+0000","last_peered":"2024-02-18T10:00:50.584531+0000","last_clean":"2024-02-18T10:00:50.584531+0000","last_became_active":"2024-02-18T10:00:47.750171+0000","last_became_peered":"2024-02-18T10:00:47.750171+0000","last_unstale":"2024-02-18T10:00:50.584531+0000","last_undegraded":"2024-02-18T10:00:50.584531+0000","last_fullsized":"2024-02-18T10:00:50.584531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086597+0000","last_change":"2024-02-18T10:00:48.766662+0000","last_active":"2024-02-18T10:00:51.086597+0000","last_peered":"2024-02-18T10:00:51.086597+0000","last_clean":"2024-02-18T10:00:51.086597+0000","last_became_active":"2024-02-18T10:00:48.766405+0000","last_became_peered":"2024-02-18T10:00:48.766405+0000","last_unstale":"2024-02-18T10:00:51.086597+0000","last_undegraded":"2024-02-18T10:00:51.086597+0000","last_fullsized":"2024-02-18T10:00:51.086597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:27.370397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085926+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:00:51.085926+0000","last_peered":"2024-02-18T10:00:51.085926+0000","last_clean":"2024-02-18T10:00:51.085926+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:00:51.085926+0000","last_undegraded":"2024-02-18T10:00:51.085926+0000","last_fullsized":"2024-02-18T10:00:51.085926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086179+0000","last_change":"2024-02-18T10:00:47.747706+0000","last_active":"2024-02-18T10:00:51.086179+0000","last_peered":"2024-02-18T10:00:51.086179+0000","last_clean":"2024-02-18T10:00:51.086179+0000","last_became_active":"2024-02-18T10:00:47.747410+0000","last_became_peered":"2024-02-18T10:00:47.747410+0000","last_unstale":"2024-02-18T10:00:51.086179+0000","last_undegraded":"2024-02-18T10:00:51.086179+0000","last_fullsized":"2024-02-18T10:00:51.086179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172827+0000","last_change":"2024-02-18T10:00:48.769224+0000","last_active":"2024-02-18T10:00:50.172827+0000","last_peered":"2024-02-18T10:00:50.172827+0000","last_clean":"2024-02-18T10:00:50.172827+0000","last_became_active":"2024-02-18T10:00:48.768881+0000","last_became_peered":"2024-02-18T10:00:48.768881+0000","last_unstale":"2024-02-18T10:00:50.172827+0000","last_undegraded":"2024-02-18T10:00:50.172827+0000","last_fullsized":"2024-02-18T10:00:50.172827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085786+0000","last_change":"2024-02-18T10:00:47.753097+0000","last_active":"2024-02-18T10:00:51.085786+0000","last_peered":"2024-02-18T10:00:51.085786+0000","last_clean":"2024-02-18T10:00:51.085786+0000","last_became_active":"2024-02-18T10:00:47.751883+0000","last_became_peered":"2024-02-18T10:00:47.751883+0000","last_unstale":"2024-02-18T10:00:51.085786+0000","last_undegraded":"2024-02-18T10:00:51.085786+0000","last_fullsized":"2024-02-18T10:00:51.085786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:32:25.941422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085198+0000","last_change":"2024-02-18T10:00:48.749065+0000","last_active":"2024-02-18T10:00:51.085198+0000","last_peered":"2024-02-18T10:00:51.085198+0000","last_clean":"2024-02-18T10:00:51.085198+0000","last_became_active":"2024-02-18T10:00:48.748721+0000","last_became_peered":"2024-02-18T10:00:48.748721+0000","last_unstale":"2024-02-18T10:00:51.085198+0000","last_undegraded":"2024-02-18T10:00:51.085198+0000","last_fullsized":"2024-02-18T10:00:51.085198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:58:39.082250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584505+0000","last_change":"2024-02-18T10:00:47.746892+0000","last_active":"2024-02-18T10:00:50.584505+0000","last_peered":"2024-02-18T10:00:50.584505+0000","last_clean":"2024-02-18T10:00:50.584505+0000","last_became_active":"2024-02-18T10:00:47.746655+0000","last_became_peered":"2024-02-18T10:00:47.746655+0000","last_unstale":"2024-02-18T10:00:50.584505+0000","last_undegraded":"2024-02-18T10:00:50.584505+0000","last_fullsized":"2024-02-18T10:00:50.584505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736201+0000","last_change":"2024-02-18T10:00:48.741827+0000","last_active":"2024-02-18T10:00:49.736201+0000","last_peered":"2024-02-18T10:00:49.736201+0000","last_clean":"2024-02-18T10:00:49.736201+0000","last_became_active":"2024-02-18T10:00:48.741575+0000","last_became_peered":"2024-02-18T10:00:48.741575+0000","last_unstale":"2024-02-18T10:00:49.736201+0000","last_undegraded":"2024-02-18T10:00:49.736201+0000","last_fullsized":"2024-02-18T10:00:49.736201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087119+0000","last_change":"2024-02-18T10:00:47.751869+0000","last_active":"2024-02-18T10:00:51.087119+0000","last_peered":"2024-02-18T10:00:51.087119+0000","last_clean":"2024-02-18T10:00:51.087119+0000","last_became_active":"2024-02-18T10:00:47.751627+0000","last_became_peered":"2024-02-18T10:00:47.751627+0000","last_unstale":"2024-02-18T10:00:51.087119+0000","last_undegraded":"2024-02-18T10:00:51.087119+0000","last_fullsized":"2024-02-18T10:00:51.087119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738483+0000","last_change":"2024-02-18T10:00:48.749047+0000","last_active":"2024-02-18T10:00:49.738483+0000","last_peered":"2024-02-18T10:00:49.738483+0000","last_clean":"2024-02-18T10:00:49.738483+0000","last_became_active":"2024-02-18T10:00:48.748750+0000","last_became_peered":"2024-02-18T10:00:48.748750+0000","last_unstale":"2024-02-18T10:00:49.738483+0000","last_undegraded":"2024-02-18T10:00:49.738483+0000","last_fullsized":"2024-02-18T10:00:49.738483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:35.064701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736176+0000","last_change":"2024-02-18T10:00:47.747157+0000","last_active":"2024-02-18T10:00:49.736176+0000","last_peered":"2024-02-18T10:00:49.736176+0000","last_clean":"2024-02-18T10:00:49.736176+0000","last_became_active":"2024-02-18T10:00:47.746267+0000","last_became_peered":"2024-02-18T10:00:47.746267+0000","last_unstale":"2024-02-18T10:00:49.736176+0000","last_undegraded":"2024-02-18T10:00:49.736176+0000","last_fullsized":"2024-02-18T10:00:49.736176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087197+0000","last_change":"2024-02-18T10:00:48.754892+0000","last_active":"2024-02-18T10:00:51.087197+0000","last_peered":"2024-02-18T10:00:51.087197+0000","last_clean":"2024-02-18T10:00:51.087197+0000","last_became_active":"2024-02-18T10:00:48.754634+0000","last_became_peered":"2024-02-18T10:00:48.754634+0000","last_unstale":"2024-02-18T10:00:51.087197+0000","last_undegraded":"2024-02-18T10:00:51.087197+0000","last_fullsized":"2024-02-18T10:00:51.087197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:15.703316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086711+0000","last_change":"2024-02-18T10:00:47.752978+0000","last_active":"2024-02-18T10:00:51.086711+0000","last_peered":"2024-02-18T10:00:51.086711+0000","last_clean":"2024-02-18T10:00:51.086711+0000","last_became_active":"2024-02-18T10:00:47.752637+0000","last_became_peered":"2024-02-18T10:00:47.752637+0000","last_unstale":"2024-02-18T10:00:51.086711+0000","last_undegraded":"2024-02-18T10:00:51.086711+0000","last_fullsized":"2024-02-18T10:00:51.086711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.062387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736363+0000","last_change":"2024-02-18T10:00:48.741218+0000","last_active":"2024-02-18T10:00:49.736363+0000","last_peered":"2024-02-18T10:00:49.736363+0000","last_clean":"2024-02-18T10:00:49.736363+0000","last_became_active":"2024-02-18T10:00:48.740947+0000","last_became_peered":"2024-02-18T10:00:48.740947+0000","last_unstale":"2024-02-18T10:00:49.736363+0000","last_undegraded":"2024-02-18T10:00:49.736363+0000","last_fullsized":"2024-02-18T10:00:49.736363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736441+0000","last_change":"2024-02-18T10:00:47.745748+0000","last_active":"2024-02-18T10:00:49.736441+0000","last_peered":"2024-02-18T10:00:49.736441+0000","last_clean":"2024-02-18T10:00:49.736441+0000","last_became_active":"2024-02-18T10:00:47.745483+0000","last_became_peered":"2024-02-18T10:00:47.745483+0000","last_unstale":"2024-02-18T10:00:49.736441+0000","last_undegraded":"2024-02-18T10:00:49.736441+0000","last_fullsized":"2024-02-18T10:00:49.736441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.062387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172965+0000","last_change":"2024-02-18T10:00:48.754790+0000","last_active":"2024-02-18T10:00:50.172965+0000","last_peered":"2024-02-18T10:00:50.172965+0000","last_clean":"2024-02-18T10:00:50.172965+0000","last_became_active":"2024-02-18T10:00:48.754516+0000","last_became_peered":"2024-02-18T10:00:48.754516+0000","last_unstale":"2024-02-18T10:00:50.172965+0000","last_undegraded":"2024-02-18T10:00:50.172965+0000","last_fullsized":"2024-02-18T10:00:50.172965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738088+0000","last_change":"2024-02-18T10:00:47.743582+0000","last_active":"2024-02-18T10:00:49.738088+0000","last_peered":"2024-02-18T10:00:49.738088+0000","last_clean":"2024-02-18T10:00:49.738088+0000","last_became_active":"2024-02-18T10:00:47.743314+0000","last_became_peered":"2024-02-18T10:00:47.743314+0000","last_unstale":"2024-02-18T10:00:49.738088+0000","last_undegraded":"2024-02-18T10:00:49.738088+0000","last_fullsized":"2024-02-18T10:00:49.738088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085499+0000","last_change":"2024-02-18T10:00:48.748201+0000","last_active":"2024-02-18T10:00:51.085499+0000","last_peered":"2024-02-18T10:00:51.085499+0000","last_clean":"2024-02-18T10:00:51.085499+0000","last_became_active":"2024-02-18T10:00:48.747809+0000","last_became_peered":"2024-02-18T10:00:48.747809+0000","last_unstale":"2024-02-18T10:00:51.085499+0000","last_undegraded":"2024-02-18T10:00:51.085499+0000","last_fullsized":"2024-02-18T10:00:51.085499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085772+0000","last_change":"2024-02-18T10:00:47.752933+0000","last_active":"2024-02-18T10:00:51.085772+0000","last_peered":"2024-02-18T10:00:51.085772+0000","last_clean":"2024-02-18T10:00:51.085772+0000","last_became_active":"2024-02-18T10:00:47.752594+0000","last_became_peered":"2024-02-18T10:00:47.752594+0000","last_unstale":"2024-02-18T10:00:51.085772+0000","last_undegraded":"2024-02-18T10:00:51.085772+0000","last_fullsized":"2024-02-18T10:00:51.085772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:57:31.966004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737717+0000","last_change":"2024-02-18T10:00:48.744423+0000","last_active":"2024-02-18T10:00:49.737717+0000","last_peered":"2024-02-18T10:00:49.737717+0000","last_clean":"2024-02-18T10:00:49.737717+0000","last_became_active":"2024-02-18T10:00:48.744108+0000","last_became_peered":"2024-02-18T10:00:48.744108+0000","last_unstale":"2024-02-18T10:00:49.737717+0000","last_undegraded":"2024-02-18T10:00:49.737717+0000","last_fullsized":"2024-02-18T10:00:49.737717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:07.789780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736266+0000","last_change":"2024-02-18T10:00:47.748994+0000","last_active":"2024-02-18T10:00:49.736266+0000","last_peered":"2024-02-18T10:00:49.736266+0000","last_clean":"2024-02-18T10:00:49.736266+0000","last_became_active":"2024-02-18T10:00:47.748750+0000","last_became_peered":"2024-02-18T10:00:47.748750+0000","last_unstale":"2024-02-18T10:00:49.736266+0000","last_undegraded":"2024-02-18T10:00:49.736266+0000","last_fullsized":"2024-02-18T10:00:49.736266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:14.424412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172744+0000","last_change":"2024-02-18T10:00:48.742322+0000","last_active":"2024-02-18T10:00:50.172744+0000","last_peered":"2024-02-18T10:00:50.172744+0000","last_clean":"2024-02-18T10:00:50.172744+0000","last_became_active":"2024-02-18T10:00:48.742051+0000","last_became_peered":"2024-02-18T10:00:48.742051+0000","last_unstale":"2024-02-18T10:00:50.172744+0000","last_undegraded":"2024-02-18T10:00:50.172744+0000","last_fullsized":"2024-02-18T10:00:50.172744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736239+0000","last_change":"2024-02-18T10:00:47.744495+0000","last_active":"2024-02-18T10:00:49.736239+0000","last_peered":"2024-02-18T10:00:49.736239+0000","last_clean":"2024-02-18T10:00:49.736239+0000","last_became_active":"2024-02-18T10:00:47.744212+0000","last_became_peered":"2024-02-18T10:00:47.744212+0000","last_unstale":"2024-02-18T10:00:49.736239+0000","last_undegraded":"2024-02-18T10:00:49.736239+0000","last_fullsized":"2024-02-18T10:00:49.736239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172955+0000","last_change":"2024-02-18T10:00:48.748982+0000","last_active":"2024-02-18T10:00:50.172955+0000","last_peered":"2024-02-18T10:00:50.172955+0000","last_clean":"2024-02-18T10:00:50.172955+0000","last_became_active":"2024-02-18T10:00:48.748709+0000","last_became_peered":"2024-02-18T10:00:48.748709+0000","last_unstale":"2024-02-18T10:00:50.172955+0000","last_undegraded":"2024-02-18T10:00:50.172955+0000","last_fullsized":"2024-02-18T10:00:50.172955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086642+0000","last_change":"2024-02-18T10:00:47.751004+0000","last_active":"2024-02-18T10:00:51.086642+0000","last_peered":"2024-02-18T10:00:51.086642+0000","last_clean":"2024-02-18T10:00:51.086642+0000","last_became_active":"2024-02-18T10:00:47.750711+0000","last_became_peered":"2024-02-18T10:00:47.750711+0000","last_unstale":"2024-02-18T10:00:51.086642+0000","last_undegraded":"2024-02-18T10:00:51.086642+0000","last_fullsized":"2024-02-18T10:00:51.086642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:14.424412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737387+0000","last_change":"2024-02-18T10:00:48.763662+0000","last_active":"2024-02-18T10:00:49.737387+0000","last_peered":"2024-02-18T10:00:49.737387+0000","last_clean":"2024-02-18T10:00:49.737387+0000","last_became_active":"2024-02-18T10:00:48.763395+0000","last_became_peered":"2024-02-18T10:00:48.763395+0000","last_unstale":"2024-02-18T10:00:49.737387+0000","last_undegraded":"2024-02-18T10:00:49.737387+0000","last_fullsized":"2024-02-18T10:00:49.737387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:55:44.537624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087087+0000","last_change":"2024-02-18T10:00:48.752146+0000","last_active":"2024-02-18T10:00:51.087087+0000","last_peered":"2024-02-18T10:00:51.087087+0000","last_clean":"2024-02-18T10:00:51.087087+0000","last_became_active":"2024-02-18T10:00:48.751865+0000","last_became_peered":"2024-02-18T10:00:48.751865+0000","last_unstale":"2024-02-18T10:00:51.087087+0000","last_undegraded":"2024-02-18T10:00:51.087087+0000","last_fullsized":"2024-02-18T10:00:51.087087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:04:20.542014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086278+0000","last_change":"2024-02-18T10:00:47.757335+0000","last_active":"2024-02-18T10:00:51.086278+0000","last_peered":"2024-02-18T10:00:51.086278+0000","last_clean":"2024-02-18T10:00:51.086278+0000","last_became_active":"2024-02-18T10:00:47.756953+0000","last_became_peered":"2024-02-18T10:00:47.756953+0000","last_unstale":"2024-02-18T10:00:51.086278+0000","last_undegraded":"2024-02-18T10:00:51.086278+0000","last_fullsized":"2024-02-18T10:00:51.086278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086394+0000","last_change":"2024-02-18T10:00:48.754209+0000","last_active":"2024-02-18T10:00:51.086394+0000","last_peered":"2024-02-18T10:00:51.086394+0000","last_clean":"2024-02-18T10:00:51.086394+0000","last_became_active":"2024-02-18T10:00:48.753933+0000","last_became_peered":"2024-02-18T10:00:48.753933+0000","last_unstale":"2024-02-18T10:00:51.086394+0000","last_undegraded":"2024-02-18T10:00:51.086394+0000","last_fullsized":"2024-02-18T10:00:51.086394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086599+0000","last_change":"2024-02-18T10:00:47.753398+0000","last_active":"2024-02-18T10:00:51.086599+0000","last_peered":"2024-02-18T10:00:51.086599+0000","last_clean":"2024-02-18T10:00:51.086599+0000","last_became_active":"2024-02-18T10:00:47.753137+0000","last_became_peered":"2024-02-18T10:00:47.753137+0000","last_unstale":"2024-02-18T10:00:51.086599+0000","last_undegraded":"2024-02-18T10:00:51.086599+0000","last_fullsized":"2024-02-18T10:00:51.086599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085481+0000","last_change":"2024-02-18T10:00:48.754681+0000","last_active":"2024-02-18T10:00:51.085481+0000","last_peered":"2024-02-18T10:00:51.085481+0000","last_clean":"2024-02-18T10:00:51.085481+0000","last_became_active":"2024-02-18T10:00:48.754241+0000","last_became_peered":"2024-02-18T10:00:48.754241+0000","last_unstale":"2024-02-18T10:00:51.085481+0000","last_undegraded":"2024-02-18T10:00:51.085481+0000","last_fullsized":"2024-02-18T10:00:51.085481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172832+0000","last_change":"2024-02-18T10:00:47.748073+0000","last_active":"2024-02-18T10:00:50.172832+0000","last_peered":"2024-02-18T10:00:50.172832+0000","last_clean":"2024-02-18T10:00:50.172832+0000","last_became_active":"2024-02-18T10:00:47.747834+0000","last_became_peered":"2024-02-18T10:00:47.747834+0000","last_unstale":"2024-02-18T10:00:50.172832+0000","last_undegraded":"2024-02-18T10:00:50.172832+0000","last_fullsized":"2024-02-18T10:00:50.172832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:03:07.548576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172932+0000","last_change":"2024-02-18T10:00:48.749891+0000","last_active":"2024-02-18T10:00:50.172932+0000","last_peered":"2024-02-18T10:00:50.172932+0000","last_clean":"2024-02-18T10:00:50.172932+0000","last_became_active":"2024-02-18T10:00:48.749644+0000","last_became_peered":"2024-02-18T10:00:48.749644+0000","last_unstale":"2024-02-18T10:00:50.172932+0000","last_undegraded":"2024-02-18T10:00:50.172932+0000","last_fullsized":"2024-02-18T10:00:50.172932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085516+0000","last_change":"2024-02-18T10:00:47.745160+0000","last_active":"2024-02-18T10:00:51.085516+0000","last_peered":"2024-02-18T10:00:51.085516+0000","last_clean":"2024-02-18T10:00:51.085516+0000","last_became_active":"2024-02-18T10:00:47.744705+0000","last_became_peered":"2024-02-18T10:00:47.744705+0000","last_unstale":"2024-02-18T10:00:51.085516+0000","last_undegraded":"2024-02-18T10:00:51.085516+0000","last_fullsized":"2024-02-18T10:00:51.085516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:24:45.056853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:01:00.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:01:00.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.576+0000 7f44733e9640 1 Processor -- start 2024-02-18T10:01:00.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.576+0000 7f44733e9640 1 -- start start 2024-02-18T10:01:00.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f44733e9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f446c0a6e60 0x7f446c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f44733e9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f446c1546d0 0x7f446c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f44733e9640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0b4aa0 con 0x7f446c14bf20 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f44733e9640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0b4cf0 con 0x7f446c1546d0 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f44733e9640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0a7350 con 0x7f446c0a6e60 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4471986640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f446c1546d0 0x7f446c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4470984640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f446c14bf20 0x7f446c14c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38690/0 (socket says 172.21.15.118:38690) 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4470984640 1 -- 172.21.15.118:0/1418078593 learned_addr learned my addr 172.21.15.118:0/1418078593 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4471185640 1 --2- 172.21.15.118:0/1418078593 >> v2:172.21.15.164:3300/0 conn(0x7f446c0a6e60 0x7f446c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4471986640 1 -- 172.21.15.118:0/1418078593 >> v2:172.21.15.164:3300/0 conn(0x7f446c0a6e60 msgr2=0x7f446c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4471986640 1 --2- 172.21.15.118:0/1418078593 >> v2:172.21.15.164:3300/0 conn(0x7f446c0a6e60 0x7f446c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4471986640 1 -- 172.21.15.118:0/1418078593 >> v1:172.21.15.118:6789/0 conn(0x7f446c14bf20 legacy=0x7f446c14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4471986640 1 -- 172.21.15.118:0/1418078593 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0c1140 con 0x7f446c1546d0 2024-02-18T10:01:00.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.577+0000 7f4463fff640 1 -- 172.21.15.118:0/1418078593 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309404560 0 0) 0x7f446c0b4aa0 con 0x7f446c14bf20 2024-02-18T10:01:00.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.578+0000 7f4471986640 1 --2- 172.21.15.118:0/1418078593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c156ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f446c073170 tx=0x7f446402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa966dbf69e1790 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.578+0000 7f4463fff640 1 -- 172.21.15.118:0/1418078593 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464031710 con 0x7f446c1546d0 2024-02-18T10:01:00.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.578+0000 7f4463fff640 1 -- 172.21.15.118:0/1418078593 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446402f050 con 0x7f446c1546d0 2024-02-18T10:01:00.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.578+0000 7f4463fff640 1 -- 172.21.15.118:0/1418078593 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464031a90 con 0x7f446c1546d0 2024-02-18T10:01:00.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 -- 172.21.15.118:0/1418078593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 msgr2=0x7f446c156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 --2- 172.21.15.118:0/1418078593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c156ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f446c073170 tx=0x7f446402b7b0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 -- 172.21.15.118:0/1418078593 shutdown_connections 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 --2- 172.21.15.118:0/1418078593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c156ac0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 --2- 172.21.15.118:0/1418078593 >> v2:172.21.15.164:3300/0 conn(0x7f446c0a6e60 0x7f446c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 -- 172.21.15.118:0/1418078593 >> 172.21.15.118:0/1418078593 conn(0x7f446c0c15b0 msgr2=0x7f446c0c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 -- 172.21.15.118:0/1418078593 shutdown_connections 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.579+0000 7f44733e9640 1 -- 172.21.15.118:0/1418078593 wait complete. 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.580+0000 7f44733e9640 1 Processor -- start 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.580+0000 7f44733e9640 1 -- start start 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.580+0000 7f44733e9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446c0a6e60 0x7f446c0b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.580+0000 7f44733e9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f446c14bf20 0x7f446c148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.580+0000 7f44733e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.580+0000 7f44733e9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b6050 con 0x7f446c1546d0 2024-02-18T10:01:00.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.580+0000 7f44733e9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b6b80 con 0x7f446c0a6e60 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f44733e9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b52b0 con 0x7f446c14bf20 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c1488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43050/0 (socket says 172.21.15.118:43050) 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 -- 172.21.15.118:0/3924665017 learned_addr learned my addr 172.21.15.118:0/3924665017 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 -- 172.21.15.118:0/3924665017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f446c14bf20 msgr2=0x7f446c148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f446c14bf20 0x7f446c148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 -- 172.21.15.118:0/3924665017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446c0a6e60 msgr2=0x7f446c0b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471185640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446c0a6e60 0x7f446c0b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446c0a6e60 0x7f446c0b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 -- 172.21.15.118:0/3924665017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009400 con 0x7f446c1546d0 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4471986640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c1488a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f446402b7f0 tx=0x7f44640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4461ffb640 1 -- 172.21.15.118:0/3924665017 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464033890 con 0x7f446c1546d0 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4461ffb640 1 -- 172.21.15.118:0/3924665017 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640339f0 con 0x7f446c1546d0 2024-02-18T10:01:00.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0b4850 con 0x7f446c1546d0 2024-02-18T10:01:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f4461ffb640 1 -- 172.21.15.118:0/3924665017 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464033d60 con 0x7f446c1546d0 2024-02-18T10:01:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.581+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0a2650 con 0x7f446c1546d0 2024-02-18T10:01:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.582+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0b46b0 con 0x7f446c1546d0 2024-02-18T10:01:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.583+0000 7f4461ffb640 1 -- 172.21.15.118:0/3924665017 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f446403a040 con 0x7f446c1546d0 2024-02-18T10:01:00.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.583+0000 7f4461ffb640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f445006bc70 0x7f445006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.583+0000 7f4471185640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f445006bc70 0x7f445006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.583+0000 7f4461ffb640 1 -- 172.21.15.118:0/3924665017 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44640abca0 con 0x7f446c1546d0 2024-02-18T10:01:00.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.584+0000 7f4471185640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f445006bc70 0x7f445006e130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e90 tx=0x7f446800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.588+0000 7f4461ffb640 1 -- 172.21.15.118:0/3924665017 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f446c0b46b0 con 0x7f446c1546d0 2024-02-18T10:01:00.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.756+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f446c066ec0 con 0x7f445006bc70 2024-02-18T10:01:00.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.761+0000 7f4461ffb640 1 -- 172.21.15.118:0/3924665017 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7f446c066ec0 con 0x7f445006bc70 2024-02-18T10:01:00.767 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:00.768 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f445006bc70 msgr2=0x7f445006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f445006bc70 0x7f445006e130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4468009e90 tx=0x7f446800b040 comp rx=0 tx=0).stop 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 msgr2=0x7f446c1488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c1488a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f446402b7f0 tx=0x7f44640046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 shutdown_connections 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f445006bc70 0x7f445006e130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c1546d0 0x7f446c1488a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f446c14bf20 0x7f446c148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 --2- 172.21.15.118:0/3924665017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f446c0a6e60 0x7f446c0b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 >> 172.21.15.118:0/3924665017 conn(0x7f446c0c15b0 msgr2=0x7f446c0a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 shutdown_connections 2024-02-18T10:01:00.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.764+0000 7f44733e9640 1 -- 172.21.15.118:0/3924665017 wait complete. 2024-02-18T10:01:00.777 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-18T10:00:59.280056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235724,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738996,"statfs":{"total":773094113280,"available":772852731904,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002158"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086380+0000","last_change":"2024-02-18T10:00:48.762372+0000","last_active":"2024-02-18T10:00:51.086380+0000","last_peered":"2024-02-18T10:00:51.086380+0000","last_clean":"2024-02-18T10:00:51.086380+0000","last_became_active":"2024-02-18T10:00:48.762116+0000","last_became_peered":"2024-02-18T10:00:48.762116+0000","last_unstale":"2024-02-18T10:00:51.086380+0000","last_undegraded":"2024-02-18T10:00:51.086380+0000","last_fullsized":"2024-02-18T10:00:51.086380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736363+0000","last_change":"2024-02-18T10:00:48.749144+0000","last_active":"2024-02-18T10:00:49.736363+0000","last_peered":"2024-02-18T10:00:49.736363+0000","last_clean":"2024-02-18T10:00:49.736363+0000","last_became_active":"2024-02-18T10:00:48.748769+0000","last_became_peered":"2024-02-18T10:00:48.748769+0000","last_unstale":"2024-02-18T10:00:49.736363+0000","last_undegraded":"2024-02-18T10:00:49.736363+0000","last_fullsized":"2024-02-18T10:00:49.736363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085421+0000","last_change":"2024-02-18T10:00:48.746009+0000","last_active":"2024-02-18T10:00:51.085421+0000","last_peered":"2024-02-18T10:00:51.085421+0000","last_clean":"2024-02-18T10:00:51.085421+0000","last_became_active":"2024-02-18T10:00:48.745723+0000","last_became_peered":"2024-02-18T10:00:48.745723+0000","last_unstale":"2024-02-18T10:00:51.085421+0000","last_undegraded":"2024-02-18T10:00:51.085421+0000","last_fullsized":"2024-02-18T10:00:51.085421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086634+0000","last_change":"2024-02-18T10:00:48.765838+0000","last_active":"2024-02-18T10:00:51.086634+0000","last_peered":"2024-02-18T10:00:51.086634+0000","last_clean":"2024-02-18T10:00:51.086634+0000","last_became_active":"2024-02-18T10:00:48.765603+0000","last_became_peered":"2024-02-18T10:00:48.765603+0000","last_unstale":"2024-02-18T10:00:51.086634+0000","last_undegraded":"2024-02-18T10:00:51.086634+0000","last_fullsized":"2024-02-18T10:00:51.086634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086270+0000","last_change":"2024-02-18T10:00:48.756241+0000","last_active":"2024-02-18T10:00:51.086270+0000","last_peered":"2024-02-18T10:00:51.086270+0000","last_clean":"2024-02-18T10:00:51.086270+0000","last_became_active":"2024-02-18T10:00:48.755053+0000","last_became_peered":"2024-02-18T10:00:48.755053+0000","last_unstale":"2024-02-18T10:00:51.086270+0000","last_undegraded":"2024-02-18T10:00:51.086270+0000","last_fullsized":"2024-02-18T10:00:51.086270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086826+0000","last_change":"2024-02-18T10:00:48.752872+0000","last_active":"2024-02-18T10:00:51.086826+0000","last_peered":"2024-02-18T10:00:51.086826+0000","last_clean":"2024-02-18T10:00:51.086826+0000","last_became_active":"2024-02-18T10:00:48.752303+0000","last_became_peered":"2024-02-18T10:00:48.752303+0000","last_unstale":"2024-02-18T10:00:51.086826+0000","last_undegraded":"2024-02-18T10:00:51.086826+0000","last_fullsized":"2024-02-18T10:00:51.086826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085945+0000","last_change":"2024-02-18T10:00:48.761872+0000","last_active":"2024-02-18T10:00:51.085945+0000","last_peered":"2024-02-18T10:00:51.085945+0000","last_clean":"2024-02-18T10:00:51.085945+0000","last_became_active":"2024-02-18T10:00:48.761571+0000","last_became_peered":"2024-02-18T10:00:48.761571+0000","last_unstale":"2024-02-18T10:00:51.085945+0000","last_undegraded":"2024-02-18T10:00:51.085945+0000","last_fullsized":"2024-02-18T10:00:51.085945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172589+0000","last_change":"2024-02-18T10:00:48.769207+0000","last_active":"2024-02-18T10:00:50.172589+0000","last_peered":"2024-02-18T10:00:50.172589+0000","last_clean":"2024-02-18T10:00:50.172589+0000","last_became_active":"2024-02-18T10:00:48.768911+0000","last_became_peered":"2024-02-18T10:00:48.768911+0000","last_unstale":"2024-02-18T10:00:50.172589+0000","last_undegraded":"2024-02-18T10:00:50.172589+0000","last_fullsized":"2024-02-18T10:00:50.172589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086809+0000","last_change":"2024-02-18T10:00:48.767470+0000","last_active":"2024-02-18T10:00:51.086809+0000","last_peered":"2024-02-18T10:00:51.086809+0000","last_clean":"2024-02-18T10:00:51.086809+0000","last_became_active":"2024-02-18T10:00:48.767204+0000","last_became_peered":"2024-02-18T10:00:48.767204+0000","last_unstale":"2024-02-18T10:00:51.086809+0000","last_undegraded":"2024-02-18T10:00:51.086809+0000","last_fullsized":"2024-02-18T10:00:51.086809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:53:44.598357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738102+0000","last_change":"2024-02-18T10:00:48.767769+0000","last_active":"2024-02-18T10:00:49.738102+0000","last_peered":"2024-02-18T10:00:49.738102+0000","last_clean":"2024-02-18T10:00:49.738102+0000","last_became_active":"2024-02-18T10:00:48.767502+0000","last_became_peered":"2024-02-18T10:00:48.767502+0000","last_unstale":"2024-02-18T10:00:49.738102+0000","last_undegraded":"2024-02-18T10:00:49.738102+0000","last_fullsized":"2024-02-18T10:00:49.738102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737554+0000","last_change":"2024-02-18T10:00:48.766859+0000","last_active":"2024-02-18T10:00:49.737554+0000","last_peered":"2024-02-18T10:00:49.737554+0000","last_clean":"2024-02-18T10:00:49.737554+0000","last_became_active":"2024-02-18T10:00:48.766595+0000","last_became_peered":"2024-02-18T10:00:48.766595+0000","last_unstale":"2024-02-18T10:00:49.737554+0000","last_undegraded":"2024-02-18T10:00:49.737554+0000","last_fullsized":"2024-02-18T10:00:49.737554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:45:13.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738472+0000","last_change":"2024-02-18T10:00:48.755535+0000","last_active":"2024-02-18T10:00:49.738472+0000","last_peered":"2024-02-18T10:00:49.738472+0000","last_clean":"2024-02-18T10:00:49.738472+0000","last_became_active":"2024-02-18T10:00:48.755267+0000","last_became_peered":"2024-02-18T10:00:48.755267+0000","last_unstale":"2024-02-18T10:00:49.738472+0000","last_undegraded":"2024-02-18T10:00:49.738472+0000","last_fullsized":"2024-02-18T10:00:49.738472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:49.765437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172950+0000","last_change":"2024-02-18T10:00:48.750469+0000","last_active":"2024-02-18T10:00:50.172950+0000","last_peered":"2024-02-18T10:00:50.172950+0000","last_clean":"2024-02-18T10:00:50.172950+0000","last_became_active":"2024-02-18T10:00:48.750226+0000","last_became_peered":"2024-02-18T10:00:48.750226+0000","last_unstale":"2024-02-18T10:00:50.172950+0000","last_undegraded":"2024-02-18T10:00:50.172950+0000","last_fullsized":"2024-02-18T10:00:50.172950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:16:25.495152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085186+0000","last_change":"2024-02-18T10:00:48.750924+0000","last_active":"2024-02-18T10:00:51.085186+0000","last_peered":"2024-02-18T10:00:51.085186+0000","last_clean":"2024-02-18T10:00:51.085186+0000","last_became_active":"2024-02-18T10:00:48.750592+0000","last_became_peered":"2024-02-18T10:00:48.750592+0000","last_unstale":"2024-02-18T10:00:51.085186+0000","last_undegraded":"2024-02-18T10:00:51.085186+0000","last_fullsized":"2024-02-18T10:00:51.085186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:27:13.111020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736200+0000","last_change":"2024-02-18T10:00:48.746265+0000","last_active":"2024-02-18T10:00:49.736200+0000","last_peered":"2024-02-18T10:00:49.736200+0000","last_clean":"2024-02-18T10:00:49.736200+0000","last_became_active":"2024-02-18T10:00:48.746015+0000","last_became_peered":"2024-02-18T10:00:48.746015+0000","last_unstale":"2024-02-18T10:00:49.736200+0000","last_undegraded":"2024-02-18T10:00:49.736200+0000","last_fullsized":"2024-02-18T10:00:49.736200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086113+0000","last_change":"2024-02-18T10:00:48.753217+0000","last_active":"2024-02-18T10:00:51.086113+0000","last_peered":"2024-02-18T10:00:51.086113+0000","last_clean":"2024-02-18T10:00:51.086113+0000","last_became_active":"2024-02-18T10:00:48.752488+0000","last_became_peered":"2024-02-18T10:00:48.752488+0000","last_unstale":"2024-02-18T10:00:51.086113+0000","last_undegraded":"2024-02-18T10:00:51.086113+0000","last_fullsized":"2024-02-18T10:00:51.086113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087297+0000","last_change":"2024-02-18T10:00:48.763358+0000","last_active":"2024-02-18T10:00:51.087297+0000","last_peered":"2024-02-18T10:00:51.087297+0000","last_clean":"2024-02-18T10:00:51.087297+0000","last_became_active":"2024-02-18T10:00:48.762822+0000","last_became_peered":"2024-02-18T10:00:48.762822+0000","last_unstale":"2024-02-18T10:00:51.087297+0000","last_undegraded":"2024-02-18T10:00:51.087297+0000","last_fullsized":"2024-02-18T10:00:51.087297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:18.873439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584653+0000","last_change":"2024-02-18T10:00:48.751879+0000","last_active":"2024-02-18T10:00:50.584653+0000","last_peered":"2024-02-18T10:00:50.584653+0000","last_clean":"2024-02-18T10:00:50.584653+0000","last_became_active":"2024-02-18T10:00:48.751596+0000","last_became_peered":"2024-02-18T10:00:48.751596+0000","last_unstale":"2024-02-18T10:00:50.584653+0000","last_undegraded":"2024-02-18T10:00:50.584653+0000","last_fullsized":"2024-02-18T10:00:50.584653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:58:39.082250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086833+0000","last_change":"2024-02-18T10:00:48.756771+0000","last_active":"2024-02-18T10:00:51.086833+0000","last_peered":"2024-02-18T10:00:51.086833+0000","last_clean":"2024-02-18T10:00:51.086833+0000","last_became_active":"2024-02-18T10:00:48.756506+0000","last_became_peered":"2024-02-18T10:00:48.756506+0000","last_unstale":"2024-02-18T10:00:51.086833+0000","last_undegraded":"2024-02-18T10:00:51.086833+0000","last_fullsized":"2024-02-18T10:00:51.086833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:40:48.193545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737843+0000","last_change":"2024-02-18T10:00:48.763478+0000","last_active":"2024-02-18T10:00:49.737843+0000","last_peered":"2024-02-18T10:00:49.737843+0000","last_clean":"2024-02-18T10:00:49.737843+0000","last_became_active":"2024-02-18T10:00:48.762974+0000","last_became_peered":"2024-02-18T10:00:48.762974+0000","last_unstale":"2024-02-18T10:00:49.737843+0000","last_undegraded":"2024-02-18T10:00:49.737843+0000","last_fullsized":"2024-02-18T10:00:49.737843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085325+0000","last_change":"2024-02-18T10:00:48.755841+0000","last_active":"2024-02-18T10:00:51.085325+0000","last_peered":"2024-02-18T10:00:51.085325+0000","last_clean":"2024-02-18T10:00:51.085325+0000","last_became_active":"2024-02-18T10:00:48.755563+0000","last_became_peered":"2024-02-18T10:00:48.755563+0000","last_unstale":"2024-02-18T10:00:51.085325+0000","last_undegraded":"2024-02-18T10:00:51.085325+0000","last_fullsized":"2024-02-18T10:00:51.085325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:55:44.537624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086926+0000","last_change":"2024-02-18T10:00:48.763939+0000","last_active":"2024-02-18T10:00:51.086926+0000","last_peered":"2024-02-18T10:00:51.086926+0000","last_clean":"2024-02-18T10:00:51.086926+0000","last_became_active":"2024-02-18T10:00:48.763645+0000","last_became_peered":"2024-02-18T10:00:48.763645+0000","last_unstale":"2024-02-18T10:00:51.086926+0000","last_undegraded":"2024-02-18T10:00:51.086926+0000","last_fullsized":"2024-02-18T10:00:51.086926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172661+0000","last_change":"2024-02-18T10:00:48.746911+0000","last_active":"2024-02-18T10:00:50.172661+0000","last_peered":"2024-02-18T10:00:50.172661+0000","last_clean":"2024-02-18T10:00:50.172661+0000","last_became_active":"2024-02-18T10:00:48.746634+0000","last_became_peered":"2024-02-18T10:00:48.746634+0000","last_unstale":"2024-02-18T10:00:50.172661+0000","last_undegraded":"2024-02-18T10:00:50.172661+0000","last_fullsized":"2024-02-18T10:00:50.172661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086406+0000","last_change":"2024-02-18T10:00:48.757610+0000","last_active":"2024-02-18T10:00:51.086406+0000","last_peered":"2024-02-18T10:00:51.086406+0000","last_clean":"2024-02-18T10:00:51.086406+0000","last_became_active":"2024-02-18T10:00:48.757334+0000","last_became_peered":"2024-02-18T10:00:48.757334+0000","last_unstale":"2024-02-18T10:00:51.086406+0000","last_undegraded":"2024-02-18T10:00:51.086406+0000","last_fullsized":"2024-02-18T10:00:51.086406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172992+0000","last_change":"2024-02-18T10:00:48.746788+0000","last_active":"2024-02-18T10:00:50.172992+0000","last_peered":"2024-02-18T10:00:50.172992+0000","last_clean":"2024-02-18T10:00:50.172992+0000","last_became_active":"2024-02-18T10:00:48.746523+0000","last_became_peered":"2024-02-18T10:00:48.746523+0000","last_unstale":"2024-02-18T10:00:50.172992+0000","last_undegraded":"2024-02-18T10:00:50.172992+0000","last_fullsized":"2024-02-18T10:00:50.172992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738283+0000","last_change":"2024-02-18T10:00:48.756429+0000","last_active":"2024-02-18T10:00:49.738283+0000","last_peered":"2024-02-18T10:00:49.738283+0000","last_clean":"2024-02-18T10:00:49.738283+0000","last_became_active":"2024-02-18T10:00:48.756141+0000","last_became_peered":"2024-02-18T10:00:48.756141+0000","last_unstale":"2024-02-18T10:00:49.738283+0000","last_undegraded":"2024-02-18T10:00:49.738283+0000","last_fullsized":"2024-02-18T10:00:49.738283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736343+0000","last_change":"2024-02-18T10:00:48.742514+0000","last_active":"2024-02-18T10:00:49.736343+0000","last_peered":"2024-02-18T10:00:49.736343+0000","last_clean":"2024-02-18T10:00:49.736343+0000","last_became_active":"2024-02-18T10:00:48.742264+0000","last_became_peered":"2024-02-18T10:00:48.742264+0000","last_unstale":"2024-02-18T10:00:49.736343+0000","last_undegraded":"2024-02-18T10:00:49.736343+0000","last_fullsized":"2024-02-18T10:00:49.736343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172990+0000","last_change":"2024-02-18T10:00:48.746831+0000","last_active":"2024-02-18T10:00:50.172990+0000","last_peered":"2024-02-18T10:00:50.172990+0000","last_clean":"2024-02-18T10:00:50.172990+0000","last_became_active":"2024-02-18T10:00:48.746574+0000","last_became_peered":"2024-02-18T10:00:48.746574+0000","last_unstale":"2024-02-18T10:00:50.172990+0000","last_undegraded":"2024-02-18T10:00:50.172990+0000","last_fullsized":"2024-02-18T10:00:50.172990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:41:29.269271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085359+0000","last_change":"2024-02-18T10:00:48.752619+0000","last_active":"2024-02-18T10:00:51.085359+0000","last_peered":"2024-02-18T10:00:51.085359+0000","last_clean":"2024-02-18T10:00:51.085359+0000","last_became_active":"2024-02-18T10:00:48.752114+0000","last_became_peered":"2024-02-18T10:00:48.752114+0000","last_unstale":"2024-02-18T10:00:51.085359+0000","last_undegraded":"2024-02-18T10:00:51.085359+0000","last_fullsized":"2024-02-18T10:00:51.085359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:45:13.570693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087086+0000","last_change":"2024-02-18T10:00:48.766940+0000","last_active":"2024-02-18T10:00:51.087086+0000","last_peered":"2024-02-18T10:00:51.087086+0000","last_clean":"2024-02-18T10:00:51.087086+0000","last_became_active":"2024-02-18T10:00:48.766671+0000","last_became_peered":"2024-02-18T10:00:48.766671+0000","last_unstale":"2024-02-18T10:00:51.087086+0000","last_undegraded":"2024-02-18T10:00:51.087086+0000","last_fullsized":"2024-02-18T10:00:51.087086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:03.738999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584567+0000","last_change":"2024-02-18T10:00:48.758455+0000","last_active":"2024-02-18T10:00:50.584567+0000","last_peered":"2024-02-18T10:00:50.584567+0000","last_clean":"2024-02-18T10:00:50.584567+0000","last_became_active":"2024-02-18T10:00:48.758160+0000","last_became_peered":"2024-02-18T10:00:48.758160+0000","last_unstale":"2024-02-18T10:00:50.584567+0000","last_undegraded":"2024-02-18T10:00:50.584567+0000","last_fullsized":"2024-02-18T10:00:50.584567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:27:13.111020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737885+0000","last_change":"2024-02-18T10:00:48.751567+0000","last_active":"2024-02-18T10:00:49.737885+0000","last_peered":"2024-02-18T10:00:49.737885+0000","last_clean":"2024-02-18T10:00:49.737885+0000","last_became_active":"2024-02-18T10:00:48.751213+0000","last_became_peered":"2024-02-18T10:00:48.751213+0000","last_unstale":"2024-02-18T10:00:49.737885+0000","last_undegraded":"2024-02-18T10:00:49.737885+0000","last_fullsized":"2024-02-18T10:00:49.737885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738361+0000","last_change":"2024-02-18T10:00:48.744508+0000","last_active":"2024-02-18T10:00:49.738361+0000","last_peered":"2024-02-18T10:00:49.738361+0000","last_clean":"2024-02-18T10:00:49.738361+0000","last_became_active":"2024-02-18T10:00:48.744189+0000","last_became_peered":"2024-02-18T10:00:48.744189+0000","last_unstale":"2024-02-18T10:00:49.738361+0000","last_undegraded":"2024-02-18T10:00:49.738361+0000","last_fullsized":"2024-02-18T10:00:49.738361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:08.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.173009+0000","last_change":"2024-02-18T10:00:47.748736+0000","last_active":"2024-02-18T10:00:50.173009+0000","last_peered":"2024-02-18T10:00:50.173009+0000","last_clean":"2024-02-18T10:00:50.173009+0000","last_became_active":"2024-02-18T10:00:47.748495+0000","last_became_peered":"2024-02-18T10:00:47.748495+0000","last_unstale":"2024-02-18T10:00:50.173009+0000","last_undegraded":"2024-02-18T10:00:50.173009+0000","last_fullsized":"2024-02-18T10:00:50.173009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:08:15.620449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085495+0000","last_change":"2024-02-18T10:00:48.751693+0000","last_active":"2024-02-18T10:00:51.085495+0000","last_peered":"2024-02-18T10:00:51.085495+0000","last_clean":"2024-02-18T10:00:51.085495+0000","last_became_active":"2024-02-18T10:00:48.750387+0000","last_became_peered":"2024-02-18T10:00:48.750387+0000","last_unstale":"2024-02-18T10:00:51.085495+0000","last_undegraded":"2024-02-18T10:00:51.085495+0000","last_fullsized":"2024-02-18T10:00:51.085495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:26:23.963773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737442+0000","last_change":"2024-02-18T10:00:47.747048+0000","last_active":"2024-02-18T10:00:49.737442+0000","last_peered":"2024-02-18T10:00:49.737442+0000","last_clean":"2024-02-18T10:00:49.737442+0000","last_became_active":"2024-02-18T10:00:47.745420+0000","last_became_peered":"2024-02-18T10:00:47.745420+0000","last_unstale":"2024-02-18T10:00:49.737442+0000","last_undegraded":"2024-02-18T10:00:49.737442+0000","last_fullsized":"2024-02-18T10:00:49.737442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172667+0000","last_change":"2024-02-18T10:00:47.747163+0000","last_active":"2024-02-18T10:00:50.172667+0000","last_peered":"2024-02-18T10:00:50.172667+0000","last_clean":"2024-02-18T10:00:50.172667+0000","last_became_active":"2024-02-18T10:00:47.746804+0000","last_became_peered":"2024-02-18T10:00:47.746804+0000","last_unstale":"2024-02-18T10:00:50.172667+0000","last_undegraded":"2024-02-18T10:00:50.172667+0000","last_fullsized":"2024-02-18T10:00:50.172667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172651+0000","last_change":"2024-02-18T10:00:48.748557+0000","last_active":"2024-02-18T10:00:50.172651+0000","last_peered":"2024-02-18T10:00:50.172651+0000","last_clean":"2024-02-18T10:00:50.172651+0000","last_became_active":"2024-02-18T10:00:48.748261+0000","last_became_peered":"2024-02-18T10:00:48.748261+0000","last_unstale":"2024-02-18T10:00:50.172651+0000","last_undegraded":"2024-02-18T10:00:50.172651+0000","last_fullsized":"2024-02-18T10:00:50.172651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086460+0000","last_change":"2024-02-18T10:00:47.753258+0000","last_active":"2024-02-18T10:00:51.086460+0000","last_peered":"2024-02-18T10:00:51.086460+0000","last_clean":"2024-02-18T10:00:51.086460+0000","last_became_active":"2024-02-18T10:00:47.752682+0000","last_became_peered":"2024-02-18T10:00:47.752682+0000","last_unstale":"2024-02-18T10:00:51.086460+0000","last_undegraded":"2024-02-18T10:00:51.086460+0000","last_fullsized":"2024-02-18T10:00:51.086460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736477+0000","last_change":"2024-02-18T10:00:48.741101+0000","last_active":"2024-02-18T10:00:49.736477+0000","last_peered":"2024-02-18T10:00:49.736477+0000","last_clean":"2024-02-18T10:00:49.736477+0000","last_became_active":"2024-02-18T10:00:48.740821+0000","last_became_peered":"2024-02-18T10:00:48.740821+0000","last_unstale":"2024-02-18T10:00:49.736477+0000","last_undegraded":"2024-02-18T10:00:49.736477+0000","last_fullsized":"2024-02-18T10:00:49.736477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737973+0000","last_change":"2024-02-18T10:00:47.750376+0000","last_active":"2024-02-18T10:00:49.737973+0000","last_peered":"2024-02-18T10:00:49.737973+0000","last_clean":"2024-02-18T10:00:49.737973+0000","last_became_active":"2024-02-18T10:00:47.749941+0000","last_became_peered":"2024-02-18T10:00:47.749941+0000","last_unstale":"2024-02-18T10:00:49.737973+0000","last_undegraded":"2024-02-18T10:00:49.737973+0000","last_fullsized":"2024-02-18T10:00:49.737973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087243+0000","last_change":"2024-02-18T10:00:48.765815+0000","last_active":"2024-02-18T10:00:51.087243+0000","last_peered":"2024-02-18T10:00:51.087243+0000","last_clean":"2024-02-18T10:00:51.087243+0000","last_became_active":"2024-02-18T10:00:48.765552+0000","last_became_peered":"2024-02-18T10:00:48.765552+0000","last_unstale":"2024-02-18T10:00:51.087243+0000","last_undegraded":"2024-02-18T10:00:51.087243+0000","last_fullsized":"2024-02-18T10:00:51.087243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:27.370397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087167+0000","last_change":"2024-02-18T10:00:47.750861+0000","last_active":"2024-02-18T10:00:51.087167+0000","last_peered":"2024-02-18T10:00:51.087167+0000","last_clean":"2024-02-18T10:00:51.087167+0000","last_became_active":"2024-02-18T10:00:47.749726+0000","last_became_peered":"2024-02-18T10:00:47.749726+0000","last_unstale":"2024-02-18T10:00:51.087167+0000","last_undegraded":"2024-02-18T10:00:51.087167+0000","last_fullsized":"2024-02-18T10:00:51.087167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085615+0000","last_change":"2024-02-18T10:00:48.754488+0000","last_active":"2024-02-18T10:00:51.085615+0000","last_peered":"2024-02-18T10:00:51.085615+0000","last_clean":"2024-02-18T10:00:51.085615+0000","last_became_active":"2024-02-18T10:00:48.753912+0000","last_became_peered":"2024-02-18T10:00:48.753912+0000","last_unstale":"2024-02-18T10:00:51.085615+0000","last_undegraded":"2024-02-18T10:00:51.085615+0000","last_fullsized":"2024-02-18T10:00:51.085615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736254+0000","last_change":"2024-02-18T10:00:47.757202+0000","last_active":"2024-02-18T10:00:49.736254+0000","last_peered":"2024-02-18T10:00:49.736254+0000","last_clean":"2024-02-18T10:00:49.736254+0000","last_became_active":"2024-02-18T10:00:47.756943+0000","last_became_peered":"2024-02-18T10:00:47.756943+0000","last_unstale":"2024-02-18T10:00:49.736254+0000","last_undegraded":"2024-02-18T10:00:49.736254+0000","last_fullsized":"2024-02-18T10:00:49.736254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738548+0000","last_change":"2024-02-18T10:00:48.756580+0000","last_active":"2024-02-18T10:00:49.738548+0000","last_peered":"2024-02-18T10:00:49.738548+0000","last_clean":"2024-02-18T10:00:49.738548+0000","last_became_active":"2024-02-18T10:00:48.755023+0000","last_became_peered":"2024-02-18T10:00:48.755023+0000","last_unstale":"2024-02-18T10:00:49.738548+0000","last_undegraded":"2024-02-18T10:00:49.738548+0000","last_fullsized":"2024-02-18T10:00:49.738548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:15.426726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737938+0000","last_change":"2024-02-18T10:00:47.745417+0000","last_active":"2024-02-18T10:00:49.737938+0000","last_peered":"2024-02-18T10:00:49.737938+0000","last_clean":"2024-02-18T10:00:49.737938+0000","last_became_active":"2024-02-18T10:00:47.745037+0000","last_became_peered":"2024-02-18T10:00:47.745037+0000","last_unstale":"2024-02-18T10:00:49.737938+0000","last_undegraded":"2024-02-18T10:00:49.737938+0000","last_fullsized":"2024-02-18T10:00:49.737938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086528+0000","last_change":"2024-02-18T10:00:48.757256+0000","last_active":"2024-02-18T10:00:51.086528+0000","last_peered":"2024-02-18T10:00:51.086528+0000","last_clean":"2024-02-18T10:00:51.086528+0000","last_became_active":"2024-02-18T10:00:48.756024+0000","last_became_peered":"2024-02-18T10:00:48.756024+0000","last_unstale":"2024-02-18T10:00:51.086528+0000","last_undegraded":"2024-02-18T10:00:51.086528+0000","last_fullsized":"2024-02-18T10:00:51.086528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:04:20.542014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085539+0000","last_change":"2024-02-18T10:00:47.743984+0000","last_active":"2024-02-18T10:00:51.085539+0000","last_peered":"2024-02-18T10:00:51.085539+0000","last_clean":"2024-02-18T10:00:51.085539+0000","last_became_active":"2024-02-18T10:00:47.743265+0000","last_became_peered":"2024-02-18T10:00:47.743265+0000","last_unstale":"2024-02-18T10:00:51.085539+0000","last_undegraded":"2024-02-18T10:00:51.085539+0000","last_fullsized":"2024-02-18T10:00:51.085539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:08:15.620449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085266+0000","last_change":"2024-02-18T10:00:48.753376+0000","last_active":"2024-02-18T10:00:51.085266+0000","last_peered":"2024-02-18T10:00:51.085266+0000","last_clean":"2024-02-18T10:00:51.085266+0000","last_became_active":"2024-02-18T10:00:48.752989+0000","last_became_peered":"2024-02-18T10:00:48.752989+0000","last_unstale":"2024-02-18T10:00:51.085266+0000","last_undegraded":"2024-02-18T10:00:51.085266+0000","last_fullsized":"2024-02-18T10:00:51.085266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:21:14.163404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086987+0000","last_change":"2024-02-18T10:00:47.754739+0000","last_active":"2024-02-18T10:00:51.086987+0000","last_peered":"2024-02-18T10:00:51.086987+0000","last_clean":"2024-02-18T10:00:51.086987+0000","last_became_active":"2024-02-18T10:00:47.754464+0000","last_became_peered":"2024-02-18T10:00:47.754464+0000","last_unstale":"2024-02-18T10:00:51.086987+0000","last_undegraded":"2024-02-18T10:00:51.086987+0000","last_fullsized":"2024-02-18T10:00:51.086987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086959+0000","last_change":"2024-02-18T10:00:48.765437+0000","last_active":"2024-02-18T10:00:51.086959+0000","last_peered":"2024-02-18T10:00:51.086959+0000","last_clean":"2024-02-18T10:00:51.086959+0000","last_became_active":"2024-02-18T10:00:48.765097+0000","last_became_peered":"2024-02-18T10:00:48.765097+0000","last_unstale":"2024-02-18T10:00:51.086959+0000","last_undegraded":"2024-02-18T10:00:51.086959+0000","last_fullsized":"2024-02-18T10:00:51.086959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:08:37.437332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737570+0000","last_change":"2024-02-18T10:00:47.746081+0000","last_active":"2024-02-18T10:00:49.737570+0000","last_peered":"2024-02-18T10:00:49.737570+0000","last_clean":"2024-02-18T10:00:49.737570+0000","last_became_active":"2024-02-18T10:00:47.745764+0000","last_became_peered":"2024-02-18T10:00:47.745764+0000","last_unstale":"2024-02-18T10:00:49.737570+0000","last_undegraded":"2024-02-18T10:00:49.737570+0000","last_fullsized":"2024-02-18T10:00:49.737570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:05.289341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737642+0000","last_change":"2024-02-18T10:00:48.751734+0000","last_active":"2024-02-18T10:00:49.737642+0000","last_peered":"2024-02-18T10:00:49.737642+0000","last_clean":"2024-02-18T10:00:49.737642+0000","last_became_active":"2024-02-18T10:00:48.751254+0000","last_became_peered":"2024-02-18T10:00:48.751254+0000","last_unstale":"2024-02-18T10:00:49.737642+0000","last_undegraded":"2024-02-18T10:00:49.737642+0000","last_fullsized":"2024-02-18T10:00:49.737642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:19:48.890157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584421+0000","last_change":"2024-02-18T10:00:47.743876+0000","last_active":"2024-02-18T10:00:50.584421+0000","last_peered":"2024-02-18T10:00:50.584421+0000","last_clean":"2024-02-18T10:00:50.584421+0000","last_became_active":"2024-02-18T10:00:47.743205+0000","last_became_peered":"2024-02-18T10:00:47.743205+0000","last_unstale":"2024-02-18T10:00:50.584421+0000","last_undegraded":"2024-02-18T10:00:50.584421+0000","last_fullsized":"2024-02-18T10:00:50.584421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086006+0000","last_change":"2024-02-18T10:00:48.765053+0000","last_active":"2024-02-18T10:00:51.086006+0000","last_peered":"2024-02-18T10:00:51.086006+0000","last_clean":"2024-02-18T10:00:51.086006+0000","last_became_active":"2024-02-18T10:00:48.764751+0000","last_became_peered":"2024-02-18T10:00:48.764751+0000","last_unstale":"2024-02-18T10:00:51.086006+0000","last_undegraded":"2024-02-18T10:00:51.086006+0000","last_fullsized":"2024-02-18T10:00:51.086006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738191+0000","last_change":"2024-02-18T10:00:47.749664+0000","last_active":"2024-02-18T10:00:49.738191+0000","last_peered":"2024-02-18T10:00:49.738191+0000","last_clean":"2024-02-18T10:00:49.738191+0000","last_became_active":"2024-02-18T10:00:47.749355+0000","last_became_peered":"2024-02-18T10:00:47.749355+0000","last_unstale":"2024-02-18T10:00:49.738191+0000","last_undegraded":"2024-02-18T10:00:49.738191+0000","last_fullsized":"2024-02-18T10:00:49.738191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:12:10.356826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086559+0000","last_change":"2024-02-18T10:00:48.764166+0000","last_active":"2024-02-18T10:00:51.086559+0000","last_peered":"2024-02-18T10:00:51.086559+0000","last_clean":"2024-02-18T10:00:51.086559+0000","last_became_active":"2024-02-18T10:00:48.763233+0000","last_became_peered":"2024-02-18T10:00:48.763233+0000","last_unstale":"2024-02-18T10:00:51.086559+0000","last_undegraded":"2024-02-18T10:00:51.086559+0000","last_fullsized":"2024-02-18T10:00:51.086559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:15.703316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584556+0000","last_change":"2024-02-18T10:00:47.746336+0000","last_active":"2024-02-18T10:00:50.584556+0000","last_peered":"2024-02-18T10:00:50.584556+0000","last_clean":"2024-02-18T10:00:50.584556+0000","last_became_active":"2024-02-18T10:00:47.746080+0000","last_became_peered":"2024-02-18T10:00:47.746080+0000","last_unstale":"2024-02-18T10:00:50.584556+0000","last_undegraded":"2024-02-18T10:00:50.584556+0000","last_fullsized":"2024-02-18T10:00:50.584556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086647+0000","last_change":"2024-02-18T10:00:48.764919+0000","last_active":"2024-02-18T10:00:51.086647+0000","last_peered":"2024-02-18T10:00:51.086647+0000","last_clean":"2024-02-18T10:00:51.086647+0000","last_became_active":"2024-02-18T10:00:48.764631+0000","last_became_peered":"2024-02-18T10:00:48.764631+0000","last_unstale":"2024-02-18T10:00:51.086647+0000","last_undegraded":"2024-02-18T10:00:51.086647+0000","last_fullsized":"2024-02-18T10:00:51.086647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:28:18.873439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736349+0000","last_change":"2024-02-18T10:00:47.744202+0000","last_active":"2024-02-18T10:00:49.736349+0000","last_peered":"2024-02-18T10:00:49.736349+0000","last_clean":"2024-02-18T10:00:49.736349+0000","last_became_active":"2024-02-18T10:00:47.743927+0000","last_became_peered":"2024-02-18T10:00:47.743927+0000","last_unstale":"2024-02-18T10:00:49.736349+0000","last_undegraded":"2024-02-18T10:00:49.736349+0000","last_fullsized":"2024-02-18T10:00:49.736349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086559+0000","last_change":"2024-02-18T10:00:48.762138+0000","last_active":"2024-02-18T10:00:51.086559+0000","last_peered":"2024-02-18T10:00:51.086559+0000","last_clean":"2024-02-18T10:00:51.086559+0000","last_became_active":"2024-02-18T10:00:48.761841+0000","last_became_peered":"2024-02-18T10:00:48.761841+0000","last_unstale":"2024-02-18T10:00:51.086559+0000","last_undegraded":"2024-02-18T10:00:51.086559+0000","last_fullsized":"2024-02-18T10:00:51.086559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:16:25.495152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584531+0000","last_change":"2024-02-18T10:00:47.750440+0000","last_active":"2024-02-18T10:00:50.584531+0000","last_peered":"2024-02-18T10:00:50.584531+0000","last_clean":"2024-02-18T10:00:50.584531+0000","last_became_active":"2024-02-18T10:00:47.750171+0000","last_became_peered":"2024-02-18T10:00:47.750171+0000","last_unstale":"2024-02-18T10:00:50.584531+0000","last_undegraded":"2024-02-18T10:00:50.584531+0000","last_fullsized":"2024-02-18T10:00:50.584531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086597+0000","last_change":"2024-02-18T10:00:48.766662+0000","last_active":"2024-02-18T10:00:51.086597+0000","last_peered":"2024-02-18T10:00:51.086597+0000","last_clean":"2024-02-18T10:00:51.086597+0000","last_became_active":"2024-02-18T10:00:48.766405+0000","last_became_peered":"2024-02-18T10:00:48.766405+0000","last_unstale":"2024-02-18T10:00:51.086597+0000","last_undegraded":"2024-02-18T10:00:51.086597+0000","last_fullsized":"2024-02-18T10:00:51.086597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:38:27.370397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085926+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:00:51.085926+0000","last_peered":"2024-02-18T10:00:51.085926+0000","last_clean":"2024-02-18T10:00:51.085926+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:00:51.085926+0000","last_undegraded":"2024-02-18T10:00:51.085926+0000","last_fullsized":"2024-02-18T10:00:51.085926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086179+0000","last_change":"2024-02-18T10:00:47.747706+0000","last_active":"2024-02-18T10:00:51.086179+0000","last_peered":"2024-02-18T10:00:51.086179+0000","last_clean":"2024-02-18T10:00:51.086179+0000","last_became_active":"2024-02-18T10:00:47.747410+0000","last_became_peered":"2024-02-18T10:00:47.747410+0000","last_unstale":"2024-02-18T10:00:51.086179+0000","last_undegraded":"2024-02-18T10:00:51.086179+0000","last_fullsized":"2024-02-18T10:00:51.086179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172827+0000","last_change":"2024-02-18T10:00:48.769224+0000","last_active":"2024-02-18T10:00:50.172827+0000","last_peered":"2024-02-18T10:00:50.172827+0000","last_clean":"2024-02-18T10:00:50.172827+0000","last_became_active":"2024-02-18T10:00:48.768881+0000","last_became_peered":"2024-02-18T10:00:48.768881+0000","last_unstale":"2024-02-18T10:00:50.172827+0000","last_undegraded":"2024-02-18T10:00:50.172827+0000","last_fullsized":"2024-02-18T10:00:50.172827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085786+0000","last_change":"2024-02-18T10:00:47.753097+0000","last_active":"2024-02-18T10:00:51.085786+0000","last_peered":"2024-02-18T10:00:51.085786+0000","last_clean":"2024-02-18T10:00:51.085786+0000","last_became_active":"2024-02-18T10:00:47.751883+0000","last_became_peered":"2024-02-18T10:00:47.751883+0000","last_unstale":"2024-02-18T10:00:51.085786+0000","last_undegraded":"2024-02-18T10:00:51.085786+0000","last_fullsized":"2024-02-18T10:00:51.085786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:32:25.941422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085198+0000","last_change":"2024-02-18T10:00:48.749065+0000","last_active":"2024-02-18T10:00:51.085198+0000","last_peered":"2024-02-18T10:00:51.085198+0000","last_clean":"2024-02-18T10:00:51.085198+0000","last_became_active":"2024-02-18T10:00:48.748721+0000","last_became_peered":"2024-02-18T10:00:48.748721+0000","last_unstale":"2024-02-18T10:00:51.085198+0000","last_undegraded":"2024-02-18T10:00:51.085198+0000","last_fullsized":"2024-02-18T10:00:51.085198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:58:39.082250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.584505+0000","last_change":"2024-02-18T10:00:47.746892+0000","last_active":"2024-02-18T10:00:50.584505+0000","last_peered":"2024-02-18T10:00:50.584505+0000","last_clean":"2024-02-18T10:00:50.584505+0000","last_became_active":"2024-02-18T10:00:47.746655+0000","last_became_peered":"2024-02-18T10:00:47.746655+0000","last_unstale":"2024-02-18T10:00:50.584505+0000","last_undegraded":"2024-02-18T10:00:50.584505+0000","last_fullsized":"2024-02-18T10:00:50.584505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:06.787466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736201+0000","last_change":"2024-02-18T10:00:48.741827+0000","last_active":"2024-02-18T10:00:49.736201+0000","last_peered":"2024-02-18T10:00:49.736201+0000","last_clean":"2024-02-18T10:00:49.736201+0000","last_became_active":"2024-02-18T10:00:48.741575+0000","last_became_peered":"2024-02-18T10:00:48.741575+0000","last_unstale":"2024-02-18T10:00:49.736201+0000","last_undegraded":"2024-02-18T10:00:49.736201+0000","last_fullsized":"2024-02-18T10:00:49.736201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087119+0000","last_change":"2024-02-18T10:00:47.751869+0000","last_active":"2024-02-18T10:00:51.087119+0000","last_peered":"2024-02-18T10:00:51.087119+0000","last_clean":"2024-02-18T10:00:51.087119+0000","last_became_active":"2024-02-18T10:00:47.751627+0000","last_became_peered":"2024-02-18T10:00:47.751627+0000","last_unstale":"2024-02-18T10:00:51.087119+0000","last_undegraded":"2024-02-18T10:00:51.087119+0000","last_fullsized":"2024-02-18T10:00:51.087119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738483+0000","last_change":"2024-02-18T10:00:48.749047+0000","last_active":"2024-02-18T10:00:49.738483+0000","last_peered":"2024-02-18T10:00:49.738483+0000","last_clean":"2024-02-18T10:00:49.738483+0000","last_became_active":"2024-02-18T10:00:48.748750+0000","last_became_peered":"2024-02-18T10:00:48.748750+0000","last_unstale":"2024-02-18T10:00:49.738483+0000","last_undegraded":"2024-02-18T10:00:49.738483+0000","last_fullsized":"2024-02-18T10:00:49.738483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:35.064701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736176+0000","last_change":"2024-02-18T10:00:47.747157+0000","last_active":"2024-02-18T10:00:49.736176+0000","last_peered":"2024-02-18T10:00:49.736176+0000","last_clean":"2024-02-18T10:00:49.736176+0000","last_became_active":"2024-02-18T10:00:47.746267+0000","last_became_peered":"2024-02-18T10:00:47.746267+0000","last_unstale":"2024-02-18T10:00:49.736176+0000","last_undegraded":"2024-02-18T10:00:49.736176+0000","last_fullsized":"2024-02-18T10:00:49.736176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087197+0000","last_change":"2024-02-18T10:00:48.754892+0000","last_active":"2024-02-18T10:00:51.087197+0000","last_peered":"2024-02-18T10:00:51.087197+0000","last_clean":"2024-02-18T10:00:51.087197+0000","last_became_active":"2024-02-18T10:00:48.754634+0000","last_became_peered":"2024-02-18T10:00:48.754634+0000","last_unstale":"2024-02-18T10:00:51.087197+0000","last_undegraded":"2024-02-18T10:00:51.087197+0000","last_fullsized":"2024-02-18T10:00:51.087197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:15.703316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086711+0000","last_change":"2024-02-18T10:00:47.752978+0000","last_active":"2024-02-18T10:00:51.086711+0000","last_peered":"2024-02-18T10:00:51.086711+0000","last_clean":"2024-02-18T10:00:51.086711+0000","last_became_active":"2024-02-18T10:00:47.752637+0000","last_became_peered":"2024-02-18T10:00:47.752637+0000","last_unstale":"2024-02-18T10:00:51.086711+0000","last_undegraded":"2024-02-18T10:00:51.086711+0000","last_fullsized":"2024-02-18T10:00:51.086711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.062387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736363+0000","last_change":"2024-02-18T10:00:48.741218+0000","last_active":"2024-02-18T10:00:49.736363+0000","last_peered":"2024-02-18T10:00:49.736363+0000","last_clean":"2024-02-18T10:00:49.736363+0000","last_became_active":"2024-02-18T10:00:48.740947+0000","last_became_peered":"2024-02-18T10:00:48.740947+0000","last_unstale":"2024-02-18T10:00:49.736363+0000","last_undegraded":"2024-02-18T10:00:49.736363+0000","last_fullsized":"2024-02-18T10:00:49.736363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736441+0000","last_change":"2024-02-18T10:00:47.745748+0000","last_active":"2024-02-18T10:00:49.736441+0000","last_peered":"2024-02-18T10:00:49.736441+0000","last_clean":"2024-02-18T10:00:49.736441+0000","last_became_active":"2024-02-18T10:00:47.745483+0000","last_became_peered":"2024-02-18T10:00:47.745483+0000","last_unstale":"2024-02-18T10:00:49.736441+0000","last_undegraded":"2024-02-18T10:00:49.736441+0000","last_fullsized":"2024-02-18T10:00:49.736441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:46:34.062387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172965+0000","last_change":"2024-02-18T10:00:48.754790+0000","last_active":"2024-02-18T10:00:50.172965+0000","last_peered":"2024-02-18T10:00:50.172965+0000","last_clean":"2024-02-18T10:00:50.172965+0000","last_became_active":"2024-02-18T10:00:48.754516+0000","last_became_peered":"2024-02-18T10:00:48.754516+0000","last_unstale":"2024-02-18T10:00:50.172965+0000","last_undegraded":"2024-02-18T10:00:50.172965+0000","last_fullsized":"2024-02-18T10:00:50.172965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:48.022842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.738088+0000","last_change":"2024-02-18T10:00:47.743582+0000","last_active":"2024-02-18T10:00:49.738088+0000","last_peered":"2024-02-18T10:00:49.738088+0000","last_clean":"2024-02-18T10:00:49.738088+0000","last_became_active":"2024-02-18T10:00:47.743314+0000","last_became_peered":"2024-02-18T10:00:47.743314+0000","last_unstale":"2024-02-18T10:00:49.738088+0000","last_undegraded":"2024-02-18T10:00:49.738088+0000","last_fullsized":"2024-02-18T10:00:49.738088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085499+0000","last_change":"2024-02-18T10:00:48.748201+0000","last_active":"2024-02-18T10:00:51.085499+0000","last_peered":"2024-02-18T10:00:51.085499+0000","last_clean":"2024-02-18T10:00:51.085499+0000","last_became_active":"2024-02-18T10:00:48.747809+0000","last_became_peered":"2024-02-18T10:00:48.747809+0000","last_unstale":"2024-02-18T10:00:51.085499+0000","last_undegraded":"2024-02-18T10:00:51.085499+0000","last_fullsized":"2024-02-18T10:00:51.085499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085772+0000","last_change":"2024-02-18T10:00:47.752933+0000","last_active":"2024-02-18T10:00:51.085772+0000","last_peered":"2024-02-18T10:00:51.085772+0000","last_clean":"2024-02-18T10:00:51.085772+0000","last_became_active":"2024-02-18T10:00:47.752594+0000","last_became_peered":"2024-02-18T10:00:47.752594+0000","last_unstale":"2024-02-18T10:00:51.085772+0000","last_undegraded":"2024-02-18T10:00:51.085772+0000","last_fullsized":"2024-02-18T10:00:51.085772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:57:31.966004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737717+0000","last_change":"2024-02-18T10:00:48.744423+0000","last_active":"2024-02-18T10:00:49.737717+0000","last_peered":"2024-02-18T10:00:49.737717+0000","last_clean":"2024-02-18T10:00:49.737717+0000","last_became_active":"2024-02-18T10:00:48.744108+0000","last_became_peered":"2024-02-18T10:00:48.744108+0000","last_unstale":"2024-02-18T10:00:49.737717+0000","last_undegraded":"2024-02-18T10:00:49.737717+0000","last_fullsized":"2024-02-18T10:00:49.737717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:22:07.789780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736266+0000","last_change":"2024-02-18T10:00:47.748994+0000","last_active":"2024-02-18T10:00:49.736266+0000","last_peered":"2024-02-18T10:00:49.736266+0000","last_clean":"2024-02-18T10:00:49.736266+0000","last_became_active":"2024-02-18T10:00:47.748750+0000","last_became_peered":"2024-02-18T10:00:47.748750+0000","last_unstale":"2024-02-18T10:00:49.736266+0000","last_undegraded":"2024-02-18T10:00:49.736266+0000","last_fullsized":"2024-02-18T10:00:49.736266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:14.424412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172744+0000","last_change":"2024-02-18T10:00:48.742322+0000","last_active":"2024-02-18T10:00:50.172744+0000","last_peered":"2024-02-18T10:00:50.172744+0000","last_clean":"2024-02-18T10:00:50.172744+0000","last_became_active":"2024-02-18T10:00:48.742051+0000","last_became_peered":"2024-02-18T10:00:48.742051+0000","last_unstale":"2024-02-18T10:00:50.172744+0000","last_undegraded":"2024-02-18T10:00:50.172744+0000","last_fullsized":"2024-02-18T10:00:50.172744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:36:28.441584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.736239+0000","last_change":"2024-02-18T10:00:47.744495+0000","last_active":"2024-02-18T10:00:49.736239+0000","last_peered":"2024-02-18T10:00:49.736239+0000","last_clean":"2024-02-18T10:00:49.736239+0000","last_became_active":"2024-02-18T10:00:47.744212+0000","last_became_peered":"2024-02-18T10:00:47.744212+0000","last_unstale":"2024-02-18T10:00:49.736239+0000","last_undegraded":"2024-02-18T10:00:49.736239+0000","last_fullsized":"2024-02-18T10:00:49.736239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:26:25.984333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172955+0000","last_change":"2024-02-18T10:00:48.748982+0000","last_active":"2024-02-18T10:00:50.172955+0000","last_peered":"2024-02-18T10:00:50.172955+0000","last_clean":"2024-02-18T10:00:50.172955+0000","last_became_active":"2024-02-18T10:00:48.748709+0000","last_became_peered":"2024-02-18T10:00:48.748709+0000","last_unstale":"2024-02-18T10:00:50.172955+0000","last_undegraded":"2024-02-18T10:00:50.172955+0000","last_fullsized":"2024-02-18T10:00:50.172955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:49:51.437652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086642+0000","last_change":"2024-02-18T10:00:47.751004+0000","last_active":"2024-02-18T10:00:51.086642+0000","last_peered":"2024-02-18T10:00:51.086642+0000","last_clean":"2024-02-18T10:00:51.086642+0000","last_became_active":"2024-02-18T10:00:47.750711+0000","last_became_peered":"2024-02-18T10:00:47.750711+0000","last_unstale":"2024-02-18T10:00:51.086642+0000","last_undegraded":"2024-02-18T10:00:51.086642+0000","last_fullsized":"2024-02-18T10:00:51.086642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:57:14.424412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:49.737387+0000","last_change":"2024-02-18T10:00:48.763662+0000","last_active":"2024-02-18T10:00:49.737387+0000","last_peered":"2024-02-18T10:00:49.737387+0000","last_clean":"2024-02-18T10:00:49.737387+0000","last_became_active":"2024-02-18T10:00:48.763395+0000","last_became_peered":"2024-02-18T10:00:48.763395+0000","last_unstale":"2024-02-18T10:00:49.737387+0000","last_undegraded":"2024-02-18T10:00:49.737387+0000","last_fullsized":"2024-02-18T10:00:49.737387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:55:44.537624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.087087+0000","last_change":"2024-02-18T10:00:48.752146+0000","last_active":"2024-02-18T10:00:51.087087+0000","last_peered":"2024-02-18T10:00:51.087087+0000","last_clean":"2024-02-18T10:00:51.087087+0000","last_became_active":"2024-02-18T10:00:48.751865+0000","last_became_peered":"2024-02-18T10:00:48.751865+0000","last_unstale":"2024-02-18T10:00:51.087087+0000","last_undegraded":"2024-02-18T10:00:51.087087+0000","last_fullsized":"2024-02-18T10:00:51.087087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:04:20.542014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086278+0000","last_change":"2024-02-18T10:00:47.757335+0000","last_active":"2024-02-18T10:00:51.086278+0000","last_peered":"2024-02-18T10:00:51.086278+0000","last_clean":"2024-02-18T10:00:51.086278+0000","last_became_active":"2024-02-18T10:00:47.756953+0000","last_became_peered":"2024-02-18T10:00:47.756953+0000","last_unstale":"2024-02-18T10:00:51.086278+0000","last_undegraded":"2024-02-18T10:00:51.086278+0000","last_fullsized":"2024-02-18T10:00:51.086278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:33:07.071530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086394+0000","last_change":"2024-02-18T10:00:48.754209+0000","last_active":"2024-02-18T10:00:51.086394+0000","last_peered":"2024-02-18T10:00:51.086394+0000","last_clean":"2024-02-18T10:00:51.086394+0000","last_became_active":"2024-02-18T10:00:48.753933+0000","last_became_peered":"2024-02-18T10:00:48.753933+0000","last_unstale":"2024-02-18T10:00:51.086394+0000","last_undegraded":"2024-02-18T10:00:51.086394+0000","last_fullsized":"2024-02-18T10:00:51.086394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:55:01.219565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.086599+0000","last_change":"2024-02-18T10:00:47.753398+0000","last_active":"2024-02-18T10:00:51.086599+0000","last_peered":"2024-02-18T10:00:51.086599+0000","last_clean":"2024-02-18T10:00:51.086599+0000","last_became_active":"2024-02-18T10:00:47.753137+0000","last_became_peered":"2024-02-18T10:00:47.753137+0000","last_unstale":"2024-02-18T10:00:51.086599+0000","last_undegraded":"2024-02-18T10:00:51.086599+0000","last_fullsized":"2024-02-18T10:00:51.086599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:46:48.763123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085481+0000","last_change":"2024-02-18T10:00:48.754681+0000","last_active":"2024-02-18T10:00:51.085481+0000","last_peered":"2024-02-18T10:00:51.085481+0000","last_clean":"2024-02-18T10:00:51.085481+0000","last_became_active":"2024-02-18T10:00:48.754241+0000","last_became_peered":"2024-02-18T10:00:48.754241+0000","last_unstale":"2024-02-18T10:00:51.085481+0000","last_undegraded":"2024-02-18T10:00:51.085481+0000","last_fullsized":"2024-02-18T10:00:51.085481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:59:24.953484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172832+0000","last_change":"2024-02-18T10:00:47.748073+0000","last_active":"2024-02-18T10:00:50.172832+0000","last_peered":"2024-02-18T10:00:50.172832+0000","last_clean":"2024-02-18T10:00:50.172832+0000","last_became_active":"2024-02-18T10:00:47.747834+0000","last_became_peered":"2024-02-18T10:00:47.747834+0000","last_unstale":"2024-02-18T10:00:50.172832+0000","last_undegraded":"2024-02-18T10:00:50.172832+0000","last_fullsized":"2024-02-18T10:00:50.172832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:03:07.548576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:50.172932+0000","last_change":"2024-02-18T10:00:48.749891+0000","last_active":"2024-02-18T10:00:50.172932+0000","last_peered":"2024-02-18T10:00:50.172932+0000","last_clean":"2024-02-18T10:00:50.172932+0000","last_became_active":"2024-02-18T10:00:48.749644+0000","last_became_peered":"2024-02-18T10:00:48.749644+0000","last_unstale":"2024-02-18T10:00:50.172932+0000","last_undegraded":"2024-02-18T10:00:50.172932+0000","last_fullsized":"2024-02-18T10:00:50.172932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:47.727742+0000","last_clean_scrub_stamp":"2024-02-18T10:00:47.727742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:07.781924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-18T10:00:51.085516+0000","last_change":"2024-02-18T10:00:47.745160+0000","last_active":"2024-02-18T10:00:51.085516+0000","last_peered":"2024-02-18T10:00:51.085516+0000","last_clean":"2024-02-18T10:00:51.085516+0000","last_became_active":"2024-02-18T10:00:47.744705+0000","last_became_peered":"2024-02-18T10:00:47.744705+0000","last_unstale":"2024-02-18T10:00:51.085516+0000","last_undegraded":"2024-02-18T10:00:51.085516+0000","last_fullsized":"2024-02-18T10:00:51.085516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:46.725428+0000","last_clean_scrub_stamp":"2024-02-18T10:00:46.725428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:24:45.056853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:01:00.781 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-18T10:01:00.781 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-18T10:01:00.781 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-18T10:01:00.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-18T10:01:00.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 Processor -- start 2024-02-18T10:01:00.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 -- start start 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efca40a6e60 0x7efca406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 0x7efca414c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efca414f3b0 0x7efca414f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40b4aa0 con 0x7efca414f3b0 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40b4cf0 con 0x7efca40a6e60 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca9735640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca414c8a0 con 0x7efca414bf20 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca37fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efca414f3b0 0x7efca414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca37fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efca414f3b0 0x7efca414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43060/0 (socket says 172.21.15.118:43060) 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.914+0000 7efca37fe640 1 -- 172.21.15.118:0/2578535190 learned_addr learned my addr 172.21.15.118:0/2578535190 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.915+0000 7efca37fe640 1 -- 172.21.15.118:0/2578535190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 msgr2=0x7efca414c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.915+0000 7efca37fe640 1 --2- 172.21.15.118:0/2578535190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 0x7efca414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.915+0000 7efca37fe640 1 -- 172.21.15.118:0/2578535190 >> v2:172.21.15.164:3300/0 conn(0x7efca40a6e60 msgr2=0x7efca406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:00.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.915+0000 7efca37fe640 1 --2- 172.21.15.118:0/2578535190 >> v2:172.21.15.164:3300/0 conn(0x7efca40a6e60 0x7efca406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.915+0000 7efca37fe640 1 -- 172.21.15.118:0/2578535190 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca40a7350 con 0x7efca414f3b0 2024-02-18T10:01:00.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.915+0000 7efca37fe640 1 --2- 172.21.15.118:0/2578535190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca414f830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efca4073170 tx=0x7efc9c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f846e03e0bbfab server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca27fc640 1 -- 172.21.15.118:0/2578535190 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02c950 con 0x7efca414f3b0 2024-02-18T10:01:00.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca27fc640 1 -- 172.21.15.118:0/2578535190 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c02cab0 con 0x7efca414f3b0 2024-02-18T10:01:00.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca27fc640 1 -- 172.21.15.118:0/2578535190 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02ce40 con 0x7efca414f3b0 2024-02-18T10:01:00.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 -- 172.21.15.118:0/2578535190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 msgr2=0x7efca414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 --2- 172.21.15.118:0/2578535190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca414f830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efca4073170 tx=0x7efc9c02bdb0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 -- 172.21.15.118:0/2578535190 shutdown_connections 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 --2- 172.21.15.118:0/2578535190 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca414f830 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 --2- 172.21.15.118:0/2578535190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 0x7efca414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 --2- 172.21.15.118:0/2578535190 >> v2:172.21.15.164:3300/0 conn(0x7efca40a6e60 0x7efca406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 -- 172.21.15.118:0/2578535190 >> 172.21.15.118:0/2578535190 conn(0x7efca40c15b0 msgr2=0x7efca40c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 -- 172.21.15.118:0/2578535190 shutdown_connections 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.916+0000 7efca9735640 1 -- 172.21.15.118:0/2578535190 wait complete. 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.917+0000 7efca9735640 1 Processor -- start 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.917+0000 7efca9735640 1 -- start start 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca9735640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca40a6e60 0x7efca41d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca9735640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 0x7efca41497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca9735640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca41d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca9735640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca41d7f80 con 0x7efca414f3b0 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca9735640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40a1a40 con 0x7efca40a6e60 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca9735640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca40b4860 con 0x7efca414bf20 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca41d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca41d62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43070/0 (socket says 172.21.15.118:43070) 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 -- 172.21.15.118:0/1116628317 learned_addr learned my addr 172.21.15.118:0/1116628317 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca2ffd640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca40a6e60 0x7efca41d85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 -- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 msgr2=0x7efca41497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efc9bfff640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 0x7efca41497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 0x7efca41497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 -- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca40a6e60 msgr2=0x7efca41d85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca40a6e60 0x7efca41d85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 -- 172.21.15.118:0/1116628317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c009b30 con 0x7efca414f3b0 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca2ffd640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca40a6e60 0x7efca41d85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.918+0000 7efca37fe640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca41d62c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009e20 tx=0x7efc9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.919+0000 7efc9b7fe640 1 -- 172.21.15.118:0/1116628317 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c040670 con 0x7efca414f3b0 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.919+0000 7efc9b7fe640 1 -- 172.21.15.118:0/1116628317 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c0407f0 con 0x7efca414f3b0 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.919+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca41d7930 con 0x7efca414f3b0 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.919+0000 7efc9b7fe640 1 -- 172.21.15.118:0/1116628317 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c040ba0 con 0x7efca414f3b0 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.919+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca40b86f0 con 0x7efca414f3b0 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.920+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca4074af0 con 0x7efca414f3b0 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.920+0000 7efc9b7fe640 1 -- 172.21.15.118:0/1116628317 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7efc9c040d00 con 0x7efca414f3b0 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.920+0000 7efc9b7fe640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efc8406bc70 0x7efc8406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:00.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.920+0000 7efc9b7fe640 1 -- 172.21.15.118:0/1116628317 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc9c0ad9c0 con 0x7efca414f3b0 2024-02-18T10:01:00.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.920+0000 7efca2ffd640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efc8406bc70 0x7efc8406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:00.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.921+0000 7efca2ffd640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efc8406bc70 0x7efc8406e130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc9400a870 tx=0x7efc94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:00.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:00.925+0000 7efc9b7fe640 1 -- 172.21.15.118:0/1116628317 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc9c078410 con 0x7efca414f3b0 2024-02-18T10:01:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.133+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efca41d80c0 con 0x7efca414f3b0 2024-02-18T10:01:01.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.134+0000 7efc9b7fe640 1 -- 172.21.15.118:0/1116628317 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efc9c07bad0 con 0x7efca414f3b0 2024-02-18T10:01:01.136 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:01.137 INFO:teuthology.orchestra.run.smithi118.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-18T10:01:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efc8406bc70 msgr2=0x7efc8406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efc8406bc70 0x7efc8406e130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efc9400a870 tx=0x7efc94008040 comp rx=0 tx=0).stop 2024-02-18T10:01:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 msgr2=0x7efca41d62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca41d62c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009e20 tx=0x7efc9c004a40 comp rx=0 tx=0).stop 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 shutdown_connections 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efc8406bc70 0x7efc8406e130 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efca414f3b0 0x7efca41d62c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efca414bf20 0x7efca41497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 --2- 172.21.15.118:0/1116628317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca40a6e60 0x7efca41d85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.135+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 >> 172.21.15.118:0/1116628317 conn(0x7efca40c15b0 msgr2=0x7efca40a0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.136+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 shutdown_connections 2024-02-18T10:01:01.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.136+0000 7efca9735640 1 -- 172.21.15.118:0/1116628317 wait complete. 2024-02-18T10:01:01.149 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-18T10:01:01.149 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:01.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.245+0000 7f99c2e64640 1 Processor -- start 2024-02-18T10:01:01.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.245+0000 7f99c2e64640 1 -- start start 2024-02-18T10:01:01.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c2e64640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99bc0a6e60 0x7f99bc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c2e64640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f99bc1546d0 0x7f99bc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c2e64640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b4aa0 con 0x7f99bc14bf20 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c2e64640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0b4cf0 con 0x7f99bc0a6e60 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c2e64640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0a7350 con 0x7f99bc1546d0 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c0c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99bc0a6e60 0x7f99bc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c0c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99bc0a6e60 0x7f99bc06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43084/0 (socket says 172.21.15.118:43084) 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c0c00640 1 -- 172.21.15.118:0/2079352255 learned_addr learned my addr 172.21.15.118:0/2079352255 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c1401640 1 --2- 172.21.15.118:0/2079352255 >> v2:172.21.15.164:3300/0 conn(0x7f99bc1546d0 0x7f99bc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c0c00640 1 -- 172.21.15.118:0/2079352255 >> v2:172.21.15.164:3300/0 conn(0x7f99bc1546d0 msgr2=0x7f99bc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c0c00640 1 --2- 172.21.15.118:0/2079352255 >> v2:172.21.15.164:3300/0 conn(0x7f99bc1546d0 0x7f99bc156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c0c00640 1 -- 172.21.15.118:0/2079352255 >> v1:172.21.15.164:6789/0 conn(0x7f99bc14bf20 legacy=0x7f99bc14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.246+0000 7f99c0c00640 1 -- 172.21.15.118:0/2079352255 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0c1140 con 0x7f99bc0a6e60 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.247+0000 7f99c0c00640 1 --2- 172.21.15.118:0/2079352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc0a6e60 0x7f99bc06b5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99bc04f930 tx=0x7f99ac02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2b81c1fdfd28f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.247+0000 7f99bb7fe640 1 -- 172.21.15.118:0/2079352255 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac02c9f0 con 0x7f99bc0a6e60 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.247+0000 7f99bb7fe640 1 -- 172.21.15.118:0/2079352255 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac02cb50 con 0x7f99bc0a6e60 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.247+0000 7f99bb7fe640 1 -- 172.21.15.118:0/2079352255 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0343f0 con 0x7f99bc0a6e60 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 -- 172.21.15.118:0/2079352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc0a6e60 msgr2=0x7f99bc06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2079352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc0a6e60 0x7f99bc06b5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99bc04f930 tx=0x7f99ac02be50 comp rx=0 tx=0).stop 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 -- 172.21.15.118:0/2079352255 shutdown_connections 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2079352255 >> v2:172.21.15.164:3300/0 conn(0x7f99bc1546d0 0x7f99bc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2079352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc0a6e60 0x7f99bc06b5c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 -- 172.21.15.118:0/2079352255 >> 172.21.15.118:0/2079352255 conn(0x7f99bc0c15b0 msgr2=0x7f99bc0c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 -- 172.21.15.118:0/2079352255 shutdown_connections 2024-02-18T10:01:01.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.248+0000 7f99c2e64640 1 -- 172.21.15.118:0/2079352255 wait complete. 2024-02-18T10:01:01.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.249+0000 7f99c2e64640 1 Processor -- start 2024-02-18T10:01:01.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.249+0000 7f99c2e64640 1 -- start start 2024-02-18T10:01:01.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c2e64640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0a6e60 0x7f99bc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c2e64640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc14bf20 0x7f99bc0b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c2e64640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc1546d0 0x7f99bc1e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c2e64640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b5c80 con 0x7f99bc14bf20 2024-02-18T10:01:01.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c2e64640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1e5dc0 con 0x7f99bc0a6e60 2024-02-18T10:01:01.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c2e64640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1e5490 con 0x7f99bc1546d0 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc14bf20 0x7f99bc0b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc14bf20 0x7f99bc0b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43088/0 (socket says 172.21.15.118:43088) 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 -- 172.21.15.118:0/2758626039 learned_addr learned my addr 172.21.15.118:0/2758626039 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c0c00640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0a6e60 0x7f99bc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 -- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc1546d0 msgr2=0x7f99bc1e32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc1546d0 0x7f99bc1e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 -- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0a6e60 msgr2=0x7f99bc0b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0a6e60 0x7f99bc0b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 -- 172.21.15.118:0/2758626039 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009b30 con 0x7f99bc14bf20 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c0c00640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0a6e60 0x7f99bc0b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99bbfff640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc14bf20 0x7f99bc0b5740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c440 tx=0x7f99b0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99b97fa640 1 -- 172.21.15.118:0/2758626039 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00052d0 con 0x7f99bc14bf20 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99b97fa640 1 -- 172.21.15.118:0/2758626039 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0005430 con 0x7f99bc14bf20 2024-02-18T10:01:01.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc1e5770 con 0x7f99bc14bf20 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.250+0000 7f99b97fa640 1 -- 172.21.15.118:0/2758626039 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0007260 con 0x7f99bc14bf20 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.251+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc14cb30 con 0x7f99bc14bf20 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.251+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc1e5f70 con 0x7f99bc14bf20 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.252+0000 7f99b97fa640 1 -- 172.21.15.118:0/2758626039 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f99b00073c0 con 0x7f99bc14bf20 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.252+0000 7f99b97fa640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f99a806bc70 0x7f99a806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.252+0000 7f99b97fa640 1 -- 172.21.15.118:0/2758626039 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b0089bd0 con 0x7f99bc14bf20 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.252+0000 7f99c0c00640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f99a806bc70 0x7f99a806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.253+0000 7f99c0c00640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f99a806bc70 0x7f99a806e130 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f99ac035000 tx=0x7f99ac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.257+0000 7f99b97fa640 1 -- 172.21.15.118:0/2758626039 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99bc1e5f70 con 0x7f99bc14bf20 2024-02-18T10:01:01.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.429+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99bc1e5f30 con 0x7f99bc14bf20 2024-02-18T10:01:01.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.431+0000 7f99b97fa640 1 -- 172.21.15.118:0/2758626039 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f99b00543b0 con 0x7f99bc14bf20 2024-02-18T10:01:01.433 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:01.433 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:01.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f99a806bc70 msgr2=0x7f99a806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f99a806bc70 0x7f99a806e130 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f99ac035000 tx=0x7f99ac030000 comp rx=0 tx=0).stop 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc14bf20 msgr2=0x7f99bc0b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc14bf20 0x7f99bc0b5740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c440 tx=0x7f99b0001e70 comp rx=0 tx=0).stop 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 shutdown_connections 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f99a806bc70 0x7f99a806e130 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f99bc1546d0 0x7f99bc1e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99bc14bf20 0x7f99bc0b5740 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 --2- 172.21.15.118:0/2758626039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f99bc0a6e60 0x7f99bc0b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 >> 172.21.15.118:0/2758626039 conn(0x7f99bc0c15b0 msgr2=0x7f99bc0bf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 shutdown_connections 2024-02-18T10:01:01.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.433+0000 7f99c2e64640 1 -- 172.21.15.118:0/2758626039 wait complete. 2024-02-18T10:01:01.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:01.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:01.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.549+0000 7f60ef59e640 1 Processor -- start 2024-02-18T10:01:01.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.549+0000 7f60ef59e640 1 -- start start 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ef59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f006c850 0x7f60f014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ef59e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f60f009e350 0x7f60f0145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ef59e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f00b9920 con 0x7f60f0146110 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ef59e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f009e860 con 0x7f60f009e350 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ef59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f014f1d0 con 0x7f60f006c850 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60e7fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f60f009e350 0x7f60f0145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f006c850 0x7f60f014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60eed9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f60f0146110 0x7f60f014bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:52410/0 (socket says 172.21.15.118:52410) 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f006c850 0x7f60f014f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:56164/0 (socket says 172.21.15.118:56164) 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60e7fff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f60f009e350 0x7f60f0145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:58422/0 (socket says 172.21.15.118:58422) 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60eed9d640 1 -- 172.21.15.118:0/2912142336 learned_addr learned my addr 172.21.15.118:0/2912142336 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60e7fff640 1 -- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f006c850 msgr2=0x7f60f014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60e7fff640 1 --2- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f006c850 0x7f60f014f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60e7fff640 1 -- 172.21.15.118:0/2912142336 >> v1:172.21.15.164:6789/0 conn(0x7f60f0146110 legacy=0x7f60f014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60edd9b640 1 -- 172.21.15.118:0/2912142336 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992810978 0 0) 0x7f60f00b9920 con 0x7f60f0146110 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60e7fff640 1 -- 172.21.15.118:0/2912142336 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f014f4b0 con 0x7f60f009e350 2024-02-18T10:01:01.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.550+0000 7f60ee59c640 1 --2- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f006c850 0x7f60f014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:01:01.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.551+0000 7f60e7fff640 1 --2- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f009e350 0x7f60f0145bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60d80097d0 tx=0x7f60d802b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e8763a9fb5d959 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.551+0000 7f60edd9b640 1 -- 172.21.15.118:0/2912142336 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8031800 con 0x7f60f009e350 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.551+0000 7f60edd9b640 1 -- 172.21.15.118:0/2912142336 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8031960 con 0x7f60f009e350 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.551+0000 7f60edd9b640 1 -- 172.21.15.118:0/2912142336 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8031cf0 con 0x7f60f009e350 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 -- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f009e350 msgr2=0x7f60f0145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 --2- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f009e350 0x7f60f0145bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60d80097d0 tx=0x7f60d802b8a0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 -- 172.21.15.118:0/2912142336 shutdown_connections 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 --2- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f009e350 0x7f60f0145bd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 --2- 172.21.15.118:0/2912142336 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f006c850 0x7f60f014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 -- 172.21.15.118:0/2912142336 >> 172.21.15.118:0/2912142336 conn(0x7f60f00bdbe0 msgr2=0x7f60f006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 -- 172.21.15.118:0/2912142336 shutdown_connections 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.552+0000 7f60ef59e640 1 -- 172.21.15.118:0/2912142336 wait complete. 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.553+0000 7f60ef59e640 1 Processor -- start 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.553+0000 7f60ef59e640 1 -- start start 2024-02-18T10:01:01.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f006c850 0x7f60f006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f009e350 0x7f60f0072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f0146110 0x7f60f014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f014e710 con 0x7f60f0146110 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f0072120 con 0x7f60f006c850 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f01d6070 con 0x7f60f009e350 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f0146110 0x7f60f014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f0146110 0x7f60f014e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43094/0 (socket says 172.21.15.118:43094) 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 -- 172.21.15.118:0/3778321742 learned_addr learned my addr 172.21.15.118:0/3778321742 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ee59c640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f006c850 0x7f60f006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60e7fff640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f009e350 0x7f60f0072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 -- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f009e350 msgr2=0x7f60f0072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f009e350 0x7f60f0072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 -- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f006c850 msgr2=0x7f60f006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f006c850 0x7f60f006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 -- 172.21.15.118:0/3778321742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0009400 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ee59c640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f006c850 0x7f60f006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60eed9d640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f0146110 0x7f60f014e1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c6d0 tx=0x7f60e800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60e6ffd640 1 -- 172.21.15.118:0/3778321742 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8004d60 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60e6ffd640 1 -- 172.21.15.118:0/3778321742 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800a640 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d8009400 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60e6ffd640 1 -- 172.21.15.118:0/3778321742 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800aa70 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.554+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f00b7c10 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.556+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f004ef20 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.556+0000 7f60e6ffd640 1 -- 172.21.15.118:0/3778321742 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f60e80070d0 con 0x7f60f0146110 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.556+0000 7f60e6ffd640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f60d006bca0 0x7f60d006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.556+0000 7f60e6ffd640 1 -- 172.21.15.118:0/3778321742 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60e8089f70 con 0x7f60f0146110 2024-02-18T10:01:01.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.556+0000 7f60ee59c640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f60d006bca0 0x7f60d006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.557+0000 7f60ee59c640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f60d006bca0 0x7f60d006e160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d20 tx=0x7f60e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.560+0000 7f60e6ffd640 1 -- 172.21.15.118:0/3778321742 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60e80bd8c0 con 0x7f60f0146110 2024-02-18T10:01:01.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.731+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60f01d5e50 con 0x7f60f0146110 2024-02-18T10:01:01.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.731+0000 7f60e6ffd640 1 -- 172.21.15.118:0/3778321742 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60e8018020 con 0x7f60f0146110 2024-02-18T10:01:01.734 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f60d006bca0 msgr2=0x7f60d006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f60d006bca0 0x7f60d006e160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d20 tx=0x7f60e0008040 comp rx=0 tx=0).stop 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f0146110 msgr2=0x7f60f014e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f0146110 0x7f60f014e1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60e800c6d0 tx=0x7f60e800cb90 comp rx=0 tx=0).stop 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 shutdown_connections 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f60d006bca0 0x7f60d006e160 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f60f0146110 0x7f60f014e1d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f60f009e350 0x7f60f0072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 --2- 172.21.15.118:0/3778321742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f60f006c850 0x7f60f006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 >> 172.21.15.118:0/3778321742 conn(0x7f60f00bdbe0 msgr2=0x7f60f00a1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 shutdown_connections 2024-02-18T10:01:01.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.733+0000 7f60ef59e640 1 -- 172.21.15.118:0/3778321742 wait complete. 2024-02-18T10:01:01.746 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:01.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.847+0000 7fd972b3a640 1 Processor -- start 2024-02-18T10:01:01.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.847+0000 7fd972b3a640 1 -- start start 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd972b3a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd96c06f930 0x7fd96c149c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd972b3a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c0bfd10 con 0x7fd96c143e10 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd972b3a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c14d460 con 0x7fd96c14cf80 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd972b3a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c14d740 con 0x7fd96c06f930 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd963fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd96c06f930 0x7fd96c149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd9708d6640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd96c143e10 0x7fd96c0bf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38706/0 (socket says 172.21.15.118:38706) 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd9708d6640 1 -- 172.21.15.118:0/1363446342 learned_addr learned my addr 172.21.15.118:0/1363446342 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd963fff640 1 -- 172.21.15.118:0/1363446342 >> v1:172.21.15.164:6789/0 conn(0x7fd96c14cf80 legacy=0x7fd96c154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:01.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd963fff640 1 -- 172.21.15.118:0/1363446342 >> v1:172.21.15.118:6789/0 conn(0x7fd96c143e10 legacy=0x7fd96c0bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd9637fe640 1 -- 172.21.15.118:0/1363446342 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954668695 0 0) 0x7fd96c0bfd10 con 0x7fd96c143e10 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.848+0000 7fd963fff640 1 -- 172.21.15.118:0/1363446342 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c14da20 con 0x7fd96c06f930 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd963fff640 1 --2- 172.21.15.118:0/1363446342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c06f930 0x7fd96c149c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0097a0 tx=0x7fd95c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b2b1f100b9f46 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd9637fe640 1 -- 172.21.15.118:0/1363446342 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c02f810 con 0x7fd96c06f930 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd9637fe640 1 -- 172.21.15.118:0/1363446342 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c02f970 con 0x7fd96c06f930 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd9637fe640 1 -- 172.21.15.118:0/1363446342 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c02fd00 con 0x7fd96c06f930 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd972b3a640 1 -- 172.21.15.118:0/1363446342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c06f930 msgr2=0x7fd96c149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1363446342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c06f930 0x7fd96c149c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0097a0 tx=0x7fd95c02b9f0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd972b3a640 1 -- 172.21.15.118:0/1363446342 shutdown_connections 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1363446342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c06f930 0x7fd96c149c00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd972b3a640 1 -- 172.21.15.118:0/1363446342 >> 172.21.15.118:0/1363446342 conn(0x7fd96c06adc0 msgr2=0x7fd96c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:01.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd972b3a640 1 -- 172.21.15.118:0/1363446342 shutdown_connections 2024-02-18T10:01:01.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.849+0000 7fd972b3a640 1 -- 172.21.15.118:0/1363446342 wait complete. 2024-02-18T10:01:01.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.850+0000 7fd972b3a640 1 Processor -- start 2024-02-18T10:01:01.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.850+0000 7fd972b3a640 1 -- start start 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd972b3a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c143e10 0x7fd96c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd972b3a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd96c14cf80 0x7fd96c1e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd972b3a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd96c1428d0 0x7fd96c142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd972b3a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1d3f20 con 0x7fd96c143e10 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd972b3a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c1d4200 con 0x7fd96c1428d0 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd972b3a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0b38a0 con 0x7fd96c14cf80 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c143e10 0x7fd96c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c143e10 0x7fd96c0b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43108/0 (socket says 172.21.15.118:43108) 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 -- 172.21.15.118:0/1593650983 learned_addr learned my addr 172.21.15.118:0/1593650983 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 -- 172.21.15.118:0/1593650983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd96c14cf80 msgr2=0x7fd96c1e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd96c14cf80 0x7fd96c1e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 -- 172.21.15.118:0/1593650983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd96c1428d0 msgr2=0x7fd96c142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:01.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd96c1428d0 0x7fd96c142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.851+0000 7fd9708d6640 1 -- 172.21.15.118:0/1593650983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c009400 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.852+0000 7fd9708d6640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c143e10 0x7fd96c0b3360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c4a0 tx=0x7fd96800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.852+0000 7fd9617fa640 1 -- 172.21.15.118:0/1593650983 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680074e0 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.852+0000 7fd9617fa640 1 -- 172.21.15.118:0/1593650983 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968007640 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.852+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c1e3440 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.852+0000 7fd9617fa640 1 -- 172.21.15.118:0/1593650983 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968004a00 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.852+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c1e3160 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.853+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c075150 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.853+0000 7fd9617fa640 1 -- 172.21.15.118:0/1593650983 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fd968004b60 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.853+0000 7fd9617fa640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd95806bc70 0x7fd95806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.854+0000 7fd963fff640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd95806bc70 0x7fd95806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.854+0000 7fd9617fa640 1 -- 172.21.15.118:0/1593650983 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd968089c20 con 0x7fd96c143e10 2024-02-18T10:01:01.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.854+0000 7fd963fff640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd95806bc70 0x7fd95806e130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd95c036000 tx=0x7fd95c039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:01.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:01.858+0000 7fd9617fa640 1 -- 172.21.15.118:0/1593650983 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd968054490 con 0x7fd96c143e10 2024-02-18T10:01:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.027+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd96c074af0 con 0x7fd96c143e10 2024-02-18T10:01:02.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.028+0000 7fd9617fa640 1 -- 172.21.15.118:0/1593650983 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9680180a0 con 0x7fd96c143e10 2024-02-18T10:01:02.031 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:02.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd95806bc70 msgr2=0x7fd95806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd95806bc70 0x7fd95806e130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd95c036000 tx=0x7fd95c039040 comp rx=0 tx=0).stop 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c143e10 msgr2=0x7fd96c0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c143e10 0x7fd96c0b3360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c4a0 tx=0x7fd96800c960 comp rx=0 tx=0).stop 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 shutdown_connections 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd95806bc70 0x7fd95806e130 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd96c1428d0 0x7fd96c142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd96c14cf80 0x7fd96c1e2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 --2- 172.21.15.118:0/1593650983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd96c143e10 0x7fd96c0b3360 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 >> 172.21.15.118:0/1593650983 conn(0x7fd96c06adc0 msgr2=0x7fd96c0bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 shutdown_connections 2024-02-18T10:01:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.030+0000 7fd972b3a640 1 -- 172.21.15.118:0/1593650983 wait complete. 2024-02-18T10:01:02.045 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:02.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.145+0000 7f7b079f4640 1 Processor -- start 2024-02-18T10:01:02.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.145+0000 7f7b079f4640 1 -- start start 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b079f4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7b000bb600 0x7f7b0006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b079f4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0006c450 con 0x7f7b00149440 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b079f4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b00149820 con 0x7f7b000bf550 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b079f4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b000bbb90 con 0x7f7b000bb600 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b05790640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7b00149440 0x7f7b000ba500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38712/0 (socket says 172.21.15.118:38712) 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b05790640 1 -- 172.21.15.118:0/2915460773 learned_addr learned my addr 172.21.15.118:0/2915460773 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b04f8f640 1 --2- 172.21.15.118:0/2915460773 >> v2:172.21.15.164:3300/0 conn(0x7f7b000bb600 0x7f7b0006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572614992 0 0) 0x7f7b0006c450 con 0x7f7b00149440 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aec003520 con 0x7f7b00149440 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827075472 0 0) 0x7f7aec003520 con 0x7f7b00149440 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 >> v2:172.21.15.164:3300/0 conn(0x7f7b000bb600 msgr2=0x7f7b0006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 --2- 172.21.15.118:0/2915460773 >> v2:172.21.15.164:3300/0 conn(0x7f7b000bb600 0x7f7b0006d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 >> v1:172.21.15.164:6789/0 conn(0x7f7b000bf550 legacy=0x7f7b00156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0006be90 con 0x7f7b00149440 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f7af80019f0 con 0x7f7b00149440 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 >> v1:172.21.15.118:6789/0 conn(0x7f7b00149440 legacy=0x7f7b000ba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec003970 0x7f7aec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec0047c0 0x7f7aec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7aec005180 0x7f7aec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000bbb90 con 0x7f7aec0047c0 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec00c020 con 0x7f7aec003970 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec00c1e0 con 0x7f7aec005180 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b04f8f640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec0047c0 0x7f7aec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.146+0000 7f7b05790640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec003970 0x7f7aec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b05f91640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7aec005180 0x7f7aec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b04f8f640 1 -- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7aec005180 msgr2=0x7f7aec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b04f8f640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7aec005180 0x7f7aec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b04f8f640 1 -- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec003970 msgr2=0x7f7aec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b04f8f640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec003970 0x7f7aec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b04f8f640 1 -- 172.21.15.118:0/2915460773 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec003520 con 0x7f7aec0047c0 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b05f91640 1 -- 172.21.15.118:0/2915460773 reap_dead start 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7b04f8f640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec0047c0 0x7f7aec004c40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009ac0 tx=0x7f7aec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede68e8fbf9c6a24 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af002c6b0 con 0x7f7aec0047c0 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af002c810 con 0x7f7aec0047c0 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.147+0000 7f7af7fff640 1 -- 172.21.15.118:0/2915460773 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af002cba0 con 0x7f7aec0047c0 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.148+0000 7f7b079f4640 1 -- 172.21.15.118:0/2915460773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec0047c0 msgr2=0x7f7aec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.148+0000 7f7b079f4640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec0047c0 0x7f7aec004c40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009ac0 tx=0x7f7aec0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.148+0000 7f7b079f4640 1 -- 172.21.15.118:0/2915460773 shutdown_connections 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.148+0000 7f7b079f4640 1 --2- 172.21.15.118:0/2915460773 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7aec0047c0 0x7f7aec004c40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.148+0000 7f7b079f4640 1 -- 172.21.15.118:0/2915460773 >> 172.21.15.118:0/2915460773 conn(0x7f7b0006adc0 msgr2=0x7f7b0006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.148+0000 7f7b079f4640 1 -- 172.21.15.118:0/2915460773 shutdown_connections 2024-02-18T10:01:02.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.148+0000 7f7b079f4640 1 -- 172.21.15.118:0/2915460773 wait complete. 2024-02-18T10:01:02.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.149+0000 7f7b079f4640 1 Processor -- start 2024-02-18T10:01:02.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.149+0000 7f7b079f4640 1 -- start start 2024-02-18T10:01:02.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b079f4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec0047c0 0x7f7b00140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b079f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b001e1a40 0x7f7b000b8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b079f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b000b6d80 0x7f7b000b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b079f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000b8e40 con 0x7f7b000b6d80 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b079f4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000b7740 con 0x7f7aec0047c0 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b079f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b001e1fb0 con 0x7f7b001e1a40 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b000b6d80 0x7f7b000b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b000b6d80 0x7f7b000b7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43120/0 (socket says 172.21.15.118:43120) 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 -- 172.21.15.118:0/4196865485 learned_addr learned my addr 172.21.15.118:0/4196865485 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b04f8f640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b001e1a40 0x7f7b000b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05790640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec0047c0 0x7f7b00140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 -- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b001e1a40 msgr2=0x7f7b000b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b001e1a40 0x7f7b000b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 -- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec0047c0 msgr2=0x7f7b00140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec0047c0 0x7f7b00140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 -- 172.21.15.118:0/4196865485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b001e2290 con 0x7f7b000b6d80 2024-02-18T10:01:02.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b04f8f640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b001e1a40 0x7f7b000b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05790640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec0047c0 0x7f7b00140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b05f91640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b000b6d80 0x7f7b000b7200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b00070100 tx=0x7f7afc00e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7af5ffb640 1 -- 172.21.15.118:0/4196865485 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0050d0 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7af5ffb640 1 -- 172.21.15.118:0/4196865485 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc005230 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7af5ffb640 1 -- 172.21.15.118:0/4196865485 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0035f0 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.150+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b001e2570 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.151+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b000b94a0 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.152+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b00075150 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.152+0000 7f7af5ffb640 1 -- 172.21.15.118:0/4196865485 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f7afc003750 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.152+0000 7f7af5ffb640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7ae406bca0 0x7f7ae406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.152+0000 7f7af5ffb640 1 -- 172.21.15.118:0/4196865485 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7afc089bf0 con 0x7f7b000b6d80 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.152+0000 7f7b05790640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7ae406bca0 0x7f7ae406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.153+0000 7f7b05790640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7ae406bca0 0x7f7ae406e160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7af8004c20 tx=0x7f7af8006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.157+0000 7f7af5ffb640 1 -- 172.21.15.118:0/4196865485 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7afc054460 con 0x7f7b000b6d80 2024-02-18T10:01:02.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.327+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b00074af0 con 0x7f7b000b6d80 2024-02-18T10:01:02.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.327+0000 7f7af5ffb640 1 -- 172.21.15.118:0/4196865485 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7afc0190a0 con 0x7f7b000b6d80 2024-02-18T10:01:02.330 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7ae406bca0 msgr2=0x7f7ae406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7ae406bca0 0x7f7ae406e160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7af8004c20 tx=0x7f7af8006040 comp rx=0 tx=0).stop 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b000b6d80 msgr2=0x7f7b000b7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b000b6d80 0x7f7b000b7200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b00070100 tx=0x7f7afc00e610 comp rx=0 tx=0).stop 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 shutdown_connections 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7ae406bca0 0x7f7ae406e160 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b000b6d80 0x7f7b000b7200 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b001e1a40 0x7f7b000b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 --2- 172.21.15.118:0/4196865485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7aec0047c0 0x7f7b00140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 >> 172.21.15.118:0/4196865485 conn(0x7f7b0006adc0 msgr2=0x7f7b00146dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:02.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 shutdown_connections 2024-02-18T10:01:02.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.329+0000 7f7b079f4640 1 -- 172.21.15.118:0/4196865485 wait complete. 2024-02-18T10:01:02.342 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:02.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.439+0000 7f38b505b640 1 Processor -- start 2024-02-18T10:01:02.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.439+0000 7f38b505b640 1 -- start start 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.439+0000 7f38b505b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f38b006bc20 0x7f38b014c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.439+0000 7f38b505b640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b00bf6b0 con 0x7f38b00bd240 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.439+0000 7f38b505b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b014be60 con 0x7f38b00bf260 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.439+0000 7f38b505b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b00bdbb0 con 0x7f38b006bc20 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.440+0000 7f38aed9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f38b006bc20 0x7f38b014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.440+0000 7f38ae59c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f38b00bd240 0x7f38b00bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38722/0 (socket says 172.21.15.118:38722) 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.440+0000 7f38ae59c640 1 -- 172.21.15.118:0/258586724 learned_addr learned my addr 172.21.15.118:0/258586724 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:02.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.440+0000 7f38aed9d640 1 -- 172.21.15.118:0/258586724 >> v1:172.21.15.164:6789/0 conn(0x7f38b00bf260 legacy=0x7f38b01565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.440+0000 7f38aed9d640 1 -- 172.21.15.118:0/258586724 >> v1:172.21.15.118:6789/0 conn(0x7f38b00bd240 legacy=0x7f38b00bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.440+0000 7f38add9b640 1 -- 172.21.15.118:0/258586724 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297995966 0 0) 0x7f38a4001110 con 0x7f38b00bd240 2024-02-18T10:01:02.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.440+0000 7f38aed9d640 1 -- 172.21.15.118:0/258586724 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b014c140 con 0x7f38b006bc20 2024-02-18T10:01:02.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38aed9d640 1 --2- 172.21.15.118:0/258586724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b006bc20 0x7f38b014c940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097a0 tx=0x7f38a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0387371d37e080 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38add9b640 1 -- 172.21.15.118:0/258586724 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0031830 con 0x7f38b006bc20 2024-02-18T10:01:02.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38add9b640 1 -- 172.21.15.118:0/258586724 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0031990 con 0x7f38b006bc20 2024-02-18T10:01:02.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38add9b640 1 -- 172.21.15.118:0/258586724 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0031d20 con 0x7f38b006bc20 2024-02-18T10:01:02.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38b505b640 1 -- 172.21.15.118:0/258586724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b006bc20 msgr2=0x7f38b014c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38b505b640 1 --2- 172.21.15.118:0/258586724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b006bc20 0x7f38b014c940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097a0 tx=0x7f38a002b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38b505b640 1 -- 172.21.15.118:0/258586724 shutdown_connections 2024-02-18T10:01:02.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38b505b640 1 --2- 172.21.15.118:0/258586724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b006bc20 0x7f38b014c940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38b505b640 1 -- 172.21.15.118:0/258586724 >> 172.21.15.118:0/258586724 conn(0x7f38b00c1850 msgr2=0x7f38b00c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:02.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38b505b640 1 -- 172.21.15.118:0/258586724 shutdown_connections 2024-02-18T10:01:02.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.441+0000 7f38b505b640 1 -- 172.21.15.118:0/258586724 wait complete. 2024-02-18T10:01:02.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 Processor -- start 2024-02-18T10:01:02.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 -- start start 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38b006bc20 0x7f38b00b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b00bd240 0x7f38b00b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b00bf260 0x7f38b00b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0146a10 con 0x7f38b00bf260 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b00bb770 con 0x7f38b00bd240 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38b505b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0147b70 con 0x7f38b006bc20 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38af59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b00bf260 0x7f38b00b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38af59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b00bf260 0x7f38b00b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43136/0 (socket says 172.21.15.118:43136) 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.443+0000 7f38af59e640 1 -- 172.21.15.118:0/2845208871 learned_addr learned my addr 172.21.15.118:0/2845208871 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38ae59c640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b00bd240 0x7f38b00b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38af59e640 1 -- 172.21.15.118:0/2845208871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38b006bc20 msgr2=0x7f38b00b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38af59e640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38b006bc20 0x7f38b00b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38af59e640 1 -- 172.21.15.118:0/2845208871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b00bd240 msgr2=0x7f38b00b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38af59e640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b00bd240 0x7f38b00b8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38af59e640 1 -- 172.21.15.118:0/2845208871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a0009400 con 0x7f38b00bf260 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38af59e640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b00bf260 0x7f38b00b3d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38a800c6e0 tx=0x7f38a800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38977fe640 1 -- 172.21.15.118:0/2845208871 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8003b70 con 0x7f38b00bf260 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38977fe640 1 -- 172.21.15.118:0/2845208871 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a8003cf0 con 0x7f38b00bf260 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b00bab10 con 0x7f38b00bf260 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38977fe640 1 -- 172.21.15.118:0/2845208871 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a8005310 con 0x7f38b00bf260 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.444+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b0147de0 con 0x7f38b00bf260 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.445+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b00bcc10 con 0x7f38b00bf260 2024-02-18T10:01:02.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.445+0000 7f38977fe640 1 -- 172.21.15.118:0/2845208871 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f38a8005470 con 0x7f38b00bf260 2024-02-18T10:01:02.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.446+0000 7f38977fe640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f389c06bc70 0x7f389c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.446+0000 7f38aed9d640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f389c06bc70 0x7f389c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.446+0000 7f38977fe640 1 -- 172.21.15.118:0/2845208871 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38a808a490 con 0x7f38b00bf260 2024-02-18T10:01:02.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.446+0000 7f38aed9d640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f389c06bc70 0x7f389c06e130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38a0036000 tx=0x7f38a0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.450+0000 7f38977fe640 1 -- 172.21.15.118:0/2845208871 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38a8054d00 con 0x7f38b00bf260 2024-02-18T10:01:02.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.656+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38b014c4b0 con 0x7f38b00bf260 2024-02-18T10:01:02.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.657+0000 7f38977fe640 1 -- 172.21.15.118:0/2845208871 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7f38a8003e60 con 0x7f38b00bf260 2024-02-18T10:01:02.660 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:02.660 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:01:02.660 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:01:02.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.658+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f389c06bc70 msgr2=0x7f389c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.658+0000 7f38b505b640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f389c06bc70 0x7f389c06e130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38a0036000 tx=0x7f38a0030000 comp rx=0 tx=0).stop 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.658+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b00bf260 msgr2=0x7f38b00b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.658+0000 7f38b505b640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b00bf260 0x7f38b00b3d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38a800c6e0 tx=0x7f38a800cba0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 shutdown_connections 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f389c06bc70 0x7f389c06e130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b00bf260 0x7f38b00b3d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b00bd240 0x7f38b00b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 --2- 172.21.15.118:0/2845208871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38b006bc20 0x7f38b00b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 >> 172.21.15.118:0/2845208871 conn(0x7f38b00c1850 msgr2=0x7f38b014a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 shutdown_connections 2024-02-18T10:01:02.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.659+0000 7f38b505b640 1 -- 172.21.15.118:0/2845208871 wait complete. 2024-02-18T10:01:02.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:02.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.770+0000 7f723f577640 1 Processor -- start 2024-02-18T10:01:02.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.770+0000 7f723f577640 1 -- start start 2024-02-18T10:01:02.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.770+0000 7f723f577640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7238145f80 0x7f723806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.770+0000 7f723f577640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f72380bab60 0x7f723814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.770+0000 7f723f577640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723814f240 con 0x7f72380baf80 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.770+0000 7f723f577640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723806f080 con 0x7f72380bab60 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.770+0000 7f723f577640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723806f260 con 0x7f7238145f80 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723cb12640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f72380bab60 0x7f723814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723cb12640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f72380bab60 0x7f723814f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43144/0 (socket says 172.21.15.118:43144) 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723cb12640 1 -- 172.21.15.118:0/1242419228 learned_addr learned my addr 172.21.15.118:0/1242419228 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723d313640 1 --2- 172.21.15.118:0/1242419228 >> v2:172.21.15.164:3300/0 conn(0x7f7238145f80 0x7f723806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723cb12640 1 -- 172.21.15.118:0/1242419228 >> v2:172.21.15.164:3300/0 conn(0x7f7238145f80 msgr2=0x7f723806eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723cb12640 1 --2- 172.21.15.118:0/1242419228 >> v2:172.21.15.164:3300/0 conn(0x7f7238145f80 0x7f723806eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723cb12640 1 -- 172.21.15.118:0/1242419228 >> v1:172.21.15.164:6789/0 conn(0x7f72380baf80 legacy=0x7f7238072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:02.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.771+0000 7f723cb12640 1 -- 172.21.15.118:0/1242419228 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723806f540 con 0x7f72380bab60 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723cb12640 1 --2- 172.21.15.118:0/1242419228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380bab60 0x7f723814f6d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7238070c40 tx=0x7f722802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e988c66080df19 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f722ffff640 1 -- 172.21.15.118:0/1242419228 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228031870 con 0x7f72380bab60 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f722ffff640 1 -- 172.21.15.118:0/1242419228 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280319d0 con 0x7f72380bab60 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f722ffff640 1 -- 172.21.15.118:0/1242419228 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228031d60 con 0x7f72380bab60 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 -- 172.21.15.118:0/1242419228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380bab60 msgr2=0x7f723814f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 --2- 172.21.15.118:0/1242419228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380bab60 0x7f723814f6d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7238070c40 tx=0x7f722802b910 comp rx=0 tx=0).stop 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 -- 172.21.15.118:0/1242419228 shutdown_connections 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 --2- 172.21.15.118:0/1242419228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380bab60 0x7f723814f6d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 --2- 172.21.15.118:0/1242419228 >> v2:172.21.15.164:3300/0 conn(0x7f7238145f80 0x7f723806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 -- 172.21.15.118:0/1242419228 >> 172.21.15.118:0/1242419228 conn(0x7f72380a11c0 msgr2=0x7f72380a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 -- 172.21.15.118:0/1242419228 shutdown_connections 2024-02-18T10:01:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.772+0000 7f723f577640 1 -- 172.21.15.118:0/1242419228 wait complete. 2024-02-18T10:01:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.773+0000 7f723f577640 1 Processor -- start 2024-02-18T10:01:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.773+0000 7f723f577640 1 -- start start 2024-02-18T10:01:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723f577640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72380bab60 0x7f723809f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723f577640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380baf80 0x7f72380a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723f577640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7238145f80 0x7f72380b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723f577640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381d5040 con 0x7f72380baf80 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723f577640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381d6410 con 0x7f7238145f80 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723f577640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72380a0e30 con 0x7f72380bab60 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380baf80 0x7f72380a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380baf80 0x7f72380a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43146/0 (socket says 172.21.15.118:43146) 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 -- 172.21.15.118:0/3212141495 learned_addr learned my addr 172.21.15.118:0/3212141495 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 -- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72380bab60 msgr2=0x7f723809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723db14640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7238145f80 0x7f72380b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723d313640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72380bab60 0x7f723809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72380bab60 0x7f723809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 -- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7238145f80 msgr2=0x7f72380b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7238145f80 0x7f72380b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723cb12640 1 -- 172.21.15.118:0/3212141495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280094d0 con 0x7f72380baf80 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723db14640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7238145f80 0x7f72380b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.774+0000 7f723d313640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72380bab60 0x7f723809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.775+0000 7f723cb12640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380baf80 0x7f72380a08f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f722802b950 tx=0x7f72280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.775+0000 7f722dffb640 1 -- 172.21.15.118:0/3212141495 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228031840 con 0x7f72380baf80 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.775+0000 7f722dffb640 1 -- 172.21.15.118:0/3212141495 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280443f0 con 0x7f72380baf80 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.775+0000 7f722dffb640 1 -- 172.21.15.118:0/3212141495 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280447a0 con 0x7f72380baf80 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.775+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72381d6680 con 0x7f72380baf80 2024-02-18T10:01:02.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.775+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72380a03f0 con 0x7f72380baf80 2024-02-18T10:01:02.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.776+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238074af0 con 0x7f72380baf80 2024-02-18T10:01:02.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.776+0000 7f722dffb640 1 -- 172.21.15.118:0/3212141495 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f7228044900 con 0x7f72380baf80 2024-02-18T10:01:02.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.777+0000 7f722dffb640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f721c06bc70 0x7f721c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:02.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.777+0000 7f722dffb640 1 -- 172.21.15.118:0/3212141495 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f722802d040 con 0x7f72380baf80 2024-02-18T10:01:02.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.777+0000 7f723d313640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f721c06bc70 0x7f721c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:02.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.777+0000 7f723d313640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f721c06bc70 0x7f721c06e130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f723400b820 tx=0x7f7234008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:02.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.781+0000 7f722dffb640 1 -- 172.21.15.118:0/3212141495 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72280777a0 con 0x7f72380baf80 2024-02-18T10:01:02.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.953+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f723806c450 con 0x7f72380baf80 2024-02-18T10:01:02.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.954+0000 7f722dffb640 1 -- 172.21.15.118:0/3212141495 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f722807ae60 con 0x7f72380baf80 2024-02-18T10:01:02.957 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:02.957 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f721c06bc70 msgr2=0x7f721c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f721c06bc70 0x7f721c06e130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f723400b820 tx=0x7f7234008040 comp rx=0 tx=0).stop 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380baf80 msgr2=0x7f72380a08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380baf80 0x7f72380a08f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f722802b950 tx=0x7f72280046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 shutdown_connections 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f721c06bc70 0x7f721c06e130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7238145f80 0x7f72380b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72380baf80 0x7f72380a08f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 --2- 172.21.15.118:0/3212141495 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72380bab60 0x7f723809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:02.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 >> 172.21.15.118:0/3212141495 conn(0x7f72380a11c0 msgr2=0x7f7238142b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:02.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 shutdown_connections 2024-02-18T10:01:02.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:02.956+0000 7f723f577640 1 -- 172.21.15.118:0/3212141495 wait complete. 2024-02-18T10:01:02.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:02.970 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:03.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.070+0000 7fbe9c92c640 1 Processor -- start 2024-02-18T10:01:03.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.070+0000 7fbe9c92c640 1 -- start start 2024-02-18T10:01:03.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe9c92c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe9814f450 0x7fbe9806c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe9c92c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe980bb6e0 0x7fbe98156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe9c92c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980ba650 con 0x7fbe98149560 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe9c92c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9814f890 con 0x7fbe9814f450 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe9c92c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980bfcc0 con 0x7fbe980bb6e0 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe95d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe9814f450 0x7fbe9806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe95d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe9814f450 0x7fbe9806c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43162/0 (socket says 172.21.15.118:43162) 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe95d9b640 1 -- 172.21.15.118:0/1677941162 learned_addr learned my addr 172.21.15.118:0/1677941162 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe96d9d640 1 --2- 172.21.15.118:0/1677941162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe980bb6e0 0x7fbe98156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe95d9b640 1 -- 172.21.15.118:0/1677941162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe980bb6e0 msgr2=0x7fbe98156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe95d9b640 1 --2- 172.21.15.118:0/1677941162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe980bb6e0 0x7fbe98156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe95d9b640 1 -- 172.21.15.118:0/1677941162 >> v1:172.21.15.118:6789/0 conn(0x7fbe98149560 legacy=0x7fbe980bf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe95d9b640 1 -- 172.21.15.118:0/1677941162 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98149940 con 0x7fbe9814f450 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.071+0000 7fbe96d9d640 1 --2- 172.21.15.118:0/1677941162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe980bb6e0 0x7fbe98156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.072+0000 7fbe95d9b640 1 --2- 172.21.15.118:0/1677941162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe9814f450 0x7fbe9806c040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009870 tx=0x7fbe8c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d500bafcf1e8ef1c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.072+0000 7fbe9559a640 1 -- 172.21.15.118:0/1677941162 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c031640 con 0x7fbe9814f450 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.072+0000 7fbe9559a640 1 -- 172.21.15.118:0/1677941162 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c0317a0 con 0x7fbe9814f450 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.072+0000 7fbe9559a640 1 -- 172.21.15.118:0/1677941162 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c031b30 con 0x7fbe9814f450 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.072+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677941162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe9814f450 msgr2=0x7fbe9806c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.072+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677941162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe9814f450 0x7fbe9806c040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009870 tx=0x7fbe8c02b8f0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.073+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677941162 shutdown_connections 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.073+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677941162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe980bb6e0 0x7fbe98156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.073+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677941162 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe9814f450 0x7fbe9806c040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.073+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677941162 >> 172.21.15.118:0/1677941162 conn(0x7fbe9806adc0 msgr2=0x7fbe9806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:03.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.073+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677941162 shutdown_connections 2024-02-18T10:01:03.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.073+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677941162 wait complete. 2024-02-18T10:01:03.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 Processor -- start 2024-02-18T10:01:03.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 -- start start 2024-02-18T10:01:03.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe980bb6e0 0x7fbe981e2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe98149560 0x7fbe980b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9814f450 0x7fbe981e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981e2230 con 0x7fbe980bb6e0 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980b7880 con 0x7fbe9814f450 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.074+0000 7fbe9c92c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980b2920 con 0x7fbe98149560 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe980bb6e0 0x7fbe981e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe980bb6e0 0x7fbe981e2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43164/0 (socket says 172.21.15.118:43164) 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 -- 172.21.15.118:0/1677754294 learned_addr learned my addr 172.21.15.118:0/1677754294 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe95d9b640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe98149560 0x7fbe980b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe96d9d640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9814f450 0x7fbe981e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 -- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe98149560 msgr2=0x7fbe980b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe98149560 0x7fbe980b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 -- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9814f450 msgr2=0x7fbe981e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9814f450 0x7fbe981e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 -- 172.21.15.118:0/1677754294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0094d0 con 0x7fbe980bb6e0 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe95d9b640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe98149560 0x7fbe980b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe96d9d640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9814f450 0x7fbe981e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9659c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe980bb6e0 0x7fbe981e2650 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c3c0 tx=0x7fbe8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe86ffd640 1 -- 172.21.15.118:0/1677754294 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880052d0 con 0x7fbe980bb6e0 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe86ffd640 1 -- 172.21.15.118:0/1677754294 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88005450 con 0x7fbe980bb6e0 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe981419b0 con 0x7fbe980bb6e0 2024-02-18T10:01:03.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe86ffd640 1 -- 172.21.15.118:0/1677754294 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88007260 con 0x7fbe980bb6e0 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.075+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe981e1e50 con 0x7fbe980bb6e0 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.076+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe98075150 con 0x7fbe980bb6e0 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.077+0000 7fbe86ffd640 1 -- 172.21.15.118:0/1677754294 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fbe880073c0 con 0x7fbe980bb6e0 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.077+0000 7fbe86ffd640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbe7806bca0 0x7fbe7806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.077+0000 7fbe86ffd640 1 -- 172.21.15.118:0/1677754294 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe88089b30 con 0x7fbe980bb6e0 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.077+0000 7fbe95d9b640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbe7806bca0 0x7fbe7806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.077+0000 7fbe95d9b640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbe7806bca0 0x7fbe7806e160 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c036000 tx=0x7fbe8c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.081+0000 7fbe86ffd640 1 -- 172.21.15.118:0/1677754294 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe88054310 con 0x7fbe980bb6e0 2024-02-18T10:01:03.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.251+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe980685f0 con 0x7fbe980bb6e0 2024-02-18T10:01:03.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.251+0000 7fbe86ffd640 1 -- 172.21.15.118:0/1677754294 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe880579d0 con 0x7fbe980bb6e0 2024-02-18T10:01:03.254 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbe7806bca0 msgr2=0x7fbe7806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbe7806bca0 0x7fbe7806e160 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c036000 tx=0x7fbe8c03c040 comp rx=0 tx=0).stop 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe980bb6e0 msgr2=0x7fbe981e2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe980bb6e0 0x7fbe981e2650 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c3c0 tx=0x7fbe8800c880 comp rx=0 tx=0).stop 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 shutdown_connections 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbe7806bca0 0x7fbe7806e160 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9814f450 0x7fbe981e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe98149560 0x7fbe980b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 --2- 172.21.15.118:0/1677754294 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe980bb6e0 0x7fbe981e2650 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 >> 172.21.15.118:0/1677754294 conn(0x7fbe9806adc0 msgr2=0x7fbe980bbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:03.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 shutdown_connections 2024-02-18T10:01:03.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.253+0000 7fbe9c92c640 1 -- 172.21.15.118:0/1677754294 wait complete. 2024-02-18T10:01:03.266 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:03.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.365+0000 7fbcfc249640 1 Processor -- start 2024-02-18T10:01:03.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.365+0000 7fbcfc249640 1 -- start start 2024-02-18T10:01:03.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcfc249640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 0x7fbcf406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcfc249640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbcf40a51e0 0x7fbcf414a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcfc249640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf4149ff0 con 0x7fbcf406fea0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcfc249640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf4070280 con 0x7fbcf40a51e0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcfc249640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40b4a60 con 0x7fbcf40b5fc0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcf9fe5640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbcf406fea0 0x7fbcf40b4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38742/0 (socket says 172.21.15.118:38742) 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcf9fe5640 1 -- 172.21.15.118:0/1532415963 learned_addr learned my addr 172.21.15.118:0/1532415963 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcf97e4640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 0x7fbcf406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795652787 0 0) 0x7fbcf4149ff0 con 0x7fbcf406fea0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcdc003520 con 0x7fbcf406fea0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.366+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/1532415963 >> v2:172.21.15.164:3300/0 conn(0x7fbcf40a51e0 0x7fbcf414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671763205 0 0) 0x7fbcdc003520 con 0x7fbcf406fea0 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 msgr2=0x7fbcf406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 0x7fbcf406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 >> v2:172.21.15.164:3300/0 conn(0x7fbcf40a51e0 msgr2=0x7fbcf414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 --2- 172.21.15.118:0/1532415963 >> v2:172.21.15.164:3300/0 conn(0x7fbcf40a51e0 0x7fbcf414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40b6510 con 0x7fbcf406fea0 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fbce40019f0 con 0x7fbcf406fea0 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf97e4640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 0x7fbcf406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 >> v1:172.21.15.118:6789/0 conn(0x7fbcf406fea0 legacy=0x7fbcf40b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc003970 0x7fbcdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 0x7fbcdc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc004d00 0x7fbcdc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40b4a60 con 0x7fbcdc004d00 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc00ba30 con 0x7fbcdc003970 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc00bbc0 con 0x7fbcf40b5fc0 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc004d00 0x7fbcdc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf97e4640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 0x7fbcdc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcf9fe5640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc003970 0x7fbcdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 msgr2=0x7fbcdc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcf40b5fc0 0x7fbcdc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc003970 msgr2=0x7fbcdc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc003970 0x7fbcdc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.367+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/1532415963 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc003520 con 0x7fbcdc004d00 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.368+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc004d00 0x7fbcdc005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00ba30 tx=0x7fbcdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b510399fa4300d85 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.368+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec032680 con 0x7fbcdc004d00 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.368+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0327e0 con 0x7fbcdc004d00 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.368+0000 7fbcf8fe3640 1 -- 172.21.15.118:0/1532415963 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec032b70 con 0x7fbcdc004d00 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.369+0000 7fbcfc249640 1 -- 172.21.15.118:0/1532415963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc004d00 msgr2=0x7fbcdc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.369+0000 7fbcfc249640 1 --2- 172.21.15.118:0/1532415963 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcdc004d00 0x7fbcdc005180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00ba30 tx=0x7fbcdc0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.369+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/1532415963 reap_dead start 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.369+0000 7fbcfc249640 1 -- 172.21.15.118:0/1532415963 shutdown_connections 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.369+0000 7fbcfc249640 1 -- 172.21.15.118:0/1532415963 >> 172.21.15.118:0/1532415963 conn(0x7fbcf40bbe30 msgr2=0x7fbcf40bc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.369+0000 7fbcfc249640 1 -- 172.21.15.118:0/1532415963 shutdown_connections 2024-02-18T10:01:03.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.369+0000 7fbcfc249640 1 -- 172.21.15.118:0/1532415963 wait complete. 2024-02-18T10:01:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 Processor -- start 2024-02-18T10:01:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 -- start start 2024-02-18T10:01:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcdc004d00 0x7fbcf40be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcf414d6e0 0x7fbcf41e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf41e5130 0x7fbcf413f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40beed0 con 0x7fbcf41e5130 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf414c1b0 con 0x7fbcf414d6e0 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfc249640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf41e55b0 con 0x7fbcdc004d00 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfa7e6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf41e5130 0x7fbcf413f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfa7e6640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf41e5130 0x7fbcf413f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43186/0 (socket says 172.21.15.118:43186) 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.370+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/4039314965 learned_addr learned my addr 172.21.15.118:0/4039314965 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcf97e4640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcf414d6e0 0x7fbcf41e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcf9fe5640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcdc004d00 0x7fbcf40be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcdc004d00 msgr2=0x7fbcf40be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcdc004d00 0x7fbcf40be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcf414d6e0 msgr2=0x7fbcf41e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcf414d6e0 0x7fbcf41e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfa7e6640 1 -- 172.21.15.118:0/4039314965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf406dc80 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcf97e4640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcf414d6e0 0x7fbcf41e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcf9fe5640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcdc004d00 0x7fbcf40be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfa7e6640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf41e5130 0x7fbcf413f4e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00bb50 tx=0x7fbcec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcf27fc640 1 -- 172.21.15.118:0/4039314965 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec03b8f0 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcf27fc640 1 -- 172.21.15.118:0/4039314965 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec03ba50 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf414c400 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcf27fc640 1 -- 172.21.15.118:0/4039314965 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec03bde0 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.371+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf414c9c0 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.372+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf41e4910 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.372+0000 7fbcf27fc640 1 -- 172.21.15.118:0/4039314965 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fbcec030450 con 0x7fbcf41e5130 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.373+0000 7fbcf27fc640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbce006bca0 0x7fbce006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.373+0000 7fbcf9fe5640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbce006bca0 0x7fbce006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.373+0000 7fbcf27fc640 1 -- 172.21.15.118:0/4039314965 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcec0ad200 con 0x7fbcf41e5130 2024-02-18T10:01:03.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.373+0000 7fbcf9fe5640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbce006bca0 0x7fbce006e160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbce4004d00 tx=0x7fbce4006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.377+0000 7fbcf27fc640 1 -- 172.21.15.118:0/4039314965 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbcf41e4910 con 0x7fbcf41e5130 2024-02-18T10:01:03.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.548+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbcf41e4910 con 0x7fbcf41e5130 2024-02-18T10:01:03.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.548+0000 7fbcf27fc640 1 -- 172.21.15.118:0/4039314965 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbcf41e4910 con 0x7fbcf41e5130 2024-02-18T10:01:03.551 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbce006bca0 msgr2=0x7fbce006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbce006bca0 0x7fbce006e160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbce4004d00 tx=0x7fbce4006040 comp rx=0 tx=0).stop 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf41e5130 msgr2=0x7fbcf413f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf41e5130 0x7fbcf413f4e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00bb50 tx=0x7fbcec004730 comp rx=0 tx=0).stop 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 shutdown_connections 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbce006bca0 0x7fbce006e160 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf41e5130 0x7fbcf413f4e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcf414d6e0 0x7fbcf41e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 --2- 172.21.15.118:0/4039314965 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbcdc004d00 0x7fbcf40be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 >> 172.21.15.118:0/4039314965 conn(0x7fbcf40bbe30 msgr2=0x7fbcf4142230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:03.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 shutdown_connections 2024-02-18T10:01:03.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.550+0000 7fbcfc249640 1 -- 172.21.15.118:0/4039314965 wait complete. 2024-02-18T10:01:03.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:03.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.663+0000 7fcec5081640 1 Processor -- start 2024-02-18T10:01:03.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.663+0000 7fcec5081640 1 -- start start 2024-02-18T10:01:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcec5081640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcec0149440 0x7fcec006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcec5081640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec00ba500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcec5081640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec006c450 con 0x7fcec00bf550 2024-02-18T10:01:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcec5081640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec00bbb90 con 0x7fcec0149440 2024-02-18T10:01:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcec5081640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec0149820 con 0x7fcec00bb600 2024-02-18T10:01:03.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebed9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcec0149440 0x7fcec006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebed9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcec0149440 0x7fcec006d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43190/0 (socket says 172.21.15.118:43190) 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebed9d640 1 -- 172.21.15.118:0/1232183626 learned_addr learned my addr 172.21.15.118:0/1232183626 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebe59c640 1 --2- 172.21.15.118:0/1232183626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec00ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebed9d640 1 -- 172.21.15.118:0/1232183626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 msgr2=0x7fcec00ba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebed9d640 1 --2- 172.21.15.118:0/1232183626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec00ba500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebed9d640 1 -- 172.21.15.118:0/1232183626 >> v1:172.21.15.164:6789/0 conn(0x7fcec00bf550 legacy=0x7fcec006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.664+0000 7fcebed9d640 1 -- 172.21.15.118:0/1232183626 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec006be90 con 0x7fcec0149440 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcebed9d640 1 --2- 172.21.15.118:0/1232183626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec006d8f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009870 tx=0x7fceb002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c71cec995b793a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcebdd9b640 1 -- 172.21.15.118:0/1232183626 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0031640 con 0x7fcec0149440 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcebdd9b640 1 -- 172.21.15.118:0/1232183626 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb00317a0 con 0x7fcec0149440 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcebdd9b640 1 -- 172.21.15.118:0/1232183626 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0031b30 con 0x7fcec0149440 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 -- 172.21.15.118:0/1232183626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 msgr2=0x7fcec006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 --2- 172.21.15.118:0/1232183626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec006d8f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009870 tx=0x7fceb002b8f0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 -- 172.21.15.118:0/1232183626 shutdown_connections 2024-02-18T10:01:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 --2- 172.21.15.118:0/1232183626 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec00ba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 --2- 172.21.15.118:0/1232183626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec006d8f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 -- 172.21.15.118:0/1232183626 >> 172.21.15.118:0/1232183626 conn(0x7fcec006adc0 msgr2=0x7fcec006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 -- 172.21.15.118:0/1232183626 shutdown_connections 2024-02-18T10:01:03.670 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.665+0000 7fcec5081640 1 -- 172.21.15.118:0/1232183626 wait complete. 2024-02-18T10:01:03.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 Processor -- start 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 -- start start 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec0145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec00bf550 0x7fcec00a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec014ba00 con 0x7fcec0149440 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00a4c30 con 0x7fcec00bf550 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcec5081640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec00a4f10 con 0x7fcec00bb600 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcebf59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcebf59e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec00a3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43202/0 (socket says 172.21.15.118:43202) 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.667+0000 7fcebf59e640 1 -- 172.21.15.118:0/892313345 learned_addr learned my addr 172.21.15.118:0/892313345 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebed9d640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec0145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebe59c640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec00bf550 0x7fcec00a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebf59e640 1 -- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 msgr2=0x7fcec0145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebf59e640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec0145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebf59e640 1 -- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec00bf550 msgr2=0x7fcec00a4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebf59e640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec00bf550 0x7fcec00a4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebf59e640 1 -- 172.21.15.118:0/892313345 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00094d0 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcebf59e640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec00a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c780 tx=0x7fceb800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcea77fe640 1 -- 172.21.15.118:0/892313345 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8003d80 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcea77fe640 1 -- 172.21.15.118:0/892313345 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb800ce90 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcea77fe640 1 -- 172.21.15.118:0/892313345 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80052b0 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec00b5890 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.668+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec014b690 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.669+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec0075150 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.670+0000 7fcea77fe640 1 -- 172.21.15.118:0/892313345 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fceb8005410 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.670+0000 7fcea77fe640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fceac06bc70 0x7fceac06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.670+0000 7fcea77fe640 1 -- 172.21.15.118:0/892313345 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceb8089fb0 con 0x7fcec0149440 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.670+0000 7fcebed9d640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fceac06bc70 0x7fceac06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.670+0000 7fcebed9d640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fceac06bc70 0x7fceac06e130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fceb0036000 tx=0x7fceb003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.674+0000 7fcea77fe640 1 -- 172.21.15.118:0/892313345 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fceb80bd8c0 con 0x7fcec0149440 2024-02-18T10:01:03.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.848+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcec0074af0 con 0x7fcec0149440 2024-02-18T10:01:03.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.848+0000 7fcea77fe640 1 -- 172.21.15.118:0/892313345 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fceb8017070 con 0x7fcec0149440 2024-02-18T10:01:03.851 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:03.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fceac06bc70 msgr2=0x7fceac06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fceac06bc70 0x7fceac06e130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fceb0036000 tx=0x7fceb003c040 comp rx=0 tx=0).stop 2024-02-18T10:01:03.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 msgr2=0x7fcec00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec00a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c780 tx=0x7fceb800cc40 comp rx=0 tx=0).stop 2024-02-18T10:01:03.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 shutdown_connections 2024-02-18T10:01:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fceac06bc70 0x7fceac06e130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcec0149440 0x7fcec00a3550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec00bf550 0x7fcec00a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 --2- 172.21.15.118:0/892313345 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcec00bb600 0x7fcec0145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 >> 172.21.15.118:0/892313345 conn(0x7fcec006adc0 msgr2=0x7fcec00bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 shutdown_connections 2024-02-18T10:01:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.850+0000 7fcec5081640 1 -- 172.21.15.118:0/892313345 wait complete. 2024-02-18T10:01:03.864 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:03.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.962+0000 7f2695c88640 1 Processor -- start 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.962+0000 7f2695c88640 1 -- start start 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.962+0000 7f2695c88640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f269006bc20 0x7f269014c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.962+0000 7f2695c88640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26900bf260 0x7f26901565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.962+0000 7f2695c88640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26900bf6b0 con 0x7f26900bd240 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.962+0000 7f2695c88640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26900bdbb0 con 0x7f269006bc20 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.962+0000 7f2695c88640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269014be60 con 0x7f26900bf260 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268f7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f269006bc20 0x7f269014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268effd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f26900bd240 0x7f26900bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38758/0 (socket says 172.21.15.118:38758) 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268effd640 1 -- 172.21.15.118:0/555660079 learned_addr learned my addr 172.21.15.118:0/555660079 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268f7fe640 1 -- 172.21.15.118:0/555660079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26900bf260 msgr2=0x7f26901565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268f7fe640 1 --2- 172.21.15.118:0/555660079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26900bf260 0x7f26901565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268f7fe640 1 -- 172.21.15.118:0/555660079 >> v1:172.21.15.118:6789/0 conn(0x7f26900bd240 legacy=0x7f26900bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268e7fc640 1 -- 172.21.15.118:0/555660079 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703291026 0 0) 0x7f2684001110 con 0x7f26900bd240 2024-02-18T10:01:03.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268f7fe640 1 -- 172.21.15.118:0/555660079 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269014c140 con 0x7f269006bc20 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.963+0000 7f268f7fe640 1 --2- 172.21.15.118:0/555660079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f269006bc20 0x7f269014c940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f26800097a0 tx=0x7f268002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e2eaca45be3aa9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f268e7fc640 1 -- 172.21.15.118:0/555660079 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268002e070 con 0x7f269006bc20 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f268e7fc640 1 -- 172.21.15.118:0/555660079 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26800315a0 con 0x7f269006bc20 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f268e7fc640 1 -- 172.21.15.118:0/555660079 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2680031930 con 0x7f269006bc20 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 -- 172.21.15.118:0/555660079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f269006bc20 msgr2=0x7f269014c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 --2- 172.21.15.118:0/555660079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f269006bc20 0x7f269014c940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f26800097a0 tx=0x7f268002b840 comp rx=0 tx=0).stop 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 -- 172.21.15.118:0/555660079 shutdown_connections 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 --2- 172.21.15.118:0/555660079 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26900bf260 0x7f26901565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 --2- 172.21.15.118:0/555660079 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f269006bc20 0x7f269014c940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 -- 172.21.15.118:0/555660079 >> 172.21.15.118:0/555660079 conn(0x7f26900c1850 msgr2=0x7f26900c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:03.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 -- 172.21.15.118:0/555660079 shutdown_connections 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.964+0000 7f2695c88640 1 -- 172.21.15.118:0/555660079 wait complete. 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.965+0000 7f2695c88640 1 Processor -- start 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.965+0000 7f2695c88640 1 -- start start 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f2695c88640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269006bc20 0x7f26900a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f2695c88640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26900bd240 0x7f26900b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f2695c88640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26900bf260 0x7f26900bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f2695c88640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26900a5eb0 con 0x7f26900bf260 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f2695c88640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26900b93e0 con 0x7f26900bd240 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f2695c88640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26900ba040 con 0x7f269006bc20 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26900bf260 0x7f26900bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26900bf260 0x7f26900bb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43214/0 (socket says 172.21.15.118:43214) 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 -- 172.21.15.118:0/3724757477 learned_addr learned my addr 172.21.15.118:0/3724757477 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:03.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268f7fe640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269006bc20 0x7f26900a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268effd640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26900bd240 0x7f26900b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 -- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269006bc20 msgr2=0x7f26900a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269006bc20 0x7f26900a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 -- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26900bd240 msgr2=0x7f26900b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26900bd240 0x7f26900b8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 -- 172.21.15.118:0/3724757477 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680009400 con 0x7f26900bf260 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.966+0000 7f268ffff640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26900bf260 0x7f26900bb0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f268800b970 tx=0x7f268800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.967+0000 7f2677fff640 1 -- 172.21.15.118:0/3724757477 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800cb40 con 0x7f26900bf260 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.967+0000 7f2677fff640 1 -- 172.21.15.118:0/3724757477 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268800ccc0 con 0x7f26900bf260 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.967+0000 7f2677fff640 1 -- 172.21.15.118:0/3724757477 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688014680 con 0x7f26900bf260 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.967+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26900ba2e0 con 0x7f26900bf260 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.967+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26900bab80 con 0x7f26900bf260 2024-02-18T10:01:03.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.968+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26900bada0 con 0x7f26900bf260 2024-02-18T10:01:03.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.968+0000 7f2677fff640 1 -- 172.21.15.118:0/3724757477 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f268801d3b0 con 0x7f26900bf260 2024-02-18T10:01:03.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.968+0000 7f2677fff640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f267c06bc70 0x7f267c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:03.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.969+0000 7f268f7fe640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f267c06bc70 0x7f267c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:03.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.969+0000 7f2677fff640 1 -- 172.21.15.118:0/3724757477 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f268808a6c0 con 0x7f26900bf260 2024-02-18T10:01:03.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.969+0000 7f268f7fe640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f267c06bc70 0x7f267c06e130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2680036000 tx=0x7f268003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:03.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:03.973+0000 7f2677fff640 1 -- 172.21.15.118:0/3724757477 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2688054ea0 con 0x7f26900bf260 2024-02-18T10:01:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.179+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26900bcc10 con 0x7f26900bf260 2024-02-18T10:01:04.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.180+0000 7f2677fff640 1 -- 172.21.15.118:0/3724757477 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7f2688058560 con 0x7f26900bf260 2024-02-18T10:01:04.183 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:04.183 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:01:04.183 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:01:04.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f267c06bc70 msgr2=0x7f267c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f267c06bc70 0x7f267c06e130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2680036000 tx=0x7f268003d040 comp rx=0 tx=0).stop 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26900bf260 msgr2=0x7f26900bb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26900bf260 0x7f26900bb0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f268800b970 tx=0x7f268800be30 comp rx=0 tx=0).stop 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 shutdown_connections 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f267c06bc70 0x7f267c06e130 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26900bf260 0x7f26900bb0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26900bd240 0x7f26900b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 --2- 172.21.15.118:0/3724757477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f269006bc20 0x7f26900a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 >> 172.21.15.118:0/3724757477 conn(0x7f26900c1850 msgr2=0x7f2690149b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 shutdown_connections 2024-02-18T10:01:04.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.182+0000 7f2695c88640 1 -- 172.21.15.118:0/3724757477 wait complete. 2024-02-18T10:01:04.195 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.292+0000 7fd4dc015640 1 Processor -- start 2024-02-18T10:01:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4dc015640 1 -- start start 2024-02-18T10:01:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4dc015640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd4d406eb40 0x7fd4d414f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4dc015640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 0x7fd4d4156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4dc015640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d414f240 con 0x7fd4d4145f80 2024-02-18T10:01:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4dc015640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d4150060 con 0x7fd4d406eb40 2024-02-18T10:01:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4dc015640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d406f260 con 0x7fd4d414fc10 2024-02-18T10:01:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4d9db1640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd4d4145f80 0x7fd4d40bab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38772/0 (socket says 172.21.15.118:38772) 2024-02-18T10:01:04.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.293+0000 7fd4d9db1640 1 -- 172.21.15.118:0/1986957751 learned_addr learned my addr 172.21.15.118:0/1986957751 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508365043 0 0) 0x7fd4d414f240 con 0x7fd4d4145f80 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c0003520 con 0x7fd4d4145f80 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d95b0640 1 --2- 172.21.15.118:0/1986957751 >> v2:172.21.15.164:3300/0 conn(0x7fd4d406eb40 0x7fd4d414f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4da5b2640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 0x7fd4d4156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2768793949 0 0) 0x7fd4c0003520 con 0x7fd4d4145f80 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 msgr2=0x7fd4d4156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 0x7fd4d4156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 >> v2:172.21.15.164:3300/0 conn(0x7fd4d406eb40 msgr2=0x7fd4d414f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 --2- 172.21.15.118:0/1986957751 >> v2:172.21.15.164:3300/0 conn(0x7fd4d406eb40 0x7fd4d414f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d406f540 con 0x7fd4d4145f80 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fd4c4001670 con 0x7fd4d4145f80 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 >> v1:172.21.15.118:6789/0 conn(0x7fd4d4145f80 legacy=0x7fd4d40bab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c0003970 0x7fd4c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 0x7fd4c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c0004d00 0x7fd4c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4150060 con 0x7fd4c0003970 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d406f260 con 0x7fd4c0004d00 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000b980 con 0x7fd4d414fc10 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d9db1640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c0003970 0x7fd4c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d95b0640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 0x7fd4c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4da5b2640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c0004d00 0x7fd4c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d9db1640 1 -- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 msgr2=0x7fd4c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d9db1640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4d414fc10 0x7fd4c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d9db1640 1 -- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c0004d00 msgr2=0x7fd4c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d9db1640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c0004d00 0x7fd4c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4d9db1640 1 -- 172.21.15.118:0/1986957751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0003520 con 0x7fd4c0003970 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.294+0000 7fd4da5b2640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4c0004d00 0x7fd4c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.295+0000 7fd4d9db1640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c0003970 0x7fd4c0003d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400c290 tx=0x7fd4c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fadb2f98acf204 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.295+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4005ad0 con 0x7fd4c0003970 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.295+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c4005c30 con 0x7fd4c0003970 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.295+0000 7fd4d8daf640 1 -- 172.21.15.118:0/1986957751 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c402c8d0 con 0x7fd4c0003970 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.296+0000 7fd4dc015640 1 -- 172.21.15.118:0/1986957751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c0003970 msgr2=0x7fd4c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.296+0000 7fd4dc015640 1 --2- 172.21.15.118:0/1986957751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4c0003970 0x7fd4c0003d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400c290 tx=0x7fd4c00057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.296+0000 7fd4da5b2640 1 -- 172.21.15.118:0/1986957751 reap_dead start 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.296+0000 7fd4dc015640 1 -- 172.21.15.118:0/1986957751 shutdown_connections 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.296+0000 7fd4dc015640 1 -- 172.21.15.118:0/1986957751 >> 172.21.15.118:0/1986957751 conn(0x7fd4d40a11c0 msgr2=0x7fd4d40a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.296+0000 7fd4dc015640 1 -- 172.21.15.118:0/1986957751 shutdown_connections 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.296+0000 7fd4dc015640 1 -- 172.21.15.118:0/1986957751 wait complete. 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 Processor -- start 2024-02-18T10:01:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 -- start start 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0003970 0x7fd4d409fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4d4147ad0 0x7fd4d414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4d414be40 0x7fd4d41414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41496c0 con 0x7fd4d4147ad0 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d409ff70 con 0x7fd4d414be40 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.297+0000 7fd4dc015640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4149190 con 0x7fd4c0003970 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4d4147ad0 0x7fd4d414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4d4147ad0 0x7fd4d414b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43240/0 (socket says 172.21.15.118:43240) 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 -- 172.21.15.118:0/3842776699 learned_addr learned my addr 172.21.15.118:0/3842776699 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d9db1640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0003970 0x7fd4d409fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4da5b2640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4d414be40 0x7fd4d41414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 -- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0003970 msgr2=0x7fd4d409fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0003970 0x7fd4d409fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 -- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4d414be40 msgr2=0x7fd4d41414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4d414be40 0x7fd4d41414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 -- 172.21.15.118:0/3842776699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d414c2c0 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4d95b0640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4d4147ad0 0x7fd4d414b900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0011ad0 tx=0x7fd4d0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4ca7fc640 1 -- 172.21.15.118:0/3842776699 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0009680 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4ca7fc640 1 -- 172.21.15.118:0/3842776699 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d000fb50 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4ca7fc640 1 -- 172.21.15.118:0/3842776699 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d000fee0 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d41493e0 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.298+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d4149fc0 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.299+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d4149b40 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.299+0000 7fd4ca7fc640 1 -- 172.21.15.118:0/3842776699 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fd4d0014440 con 0x7fd4d4147ad0 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.300+0000 7fd4ca7fc640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd4b806bc70 0x7fd4b806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.300+0000 7fd4ca7fc640 1 -- 172.21.15.118:0/3842776699 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4d008af20 con 0x7fd4d4147ad0 2024-02-18T10:01:04.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.300+0000 7fd4d9db1640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd4b806bc70 0x7fd4b806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.300+0000 7fd4d9db1640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd4b806bc70 0x7fd4b806e130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4034000 tx=0x7fd4c4007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:04.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.304+0000 7fd4ca7fc640 1 -- 172.21.15.118:0/3842776699 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd4d4149b40 con 0x7fd4d4147ad0 2024-02-18T10:01:04.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.476+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4d4149b40 con 0x7fd4d4147ad0 2024-02-18T10:01:04.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.477+0000 7fd4ca7fc640 1 -- 172.21.15.118:0/3842776699 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fd4d4149b40 con 0x7fd4d4147ad0 2024-02-18T10:01:04.479 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:04.480 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:04.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd4b806bc70 msgr2=0x7fd4b806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd4b806bc70 0x7fd4b806e130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4034000 tx=0x7fd4c4007000 comp rx=0 tx=0).stop 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4d4147ad0 msgr2=0x7fd4d414b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4d4147ad0 0x7fd4d414b900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0011ad0 tx=0x7fd4d0011f90 comp rx=0 tx=0).stop 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 shutdown_connections 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd4b806bc70 0x7fd4b806e130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4d414be40 0x7fd4d41414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4d4147ad0 0x7fd4d414b900 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 --2- 172.21.15.118:0/3842776699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd4c0003970 0x7fd4d409fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 >> 172.21.15.118:0/3842776699 conn(0x7fd4d40a11c0 msgr2=0x7fd4d4143610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 shutdown_connections 2024-02-18T10:01:04.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.479+0000 7fd4dc015640 1 -- 172.21.15.118:0/3842776699 wait complete. 2024-02-18T10:01:04.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:04.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.589+0000 7fde18264640 1 Processor -- start 2024-02-18T10:01:04.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde18264640 1 -- start start 2024-02-18T10:01:04.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde18264640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fde100a6e60 0x7fde1006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde18264640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde1014bf20 0x7fde1014c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde18264640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde1014f3b0 0x7fde1014f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde18264640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde100b4aa0 con 0x7fde1014f3b0 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde18264640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde100b4cf0 con 0x7fde100a6e60 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde18264640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1014c8a0 con 0x7fde1014bf20 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde16000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fde100a6e60 0x7fde1006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde157ff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde1014bf20 0x7fde1014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde16801640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde1014f3b0 0x7fde1014f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde16000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fde100a6e60 0x7fde1006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:58570/0 (socket says 172.21.15.118:58570) 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.590+0000 7fde16000640 1 -- 172.21.15.118:0/344229624 learned_addr learned my addr 172.21.15.118:0/344229624 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.591+0000 7fde16000640 1 -- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde1014bf20 msgr2=0x7fde1014c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.591+0000 7fde16000640 1 --2- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde1014bf20 0x7fde1014c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.591+0000 7fde16000640 1 -- 172.21.15.118:0/344229624 >> v2:172.21.15.118:3300/0 conn(0x7fde1014f3b0 msgr2=0x7fde1014f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.591+0000 7fde16000640 1 --2- 172.21.15.118:0/344229624 >> v2:172.21.15.118:3300/0 conn(0x7fde1014f3b0 0x7fde1014f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.591+0000 7fde16000640 1 -- 172.21.15.118:0/344229624 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100a7350 con 0x7fde100a6e60 2024-02-18T10:01:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.591+0000 7fde16801640 1 --2- 172.21.15.118:0/344229624 >> v2:172.21.15.118:3300/0 conn(0x7fde1014f3b0 0x7fde1014f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:01:04.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.591+0000 7fde157ff640 1 --2- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde1014bf20 0x7fde1014c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:01:04.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.592+0000 7fde16000640 1 --2- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde100a6e60 0x7fde1006b5c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde10073170 tx=0x7fde0c02bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=306df65b44dabded server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:04.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.592+0000 7fde14ffe640 1 -- 172.21.15.118:0/344229624 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c02c950 con 0x7fde100a6e60 2024-02-18T10:01:04.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.592+0000 7fde14ffe640 1 -- 172.21.15.118:0/344229624 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0c02cab0 con 0x7fde100a6e60 2024-02-18T10:01:04.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.592+0000 7fde14ffe640 1 -- 172.21.15.118:0/344229624 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c02ce40 con 0x7fde100a6e60 2024-02-18T10:01:04.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.592+0000 7fde18264640 1 -- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde100a6e60 msgr2=0x7fde1006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.592+0000 7fde18264640 1 --2- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde100a6e60 0x7fde1006b5c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde10073170 tx=0x7fde0c02bdb0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.593+0000 7fde18264640 1 -- 172.21.15.118:0/344229624 shutdown_connections 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.593+0000 7fde18264640 1 --2- 172.21.15.118:0/344229624 >> v2:172.21.15.118:3300/0 conn(0x7fde1014f3b0 0x7fde1014f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.593+0000 7fde18264640 1 --2- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde1014bf20 0x7fde1014c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.593+0000 7fde18264640 1 --2- 172.21.15.118:0/344229624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde100a6e60 0x7fde1006b5c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.593+0000 7fde18264640 1 -- 172.21.15.118:0/344229624 >> 172.21.15.118:0/344229624 conn(0x7fde100c15b0 msgr2=0x7fde100c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.593+0000 7fde18264640 1 -- 172.21.15.118:0/344229624 shutdown_connections 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.593+0000 7fde18264640 1 -- 172.21.15.118:0/344229624 wait complete. 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 Processor -- start 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 -- start start 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde100a6e60 0x7fde10149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde1014bf20 0x7fde101d7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1014f3b0 0x7fde101471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde10149f80 con 0x7fde1014f3b0 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde100b3610 con 0x7fde1014bf20 2024-02-18T10:01:04.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde18264640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde100b3e70 con 0x7fde100a6e60 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde16801640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1014f3b0 0x7fde101471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde16801640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1014f3b0 0x7fde101471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43258/0 (socket says 172.21.15.118:43258) 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.594+0000 7fde16801640 1 -- 172.21.15.118:0/2423920542 learned_addr learned my addr 172.21.15.118:0/2423920542 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde16000640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde100a6e60 0x7fde10149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde157ff640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde1014bf20 0x7fde101d7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde16801640 1 -- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde100a6e60 msgr2=0x7fde10149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde16801640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde100a6e60 0x7fde10149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde16801640 1 -- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde1014bf20 msgr2=0x7fde101d7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde16801640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde1014bf20 0x7fde101d7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde16801640 1 -- 172.21.15.118:0/2423920542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00009400 con 0x7fde1014f3b0 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde157ff640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde1014bf20 0x7fde101d7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde16801640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1014f3b0 0x7fde101471f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde0800e900 tx=0x7fde0800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:04.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde067fc640 1 -- 172.21.15.118:0/2423920542 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08009700 con 0x7fde1014f3b0 2024-02-18T10:01:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde067fc640 1 -- 172.21.15.118:0/2423920542 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0800ca00 con 0x7fde1014f3b0 2024-02-18T10:01:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde067fc640 1 -- 172.21.15.118:0/2423920542 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0800cdb0 con 0x7fde1014f3b0 2024-02-18T10:01:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde08009400 con 0x7fde1014f3b0 2024-02-18T10:01:04.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.595+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c009b30 con 0x7fde1014f3b0 2024-02-18T10:01:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.596+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde100a0f30 con 0x7fde1014f3b0 2024-02-18T10:01:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.597+0000 7fde067fc640 1 -- 172.21.15.118:0/2423920542 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fde08013470 con 0x7fde1014f3b0 2024-02-18T10:01:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.597+0000 7fde067fc640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fddf406bc70 0x7fddf406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.597+0000 7fde067fc640 1 -- 172.21.15.118:0/2423920542 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde0808a950 con 0x7fde1014f3b0 2024-02-18T10:01:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.597+0000 7fde16000640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fddf406bc70 0x7fddf406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:04.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.597+0000 7fde16000640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fddf406bc70 0x7fddf406e130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde0c035000 tx=0x7fde0c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:04.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.601+0000 7fde067fc640 1 -- 172.21.15.118:0/2423920542 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde080551e0 con 0x7fde1014f3b0 2024-02-18T10:01:04.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.813+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde100b3fb0 con 0x7fde1014f3b0 2024-02-18T10:01:04.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.813+0000 7fde067fc640 1 -- 172.21.15.118:0/2423920542 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7fde080588a0 con 0x7fde1014f3b0 2024-02-18T10:01:04.816 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:04.816 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:01:04.816 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:01:04.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fddf406bc70 msgr2=0x7fddf406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fddf406bc70 0x7fddf406e130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde0c035000 tx=0x7fde0c030000 comp rx=0 tx=0).stop 2024-02-18T10:01:04.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1014f3b0 msgr2=0x7fde101471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:04.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1014f3b0 0x7fde101471f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde0800e900 tx=0x7fde0800edc0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 shutdown_connections 2024-02-18T10:01:04.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fddf406bc70 0x7fddf406e130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde1014f3b0 0x7fde101471f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde1014bf20 0x7fde101d7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 --2- 172.21.15.118:0/2423920542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde100a6e60 0x7fde10149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:04.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 >> 172.21.15.118:0/2423920542 conn(0x7fde100c15b0 msgr2=0x7fde1014a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:04.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 shutdown_connections 2024-02-18T10:01:04.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:04.815+0000 7fde18264640 1 -- 172.21.15.118:0/2423920542 wait complete. 2024-02-18T10:01:05.131 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-18T10:00:48.080556+0000', 'modified': '2024-02-18T10:00:50.087917+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6833/2459180675', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6832', 'nonce': 2459180675}, {'type': 'v1', 'addr': '172.21.15.164:6833', 'nonce': 2459180675}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-18T10:01:05.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-18T10:01:05.132 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-18T10:01:05.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.231+0000 7f8454ec9640 1 Processor -- start 2024-02-18T10:01:05.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.231+0000 7f8454ec9640 1 -- start start 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f8454ec9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f845014fa00 0x7f84501544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f8454ec9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f845006c0d0 0x7f8450156a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f8454ec9640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845006d600 con 0x7f845006bcf0 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f8454ec9640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8450070080 con 0x7f845006c0d0 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f8454ec9640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845006ec70 con 0x7f845014fa00 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844ed9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f845006c0d0 0x7f8450156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844ed9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f845006c0d0 0x7f8450156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43272/0 (socket says 172.21.15.118:43272) 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844ed9d640 1 -- 172.21.15.118:0/2714551890 learned_addr learned my addr 172.21.15.118:0/2714551890 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844dd9b640 1 --2- 172.21.15.118:0/2714551890 >> v2:172.21.15.164:3300/0 conn(0x7f845014fa00 0x7f84501544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844ed9d640 1 -- 172.21.15.118:0/2714551890 >> v2:172.21.15.164:3300/0 conn(0x7f845014fa00 msgr2=0x7f84501544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844ed9d640 1 --2- 172.21.15.118:0/2714551890 >> v2:172.21.15.164:3300/0 conn(0x7f845014fa00 0x7f84501544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844ed9d640 1 -- 172.21.15.118:0/2714551890 >> v1:172.21.15.118:6789/0 conn(0x7f845006bcf0 legacy=0x7f845014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.236 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.232+0000 7f844ed9d640 1 -- 172.21.15.118:0/2714551890 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845006ef50 con 0x7f845006c0d0 2024-02-18T10:01:05.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.233+0000 7f844ed9d640 1 --2- 172.21.15.118:0/2714551890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845006c0d0 0x7f8450156a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8450073230 tx=0x7f844802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2984d7557a97ad1a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.233+0000 7f844d59a640 1 -- 172.21.15.118:0/2714551890 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844802cb20 con 0x7f845006c0d0 2024-02-18T10:01:05.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.233+0000 7f844d59a640 1 -- 172.21.15.118:0/2714551890 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844802cc80 con 0x7f845006c0d0 2024-02-18T10:01:05.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.233+0000 7f844d59a640 1 -- 172.21.15.118:0/2714551890 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84480343f0 con 0x7f845006c0d0 2024-02-18T10:01:05.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 -- 172.21.15.118:0/2714551890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845006c0d0 msgr2=0x7f8450156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 --2- 172.21.15.118:0/2714551890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845006c0d0 0x7f8450156a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8450073230 tx=0x7f844802bf80 comp rx=0 tx=0).stop 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 -- 172.21.15.118:0/2714551890 shutdown_connections 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 --2- 172.21.15.118:0/2714551890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845006c0d0 0x7f8450156a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 --2- 172.21.15.118:0/2714551890 >> v2:172.21.15.164:3300/0 conn(0x7f845014fa00 0x7f84501544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 -- 172.21.15.118:0/2714551890 >> 172.21.15.118:0/2714551890 conn(0x7f84500bbea0 msgr2=0x7f84500bc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 -- 172.21.15.118:0/2714551890 shutdown_connections 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.234+0000 7f8454ec9640 1 -- 172.21.15.118:0/2714551890 wait complete. 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 Processor -- start 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 -- start start 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f845006bcf0 0x7f845014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f845006c0d0 0x7f84501e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845014fa00 0x7f84501e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845014efa0 con 0x7f845014fa00 2024-02-18T10:01:05.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84501e14b0 con 0x7f845006c0d0 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.235+0000 7f8454ec9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845014d730 con 0x7f845006bcf0 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845014fa00 0x7f84501e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845014fa00 0x7f84501e1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43276/0 (socket says 172.21.15.118:43276) 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 -- 172.21.15.118:0/3084141092 learned_addr learned my addr 172.21.15.118:0/3084141092 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844dd9b640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f845006c0d0 0x7f84501e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844e59c640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f845006bcf0 0x7f845014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 -- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f845006bcf0 msgr2=0x7f845014ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f845006bcf0 0x7f845014ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 -- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f845006c0d0 msgr2=0x7f84501e1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f845006c0d0 0x7f84501e1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 -- 172.21.15.118:0/3084141092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448009b30 con 0x7f845014fa00 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844dd9b640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f845006c0d0 0x7f84501e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f844ed9d640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845014fa00 0x7f84501e1e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8448036040 tx=0x7f8448004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f843effd640 1 -- 172.21.15.118:0/3084141092 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448009510 con 0x7f845014fa00 2024-02-18T10:01:05.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f843effd640 1 -- 172.21.15.118:0/3084141092 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448007e50 con 0x7f845014fa00 2024-02-18T10:01:05.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84501463b0 con 0x7f845014fa00 2024-02-18T10:01:05.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f843effd640 1 -- 172.21.15.118:0/3084141092 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844803e670 con 0x7f845014fa00 2024-02-18T10:01:05.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.236+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845014dcf0 con 0x7f845014fa00 2024-02-18T10:01:05.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.238+0000 7f843effd640 1 -- 172.21.15.118:0/3084141092 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f844803e7d0 con 0x7f845014fa00 2024-02-18T10:01:05.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.238+0000 7f843effd640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f843006bca0 0x7f843006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.238+0000 7f843effd640 1 -- 172.21.15.118:0/3084141092 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84480ad280 con 0x7f845014fa00 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.238+0000 7f844e59c640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f843006bca0 0x7f843006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.238+0000 7f844e59c640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f843006bca0 0x7f843006e160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8440007fd0 tx=0x7f8440009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.239+0000 7f8457b79740 1 Processor -- start 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.239+0000 7f8457b79740 1 -- start start 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177408760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177408ca0 0x55a177439930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f8457b79740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177439e70 0x55a17743a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f8457b79740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1773c8dc0 con 0x55a177439e70 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a17737bf20 con 0x55a177444590 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a177379450 con 0x55a177408ca0 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177439e70 0x55a17743a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177439e70 0x55a17743a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43286/0 (socket says 172.21.15.118:43286) 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 -- 172.21.15.118:0/3751114274 learned_addr learned my addr 172.21.15.118:0/3751114274 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844e59c640 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177408760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844dd9b640 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177408ca0 0x55a177439930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 -- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177408ca0 msgr2=0x55a177439930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177408ca0 0x55a177439930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 -- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 msgr2=0x55a177408760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177408760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 -- 172.21.15.118:0/3751114274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a177329f20 con 0x55a177439e70 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844e59c640 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177408760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844dd9b640 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177408ca0 0x55a177439930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f844ed9d640 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177439e70 0x55a17743a2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f844807b7e0 tx=0x7f844802cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39cdf5071a22852 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f842ffff640 1 -- 172.21.15.118:0/3751114274 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84480ad0c0 con 0x55a177439e70 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f842ffff640 1 -- 172.21.15.118:0/3751114274 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844807b850 con 0x55a177439e70 2024-02-18T10:01:05.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.240+0000 7f842ffff640 1 -- 172.21.15.118:0/3751114274 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844807f9a0 con 0x55a177439e70 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 -- 172.21.15.118:0/3751114274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177439e70 msgr2=0x55a17743a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177439e70 0x55a17743a2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f844807b7e0 tx=0x7f844802cc10 comp rx=0 tx=0).stop 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 -- 172.21.15.118:0/3751114274 shutdown_connections 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177439e70 0x55a17743a2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177408ca0 0x55a177439930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 --2- 172.21.15.118:0/3751114274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177408760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 -- 172.21.15.118:0/3751114274 >> 172.21.15.118:0/3751114274 conn(0x55a17740a0f0 msgr2=0x55a177443c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 -- 172.21.15.118:0/3751114274 shutdown_connections 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.241+0000 7f8457b79740 1 -- 172.21.15.118:0/3751114274 wait complete. 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.242+0000 7f8457b79740 1 -- start start 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.242+0000 7f8457b79740 1 Processor -- start 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a17743c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177444590 0x55a177430d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177436b70 0x55a177431250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a177374c30 con 0x55a177444590 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a177319d30 con 0x55a177439e70 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a177048310 con 0x55a177436b70 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 10 client.0 _ll_register_callbacks cb 0x55a177321d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177444590 0x55a177430d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177444590 0x55a177430d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43296/0 (socket says 172.21.15.118:43296) 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 -- 172.21.15.118:0/182423382 learned_addr learned my addr 172.21.15.118:0/182423382 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844e59c640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a17743c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844ed9d640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177436b70 0x55a177431250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 -- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177436b70 msgr2=0x55a177431250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177436b70 0x55a177431250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 -- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 msgr2=0x55a17743c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a17743c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 -- 172.21.15.118:0/182423382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845014dcf0 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844e59c640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a17743c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844ed9d640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177436b70 0x55a177431250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f844dd9b640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177444590 0x55a177430d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8444011340 tx=0x7f8444011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a68a3a28e254be server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f842d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f842d7fa640 1 -- 172.21.15.118:0/182423382 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444015650 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f842d7fa640 1 -- 172.21.15.118:0/182423382 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84440157b0 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.243+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1770746c0 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f842d7fa640 1 -- 172.21.15.118:0/182423382 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8444015970 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 10 client.4689 fetch_fsmap learned FSMap version 6 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55a1773732b0 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f842d7fa640 1 -- 172.21.15.118:0/182423382 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a1770746c0 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f842d7fa640 1 -- 172.21.15.118:0/182423382 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f8444015ad0 con 0x55a177444590 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 10 client.4689 fetch_fsmap finished waiting for FSMap version 6 2024-02-18T10:01:05.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 20 client.4689 populate_metadata read hostname 'smithi118' 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17745d5a0 0x55a17745f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 4 client.4689 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 --> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1770c5270 con 0x55a17745d5a0 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f844e59c640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17745d5a0 0x55a17745f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f842d7fa640 10 client.4689 ms_handle_connect on v2:172.21.15.164:6832/2459180675 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.244+0000 7f844e59c640 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17745d5a0 0x55a17745f990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c13cbb35f03c2a server_cookie=b7a649f92deed831 in_seq=0 out_seq=0 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f842d7fa640 1 -- 172.21.15.118:0/182423382 <== mds.0 v2:172.21.15.164:6832/2459180675 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a1770c5270 con 0x55a17745d5a0 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f842d7fa640 10 client.4689 handle_command_reply: tid=0 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 client.4689 shutdown 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177444590 msgr2=0x55a177430d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177444590 0x55a177430d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8444011340 tx=0x7f8444011800 comp rx=0 tx=0).stop 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 shutdown_connections 2024-02-18T10:01:05.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17745d5a0 0x55a17745f990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177436b70 0x55a177431250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177444590 0x55a177430d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 --2- 172.21.15.118:0/182423382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a17743c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f842d7fa640 0 client.4689 ms_handle_reset on v2:172.21.15.164:6832/2459180675 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 >> 172.21.15.118:0/182423382 conn(0x55a177408ca0 msgr2=0x55a177407950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 shutdown_connections 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.245+0000 7f8457b79740 1 -- 172.21.15.118:0/182423382 wait complete. 2024-02-18T10:01:05.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.246+0000 7f8457b79740 20 client.4689 trim_cache size 0 max 16384 2024-02-18T10:01:05.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.261+0000 7f8457b79740 1 Processor -- start 2024-02-18T10:01:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.261+0000 7f8457b79740 1 -- start start 2024-02-18T10:01:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f8457b79740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177436fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a1774639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177444590 0x55a177463ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f8457b79740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1772fa490 con 0x55a177436b70 2024-02-18T10:01:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a177409d20 con 0x55a177439e70 2024-02-18T10:01:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a177408660 con 0x55a177444590 2024-02-18T10:01:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177436fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177436fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43306/0 (socket says 172.21.15.118:43306) 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 -- 172.21.15.118:0/3910153230 learned_addr learned my addr 172.21.15.118:0/3910153230 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 -- 172.21.15.118:0/3910153230 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177444590 msgr2=0x55a177463ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 --2- 172.21.15.118:0/3910153230 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177444590 0x55a177463ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 -- 172.21.15.118:0/3910153230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 msgr2=0x55a1774639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 --2- 172.21.15.118:0/3910153230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a1774639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 -- 172.21.15.118:0/3910153230 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a17730fa20 con 0x55a177436b70 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f844e59c640 1 --2- 172.21.15.118:0/3910153230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177436fd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55a17743d710 tx=0x7f8440017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f882068f5ef52506 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f842f7fe640 1 -- 172.21.15.118:0/3910153230 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400243c0 con 0x55a177436b70 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f842f7fe640 1 -- 172.21.15.118:0/3910153230 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8440024520 con 0x55a177436b70 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.262+0000 7f842f7fe640 1 -- 172.21.15.118:0/3910153230 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8440024690 con 0x55a177436b70 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 -- 172.21.15.118:0/3910153230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 msgr2=0x55a177436fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 --2- 172.21.15.118:0/3910153230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177436fd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55a17743d710 tx=0x7f8440017040 comp rx=0 tx=0).stop 2024-02-18T10:01:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 -- 172.21.15.118:0/3910153230 shutdown_connections 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 --2- 172.21.15.118:0/3910153230 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177444590 0x55a177463ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 --2- 172.21.15.118:0/3910153230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177439e70 0x55a1774639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 --2- 172.21.15.118:0/3910153230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177436fd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 -- 172.21.15.118:0/3910153230 >> 172.21.15.118:0/3910153230 conn(0x55a177408ca0 msgr2=0x55a17740d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 -- 172.21.15.118:0/3910153230 shutdown_connections 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 -- 172.21.15.118:0/3910153230 wait complete. 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 -- start start 2024-02-18T10:01:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.263+0000 7f8457b79740 1 Processor -- start 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f8457b79740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177435440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177439e70 0x55a1774a5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f8457b79740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177463ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f8457b79740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a177431540 con 0x55a177436b70 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a17744d4a0 con 0x55a177444590 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f8457b79740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1774afd10 con 0x55a177439e70 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f8457b79740 10 client.0 _ll_register_callbacks cb 0x7f8448007310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177435440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177435440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43316/0 (socket says 172.21.15.118:43316) 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 -- 172.21.15.118:0/1829699097 learned_addr learned my addr 172.21.15.118:0/1829699097 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844dd9b640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177439e70 0x55a1774a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844ed9d640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177463ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 -- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177439e70 msgr2=0x55a1774a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177439e70 0x55a1774a5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 -- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 msgr2=0x55a177463ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177463ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844e59c640 1 -- 172.21.15.118:0/1829699097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844000f040 con 0x55a177436b70 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.264+0000 7f844dd9b640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177439e70 0x55a1774a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f844e59c640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177435440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8440027040 tx=0x7f8440000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f19fde44a98bae server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f842d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f842d7fa640 1 -- 172.21.15.118:0/1829699097 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8440024890 con 0x55a177436b70 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f842d7fa640 1 -- 172.21.15.118:0/1829699097 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f844002e640 con 0x55a177436b70 2024-02-18T10:01:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f844807b850 con 0x55a177436b70 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f842d7fa640 1 -- 172.21.15.118:0/1829699097 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f844002e800 con 0x55a177436b70 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 10 client.4695 fetch_fsmap learned FSMap version 6 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55a177335780 con 0x55a177436b70 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f842d7fa640 1 -- 172.21.15.118:0/1829699097 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844807b850 con 0x55a177436b70 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f842d7fa640 1 -- 172.21.15.118:0/1829699097 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f844002e960 con 0x55a177436b70 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 10 client.4695 fetch_fsmap finished waiting for FSMap version 6 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 20 client.4695 populate_metadata read hostname 'smithi118' 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17743f5e0 0x55a17743f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 4 client.4695 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 --> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a1770b1610 con 0x55a17743f5e0 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.265+0000 7f844dd9b640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17743f5e0 0x55a17743f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f842d7fa640 10 client.4695 ms_handle_connect on v2:172.21.15.164:6832/2459180675 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f844dd9b640 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17743f5e0 0x55a17743f9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f2ac916477c595 server_cookie=a4a5c917edd61f04 in_seq=0 out_seq=0 2024-02-18T10:01:05.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f842d7fa640 1 -- 172.21.15.118:0/1829699097 <== mds.0 v2:172.21.15.164:6832/2459180675 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a1770b1610 con 0x55a17743f5e0 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f842d7fa640 10 client.4695 handle_command_reply: tid=0 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 client.4695 shutdown 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 msgr2=0x55a177435440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177435440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8440027040 tx=0x7f8440000bc0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 shutdown_connections 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:6832/2459180675,v1:172.21.15.164:6833/2459180675] conn(0x55a17743f5e0 0x55a17743f9c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a177444590 0x55a177463ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a177439e70 0x55a1774a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 --2- 172.21.15.118:0/1829699097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a177436b70 0x55a177435440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f842d7fa640 0 client.4695 ms_handle_reset on v2:172.21.15.164:6832/2459180675 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 >> 172.21.15.118:0/1829699097 conn(0x55a177408ca0 msgr2=0x55a177443900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 shutdown_connections 2024-02-18T10:01:05.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 1 -- 172.21.15.118:0/1829699097 wait complete. 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.266+0000 7f8457b79740 20 client.4695 trim_cache size 0 max 16384 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "96fc967a-d47f-4a89-a97a-6d7920f41e97", 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4264, 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-02-18T10:01:05.277 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 16.533083399999999, 2024-02-18T10:01:05.278 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 6, 2024-02-18T10:01:05.278 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 21, 2024-02-18T10:01:05.278 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 21, 2024-02-18T10:01:05.278 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 23.543940184 2024-02-18T10:01:05.278 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f843006bca0 msgr2=0x7f843006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f843006bca0 0x7f843006e160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8440007fd0 tx=0x7f8440009040 comp rx=0 tx=0).stop 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845014fa00 msgr2=0x7f84501e1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845014fa00 0x7f84501e1e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8448036040 tx=0x7f8448004a40 comp rx=0 tx=0).stop 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 shutdown_connections 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f843006bca0 0x7f843006e160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f845014fa00 0x7f84501e1e80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f845006c0d0 0x7f84501e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 --2- 172.21.15.118:0/3084141092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f845006bcf0 0x7f845014ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 >> 172.21.15.118:0/3084141092 conn(0x7f84500bbea0 msgr2=0x7f84500b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 shutdown_connections 2024-02-18T10:01:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.267+0000 7f8454ec9640 1 -- 172.21.15.118:0/3084141092 wait complete. 2024-02-18T10:01:05.281 INFO:teuthology.run_tasks:Running task kclient... 2024-02-18T10:01:05.307 INFO:tasks.kclient:Mounting kernel clients... 2024-02-18T10:01:05.307 INFO:tasks.kclient:config is {'client.0': {}} 2024-02-18T10:01:05.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:05.307 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-02-18T10:01:05.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:05.369 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-02-18T10:01:05.466 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2024-02-18T10:01:05.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T10:01:05.470 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-02-18T10:01:05.470 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-18T10:01:05.470 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:05.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.568+0000 7f9a3d30c640 1 Processor -- start 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.568+0000 7f9a3d30c640 1 -- start start 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a3d30c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9a3806da80 0x7f9a3814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a3d30c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9a3806fe20 0x7f9a3814f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a3d30c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a381462f0 con 0x7f9a380723c0 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a3d30c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3806c9a0 con 0x7f9a3806da80 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a3d30c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3806cc80 con 0x7f9a3806fe20 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a367fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9a3806da80 0x7f9a3814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a367fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9a3806da80 0x7f9a3814f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43318/0 (socket says 172.21.15.118:43318) 2024-02-18T10:01:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a367fc640 1 -- 172.21.15.118:0/1029195273 learned_addr learned my addr 172.21.15.118:0/1029195273 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a377fe640 1 --2- 172.21.15.118:0/1029195273 >> v2:172.21.15.164:3300/0 conn(0x7f9a3806fe20 0x7f9a3814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a367fc640 1 -- 172.21.15.118:0/1029195273 >> v2:172.21.15.164:3300/0 conn(0x7f9a3806fe20 msgr2=0x7f9a3814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a367fc640 1 --2- 172.21.15.118:0/1029195273 >> v2:172.21.15.164:3300/0 conn(0x7f9a3806fe20 0x7f9a3814f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a367fc640 1 -- 172.21.15.118:0/1029195273 >> v1:172.21.15.164:6789/0 conn(0x7f9a380723c0 legacy=0x7f9a38145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a367fc640 1 -- 172.21.15.118:0/1029195273 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3806cf60 con 0x7f9a3806da80 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.569+0000 7f9a377fe640 1 --2- 172.21.15.118:0/1029195273 >> v2:172.21.15.164:3300/0 conn(0x7f9a3806fe20 0x7f9a3814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.570+0000 7f9a367fc640 1 --2- 172.21.15.118:0/1029195273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a3806da80 0x7f9a3814f3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a3806e870 tx=0x7f9a2c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55e0641aa64ae5f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.570+0000 7f9a35ffb640 1 -- 172.21.15.118:0/1029195273 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c02f850 con 0x7f9a3806da80 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.570+0000 7f9a35ffb640 1 -- 172.21.15.118:0/1029195273 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c02f9b0 con 0x7f9a3806da80 2024-02-18T10:01:05.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.570+0000 7f9a35ffb640 1 -- 172.21.15.118:0/1029195273 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c02fd40 con 0x7f9a3806da80 2024-02-18T10:01:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 -- 172.21.15.118:0/1029195273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a3806da80 msgr2=0x7f9a3814f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/1029195273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a3806da80 0x7f9a3814f3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a3806e870 tx=0x7f9a2c02ba30 comp rx=0 tx=0).stop 2024-02-18T10:01:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 -- 172.21.15.118:0/1029195273 shutdown_connections 2024-02-18T10:01:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/1029195273 >> v2:172.21.15.164:3300/0 conn(0x7f9a3806fe20 0x7f9a3814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/1029195273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a3806da80 0x7f9a3814f3d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 -- 172.21.15.118:0/1029195273 >> 172.21.15.118:0/1029195273 conn(0x7f9a380a11c0 msgr2=0x7f9a380a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 -- 172.21.15.118:0/1029195273 shutdown_connections 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.571+0000 7f9a3d30c640 1 -- 172.21.15.118:0/1029195273 wait complete. 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.572+0000 7f9a3d30c640 1 Processor -- start 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.572+0000 7f9a3d30c640 1 -- start start 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3806da80 0x7f9a380b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a3806fe20 0x7f9a3809f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a380723c0 0x7f9a3809e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380b5c30 con 0x7f9a380723c0 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380a0ab0 con 0x7f9a3806da80 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380a04a0 con 0x7f9a3806fe20 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a380723c0 0x7f9a3809e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a380723c0 0x7f9a3809e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43326/0 (socket says 172.21.15.118:43326) 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 -- 172.21.15.118:0/337734518 learned_addr learned my addr 172.21.15.118:0/337734518 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a367fc640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a3806fe20 0x7f9a3809f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a36ffd640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3806da80 0x7f9a380b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 -- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a3806fe20 msgr2=0x7f9a3809f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a3806fe20 0x7f9a3809f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 -- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3806da80 msgr2=0x7f9a380b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3806da80 0x7f9a380b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 -- 172.21.15.118:0/337734518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0094d0 con 0x7f9a380723c0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a36ffd640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3806da80 0x7f9a380b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a377fe640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a380723c0 0x7f9a3809e110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000e7e0 tx=0x7f9a3000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a1f7fe640 1 -- 172.21.15.118:0/337734518 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30004030 con 0x7f9a380723c0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a1f7fe640 1 -- 172.21.15.118:0/337734518 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a30004190 con 0x7f9a380723c0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a38140f80 con 0x7f9a380723c0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a1f7fe640 1 -- 172.21.15.118:0/337734518 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30004500 con 0x7f9a380723c0 2024-02-18T10:01:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.573+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a380a0740 con 0x7f9a380723c0 2024-02-18T10:01:05.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.574+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a380a0300 con 0x7f9a380723c0 2024-02-18T10:01:05.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.575+0000 7f9a1f7fe640 1 -- 172.21.15.118:0/337734518 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9a3000c6d0 con 0x7f9a380723c0 2024-02-18T10:01:05.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.575+0000 7f9a1f7fe640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a2406bca0 0x7f9a2406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:05.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.575+0000 7f9a36ffd640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a2406bca0 0x7f9a2406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:05.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.575+0000 7f9a1f7fe640 1 -- 172.21.15.118:0/337734518 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a3008a580 con 0x7f9a380723c0 2024-02-18T10:01:05.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.576+0000 7f9a36ffd640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a2406bca0 0x7f9a2406e160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a28001d60 tx=0x7f9a28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:05.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.579+0000 7f9a1f7fe640 1 -- 172.21.15.118:0/337734518 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a380a0300 con 0x7f9a380723c0 2024-02-18T10:01:05.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.786+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9a380a0300 con 0x7f9a380723c0 2024-02-18T10:01:05.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.786+0000 7f9a1f7fe640 1 -- 172.21.15.118:0/337734518 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9a380a0300 con 0x7f9a380723c0 2024-02-18T10:01:05.789 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-18T10:01:05.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a2406bca0 msgr2=0x7f9a2406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a2406bca0 0x7f9a2406e160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9a28001d60 tx=0x7f9a28009040 comp rx=0 tx=0).stop 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a380723c0 msgr2=0x7f9a3809e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a380723c0 0x7f9a3809e110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000e7e0 tx=0x7f9a3000eca0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 shutdown_connections 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a2406bca0 0x7f9a2406e160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9a380723c0 0x7f9a3809e110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9a3806fe20 0x7f9a3809f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 --2- 172.21.15.118:0/337734518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a3806da80 0x7f9a380b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 >> 172.21.15.118:0/337734518 conn(0x7f9a380a11c0 msgr2=0x7f9a38145be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 shutdown_connections 2024-02-18T10:01:05.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:05.788+0000 7f9a3d30c640 1 -- 172.21.15.118:0/337734518 wait complete. 2024-02-18T10:01:05.801 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-18T10:01:05.801 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-18T10:01:05.801 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-02-18T10:01:05.801 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-18T10:01:05.801 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:05.802 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-18T10:01:05.802 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-18T10:01:05.802 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-18T10:01:05.802 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-18T10:01:05.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:05.802 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-02-18T10:01:05.858 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-18T10:01:05.858 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-18T10:01:05.858 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-02-18T10:01:05.858 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-18T10:01:05.859 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42639sec preferred_lft 42639sec 2024-02-18T10:01:05.860 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link proto kernel_ll 2024-02-18T10:01:05.860 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:05.861 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-18T10:01:05.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:05.861 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-02-18T10:01:05.861 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-02-18T10:01:05.861 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add name ceph-brx type bridge 2024-02-18T10:01:05.861 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr flush dev ceph-brx 2024-02-18T10:01:05.861 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set ceph-brx up 2024-02-18T10:01:05.861 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-18T10:01:05.861 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-02-18T10:01:06.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:06.319 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-18T10:01:06.399 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-02-18T10:01:06.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:06.403 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-02-18T10:01:06.454 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-02-18T10:01:06.454 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-18T10:01:06.454 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-18T10:01:06.454 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-18T10:01:06.454 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-18T10:01:06.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:06.455 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-02-18T10:01:06.455 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-02-18T10:01:06.455 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-18T10:01:06.455 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-18T10:01:06.455 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-18T10:01:06.455 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-02-18T10:01:07.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:07.184 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-02-18T10:01:07.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:07.236 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2024-02-18T10:01:07.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:07.286 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-02-18T10:01:07.286 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-02-18T10:01:07.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-18T10:01:07.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-18T10:01:07.286 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-02-18T10:01:07.427 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-18T10:01:07.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:07.427 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-02-18T10:01:07.427 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-02-18T10:01:07.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-18T10:01:07.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-18T10:01:07.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-18T10:01:07.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-18T10:01:07.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-18T10:01:07.428 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-02-18T10:01:07.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:07.709 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-02-18T10:01:07.709 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-02-18T10:01:07.709 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2024-02-18T10:01:07.709 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.0 master ceph-brx 2024-02-18T10:01:07.709 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-02-18T10:01:07.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-18T10:01:07.870 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:07.917 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-18T10:01:07.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-18T10:01:07.918 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:08.009 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-02-18T10:01:08.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:08.010 DEBUG:teuthology.orchestra.run.smithi204:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-18T10:01:08.159 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-18T10:01:08.159 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-18T10:01:08.810 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-18T10:01:08.810 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-18T10:01:08.810 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-02-18T10:01:08.810 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: trying mount with new device syntax: 0@96fc967a-d47f-4a89-a97a-6d7920f41e97.cephfs=/ 2024-02-18T10:01:08.810 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.164:3300/172.21.15.164:3301" will pass to kernel 2024-02-18T10:01:08.813 INFO:teuthology.orchestra.run.smithi204.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-18T10:01:08.813 INFO:teuthology.orchestra.run.smithi204.stdout: You just mounted a file system that supports labels which does not 2024-02-18T10:01:08.813 INFO:teuthology.orchestra.run.smithi204.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-18T10:01:08.813 INFO:teuthology.orchestra.run.smithi204.stdout: applications will generate AVC messages and not be allowed access to 2024-02-18T10:01:08.813 INFO:teuthology.orchestra.run.smithi204.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-18T10:01:08.817 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-18T10:01:08.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:08.817 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:08.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:08.903 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-18T10:01:08.968 INFO:teuthology.orchestra.run.smithi204.stdout:client4442 2024-02-18T10:01:08.969 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:01:08.969 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T10:01:09.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:09.021 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-18T10:01:09.083 INFO:teuthology.orchestra.run.smithi204.stdout:client4442 2024-02-18T10:01:09.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:09.083 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-18T10:01:09.145 INFO:teuthology.orchestra.run.smithi204.stdout:client4442 2024-02-18T10:01:09.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:09.146 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/96fc967a-d47f-4a89-a97a-6d7920f41e97.client4442/status') 2024-02-18T10:01:09.240 INFO:teuthology.orchestra.run.smithi204.stdout:instance: client.4442 (3)172.21.15.204:0/3001678085 2024-02-18T10:01:09.240 INFO:teuthology.orchestra.run.smithi204.stdout:blocklisted: false 2024-02-18T10:01:09.241 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2024-02-18T10:01:09.241 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2024-02-18T10:01:09.241 INFO:teuthology.orchestra.run.smithi204.stderr:71 bytes copied, 6.5621e-05 s, 1.1 MB/s 2024-02-18T10:01:09.245 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-02-18T10:01:09.261 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:09.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.368+0000 7f50dc90c640 1 Processor -- start 2024-02-18T10:01:09.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.368+0000 7f50dc90c640 1 -- start start 2024-02-18T10:01:09.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50dc90c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f50d806bbe0 0x7f50d8149300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50dc90c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50d8149840 0x7f50d8156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50dc90c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d80b4e10 con 0x7f50d80bd2b0 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50dc90c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80bdc20 con 0x7f50d8149840 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50dc90c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80bc5c0 con 0x7f50d806bbe0 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50d6d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50d8149840 0x7f50d8156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50d6d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50d8149840 0x7f50d8156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45822/0 (socket says 172.21.15.118:45822) 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50d5d9b640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f50d80bd2b0 0x7f50d814bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57180/0 (socket says 172.21.15.118:57180) 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.369+0000 7f50d6d9d640 1 -- 172.21.15.118:0/1623863596 learned_addr learned my addr 172.21.15.118:0/1623863596 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d6d9d640 1 -- 172.21.15.118:0/1623863596 >> v2:172.21.15.164:3300/0 conn(0x7f50d806bbe0 msgr2=0x7f50d8149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d6d9d640 1 --2- 172.21.15.118:0/1623863596 >> v2:172.21.15.164:3300/0 conn(0x7f50d806bbe0 0x7f50d8149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d6d9d640 1 -- 172.21.15.118:0/1623863596 >> v1:172.21.15.118:6789/0 conn(0x7f50d80bd2b0 legacy=0x7f50d814bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d6d9d640 1 -- 172.21.15.118:0/1623863596 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d80b4b50 con 0x7f50d8149840 2024-02-18T10:01:09.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d6d9d640 1 --2- 172.21.15.118:0/1623863596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d8149840 0x7f50d8156650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50d80740b0 tx=0x7f50d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff51eaa238c2d281 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d559a640 1 -- 172.21.15.118:0/1623863596 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0031870 con 0x7f50d8149840 2024-02-18T10:01:09.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d559a640 1 -- 172.21.15.118:0/1623863596 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d00319d0 con 0x7f50d8149840 2024-02-18T10:01:09.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.370+0000 7f50d559a640 1 -- 172.21.15.118:0/1623863596 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0031d60 con 0x7f50d8149840 2024-02-18T10:01:09.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 -- 172.21.15.118:0/1623863596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d8149840 msgr2=0x7f50d8156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 --2- 172.21.15.118:0/1623863596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d8149840 0x7f50d8156650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50d80740b0 tx=0x7f50d002b910 comp rx=0 tx=0).stop 2024-02-18T10:01:09.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 -- 172.21.15.118:0/1623863596 shutdown_connections 2024-02-18T10:01:09.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 --2- 172.21.15.118:0/1623863596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d8149840 0x7f50d8156650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 --2- 172.21.15.118:0/1623863596 >> v2:172.21.15.164:3300/0 conn(0x7f50d806bbe0 0x7f50d8149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 -- 172.21.15.118:0/1623863596 >> 172.21.15.118:0/1623863596 conn(0x7f50d80c18e0 msgr2=0x7f50d80c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:09.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 -- 172.21.15.118:0/1623863596 shutdown_connections 2024-02-18T10:01:09.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.371+0000 7f50dc90c640 1 -- 172.21.15.118:0/1623863596 wait complete. 2024-02-18T10:01:09.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.372+0000 7f50dc90c640 1 Processor -- start 2024-02-18T10:01:09.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.372+0000 7f50dc90c640 1 -- start start 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50dc90c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50d806bbe0 0x7f50d814e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50dc90c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d80bd2b0 0x7f50d80b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50dc90c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50d8149840 0x7f50d80b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50dc90c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80a54d0 con 0x7f50d80bd2b0 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50dc90c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80a57b0 con 0x7f50d8149840 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50dc90c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d814d770 con 0x7f50d806bbe0 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d80bd2b0 0x7f50d80b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d80bd2b0 0x7f50d80b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45836/0 (socket says 172.21.15.118:45836) 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 -- 172.21.15.118:0/2839586356 learned_addr learned my addr 172.21.15.118:0/2839586356 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:09.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d659c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50d806bbe0 0x7f50d814e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d6d9d640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50d8149840 0x7f50d80b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 -- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50d806bbe0 msgr2=0x7f50d814e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50d806bbe0 0x7f50d814e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 -- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50d8149840 msgr2=0x7f50d80b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50d8149840 0x7f50d80b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 -- 172.21.15.118:0/2839586356 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d00094d0 con 0x7f50d80bd2b0 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d6d9d640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50d8149840 0x7f50d80b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d659c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50d806bbe0 0x7f50d814e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.373+0000 7f50d5d9b640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d80bd2b0 0x7f50d80b7ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c440 tx=0x7f50cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.374+0000 7f50c6ffd640 1 -- 172.21.15.118:0/2839586356 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0074e0 con 0x7f50d80bd2b0 2024-02-18T10:01:09.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.374+0000 7f50c6ffd640 1 -- 172.21.15.118:0/2839586356 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc007640 con 0x7f50d80bd2b0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.374+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d80b8000 con 0x7f50d80bd2b0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.374+0000 7f50c6ffd640 1 -- 172.21.15.118:0/2839586356 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc004a20 con 0x7f50d80bd2b0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.374+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d814d490 con 0x7f50d80bd2b0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.375+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d8074af0 con 0x7f50d80bd2b0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.375+0000 7f50c6ffd640 1 -- 172.21.15.118:0/2839586356 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f50cc004b80 con 0x7f50d80bd2b0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.375+0000 7f50c6ffd640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50b806bc70 0x7f50b806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.375+0000 7f50c6ffd640 1 -- 172.21.15.118:0/2839586356 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50cc08a1c0 con 0x7f50d80bd2b0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.375+0000 7f50d659c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50b806bc70 0x7f50b806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.376+0000 7f50d659c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50b806bc70 0x7f50b806e130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009fa0 tx=0x7f50c8009570 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.380+0000 7f50c6ffd640 1 -- 172.21.15.118:0/2839586356 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f50cc0549a0 con 0x7f50d80bd2b0 2024-02-18T10:01:09.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.555+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50d80bcf60 con 0x7f50d80bd2b0 2024-02-18T10:01:09.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.556+0000 7f50c6ffd640 1 -- 172.21.15.118:0/2839586356 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f50cc058060 con 0x7f50d80bd2b0 2024-02-18T10:01:09.559 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:09.559 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50b806bc70 msgr2=0x7f50b806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50b806bc70 0x7f50b806e130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009fa0 tx=0x7f50c8009570 comp rx=0 tx=0).stop 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d80bd2b0 msgr2=0x7f50d80b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d80bd2b0 0x7f50d80b7ac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c440 tx=0x7f50cc001e70 comp rx=0 tx=0).stop 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 shutdown_connections 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f50b806bc70 0x7f50b806e130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50d8149840 0x7f50d80b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50d80bd2b0 0x7f50d80b7ac0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 --2- 172.21.15.118:0/2839586356 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50d806bbe0 0x7f50d814e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 >> 172.21.15.118:0/2839586356 conn(0x7f50d80c18e0 msgr2=0x7f50d80a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:09.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 shutdown_connections 2024-02-18T10:01:09.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.558+0000 7f50dc90c640 1 -- 172.21.15.118:0/2839586356 wait complete. 2024-02-18T10:01:09.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:09.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:09.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.672+0000 7f9f2d7ac640 1 Processor -- start 2024-02-18T10:01:09.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.672+0000 7f9f2d7ac640 1 -- start start 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.672+0000 7f9f2d7ac640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f2806c9e0 0x7f9f280bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.672+0000 7f9f2d7ac640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2806d130 con 0x7f9f2814c870 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.672+0000 7f9f2d7ac640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2806be10 con 0x7f9f280c0050 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.672+0000 7f9f2d7ac640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f280bda50 con 0x7f9f2806c9e0 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.672+0000 7f9f26ffd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9f2814c870 0x7f9f2806b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57196/0 (socket says 172.21.15.118:57196) 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f26ffd640 1 -- 172.21.15.118:0/2945072916 learned_addr learned my addr 172.21.15.118:0/2945072916 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f267fc640 1 --2- 172.21.15.118:0/2945072916 >> v2:172.21.15.164:3300/0 conn(0x7f9f2806c9e0 0x7f9f280bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f25ffb640 1 -- 172.21.15.118:0/2945072916 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132597132 0 0) 0x7f9f2806d130 con 0x7f9f2814c870 2024-02-18T10:01:09.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f25ffb640 1 -- 172.21.15.118:0/2945072916 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f10003520 con 0x7f9f2814c870 2024-02-18T10:01:09.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f25ffb640 1 -- 172.21.15.118:0/2945072916 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50711868 0 0) 0x7f9f10003520 con 0x7f9f2814c870 2024-02-18T10:01:09.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f267fc640 1 -- 172.21.15.118:0/2945072916 >> v1:172.21.15.164:6789/0 conn(0x7f9f280c0050 legacy=0x7f9f28156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f267fc640 1 -- 172.21.15.118:0/2945072916 >> v1:172.21.15.118:6789/0 conn(0x7f9f2814c870 legacy=0x7f9f2806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.673+0000 7f9f267fc640 1 -- 172.21.15.118:0/2945072916 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280c0480 con 0x7f9f2806c9e0 2024-02-18T10:01:09.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f267fc640 1 --2- 172.21.15.118:0/2945072916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2806c9e0 0x7f9f280bfb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0097a0 tx=0x7f9f1c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b62473fb4f440c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f25ffb640 1 -- 172.21.15.118:0/2945072916 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18001690 con 0x7f9f2806c9e0 2024-02-18T10:01:09.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f25ffb640 1 -- 172.21.15.118:0/2945072916 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c031590 con 0x7f9f2806c9e0 2024-02-18T10:01:09.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f25ffb640 1 -- 172.21.15.118:0/2945072916 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c031920 con 0x7f9f2806c9e0 2024-02-18T10:01:09.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/2945072916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2806c9e0 msgr2=0x7f9f280bfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/2945072916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2806c9e0 0x7f9f280bfb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0097a0 tx=0x7f9f1c02b8b0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/2945072916 shutdown_connections 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/2945072916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2806c9e0 0x7f9f280bfb10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.674+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/2945072916 >> 172.21.15.118:0/2945072916 conn(0x7f9f280c1650 msgr2=0x7f9f280c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.675+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/2945072916 shutdown_connections 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.675+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/2945072916 wait complete. 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 Processor -- start 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 -- start start 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f2806c9e0 0x7f9f28144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f280c0050 0x7f9f280b9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2814c870 0x7f9f280ba990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28145410 con 0x7f9f2806c9e0 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f280be920 con 0x7f9f2814c870 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f2d7ac640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f280b8ad0 con 0x7f9f280c0050 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f26ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f2806c9e0 0x7f9f28144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f26ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f2806c9e0 0x7f9f28144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45850/0 (socket says 172.21.15.118:45850) 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.676+0000 7f9f26ffd640 1 -- 172.21.15.118:0/55819133 learned_addr learned my addr 172.21.15.118:0/55819133 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f26ffd640 1 -- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f280c0050 msgr2=0x7f9f280b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f277fe640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2814c870 0x7f9f280ba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f267fc640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f280c0050 0x7f9f280b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f26ffd640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f280c0050 0x7f9f280b9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f26ffd640 1 -- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2814c870 msgr2=0x7f9f280ba990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f26ffd640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2814c870 0x7f9f280ba990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f26ffd640 1 -- 172.21.15.118:0/55819133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c009400 con 0x7f9f2806c9e0 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f26ffd640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f2806c9e0 0x7f9f28144ed0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800c550 tx=0x7f9f1800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f0f7fe640 1 -- 172.21.15.118:0/55819133 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180074e0 con 0x7f9f2806c9e0 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f0f7fe640 1 -- 172.21.15.118:0/55819133 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f18007660 con 0x7f9f2806c9e0 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f280be640 con 0x7f9f2806c9e0 2024-02-18T10:01:09.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f0f7fe640 1 -- 172.21.15.118:0/55819133 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18004a20 con 0x7f9f2806c9e0 2024-02-18T10:01:09.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.677+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f280b9050 con 0x7f9f2806c9e0 2024-02-18T10:01:09.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.678+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f28075150 con 0x7f9f2806c9e0 2024-02-18T10:01:09.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.678+0000 7f9f0f7fe640 1 -- 172.21.15.118:0/55819133 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9f18004b80 con 0x7f9f2806c9e0 2024-02-18T10:01:09.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.679+0000 7f9f0f7fe640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f1406bc70 0x7f9f1406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.679+0000 7f9f0f7fe640 1 -- 172.21.15.118:0/55819133 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f18089cf0 con 0x7f9f2806c9e0 2024-02-18T10:01:09.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.679+0000 7f9f267fc640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f1406bc70 0x7f9f1406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.679+0000 7f9f267fc640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f1406bc70 0x7f9f1406e130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c036000 tx=0x7f9f1c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.683+0000 7f9f0f7fe640 1 -- 172.21.15.118:0/55819133 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f1808e070 con 0x7f9f2806c9e0 2024-02-18T10:01:09.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.854+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f280a71d0 con 0x7f9f2806c9e0 2024-02-18T10:01:09.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.854+0000 7f9f0f7fe640 1 -- 172.21.15.118:0/55819133 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f18018020 con 0x7f9f2806c9e0 2024-02-18T10:01:09.857 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:09.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f1406bc70 msgr2=0x7f9f1406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f1406bc70 0x7f9f1406e130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c036000 tx=0x7f9f1c008030 comp rx=0 tx=0).stop 2024-02-18T10:01:09.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f2806c9e0 msgr2=0x7f9f28144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f2806c9e0 0x7f9f28144ed0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800c550 tx=0x7f9f1800ca10 comp rx=0 tx=0).stop 2024-02-18T10:01:09.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 shutdown_connections 2024-02-18T10:01:09.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f1406bc70 0x7f9f1406e130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f2814c870 0x7f9f280ba990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f280c0050 0x7f9f280b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 --2- 172.21.15.118:0/55819133 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f2806c9e0 0x7f9f28144ed0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 >> 172.21.15.118:0/55819133 conn(0x7f9f280c1650 msgr2=0x7f9f281d7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:09.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 shutdown_connections 2024-02-18T10:01:09.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.856+0000 7f9f2d7ac640 1 -- 172.21.15.118:0/55819133 wait complete. 2024-02-18T10:01:09.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:09.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.969+0000 7ff72613a640 1 Processor -- start 2024-02-18T10:01:09.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.969+0000 7ff72613a640 1 -- start start 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.969+0000 7ff72613a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff720072a70 0x7ff72014d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.969+0000 7ff72613a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72006b8e0 con 0x7ff7200713a0 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.969+0000 7ff72613a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72014d970 con 0x7ff72014cf50 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.969+0000 7ff72613a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72014dc50 con 0x7ff720072a70 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71effd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff720072a70 0x7ff72014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71ffff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff7200713a0 0x7ff720154280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57200/0 (socket says 172.21.15.118:57200) 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71ffff640 1 -- 172.21.15.118:0/2668400324 learned_addr learned my addr 172.21.15.118:0/2668400324 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71effd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff720072a70 0x7ff72014d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45852/0 (socket says 172.21.15.118:45852) 2024-02-18T10:01:09.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71effd640 1 -- 172.21.15.118:0/2668400324 >> v1:172.21.15.164:6789/0 conn(0x7ff72014cf50 legacy=0x7ff720070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:09.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71effd640 1 -- 172.21.15.118:0/2668400324 >> v1:172.21.15.118:6789/0 conn(0x7ff7200713a0 legacy=0x7ff720154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71effd640 1 -- 172.21.15.118:0/2668400324 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720070770 con 0x7ff720072a70 2024-02-18T10:01:09.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.970+0000 7ff71e7fc640 1 -- 172.21.15.118:0/2668400324 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993006611 0 0) 0x7ff72006b8e0 con 0x7ff7200713a0 2024-02-18T10:01:09.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff71effd640 1 --2- 172.21.15.118:0/2668400324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff720072a70 0x7ff72014d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff7140097a0 tx=0x7ff71402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d648abb520e2ad9c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff71e7fc640 1 -- 172.21.15.118:0/2668400324 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714031830 con 0x7ff720072a70 2024-02-18T10:01:09.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff71e7fc640 1 -- 172.21.15.118:0/2668400324 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714031990 con 0x7ff720072a70 2024-02-18T10:01:09.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff71e7fc640 1 -- 172.21.15.118:0/2668400324 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714031d20 con 0x7ff720072a70 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff72613a640 1 -- 172.21.15.118:0/2668400324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff720072a70 msgr2=0x7ff72014d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff72613a640 1 --2- 172.21.15.118:0/2668400324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff720072a70 0x7ff72014d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff7140097a0 tx=0x7ff71402b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff72613a640 1 -- 172.21.15.118:0/2668400324 shutdown_connections 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff72613a640 1 --2- 172.21.15.118:0/2668400324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff720072a70 0x7ff72014d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff72613a640 1 -- 172.21.15.118:0/2668400324 >> 172.21.15.118:0/2668400324 conn(0x7ff7200ba410 msgr2=0x7ff72006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff72613a640 1 -- 172.21.15.118:0/2668400324 shutdown_connections 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.971+0000 7ff72613a640 1 -- 172.21.15.118:0/2668400324 wait complete. 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.972+0000 7ff72613a640 1 Processor -- start 2024-02-18T10:01:09.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.972+0000 7ff72613a640 1 -- start start 2024-02-18T10:01:09.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff72613a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7200713a0 0x7ff72013ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff72613a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff720072a70 0x7ff7201d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff72613a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72014cf50 0x7ff7201d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff72613a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7201d3af0 con 0x7ff72014cf50 2024-02-18T10:01:09.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff72613a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7201d2df0 con 0x7ff7200713a0 2024-02-18T10:01:09.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff72613a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7201d4510 con 0x7ff720072a70 2024-02-18T10:01:09.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72014cf50 0x7ff7201d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72014cf50 0x7ff7201d3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45862/0 (socket says 172.21.15.118:45862) 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 -- 172.21.15.118:0/2635544889 learned_addr learned my addr 172.21.15.118:0/2635544889 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 -- 172.21.15.118:0/2635544889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff720072a70 msgr2=0x7ff7201d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff720072a70 0x7ff7201d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 -- 172.21.15.118:0/2635544889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7200713a0 msgr2=0x7ff72013ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71f7fe640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7200713a0 0x7ff72013ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7200713a0 0x7ff72013ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.973+0000 7ff71ffff640 1 -- 172.21.15.118:0/2635544889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff714009400 con 0x7ff72014cf50 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.974+0000 7ff71ffff640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72014cf50 0x7ff7201d3fd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff71800c7a0 tx=0x7ff71800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.974+0000 7ff707fff640 1 -- 172.21.15.118:0/2635544889 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800a640 con 0x7ff72014cf50 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.974+0000 7ff707fff640 1 -- 172.21.15.118:0/2635544889 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800a7a0 con 0x7ff72014cf50 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.974+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7201d4b20 con 0x7ff72014cf50 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.974+0000 7ff707fff640 1 -- 172.21.15.118:0/2635544889 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800abd0 con 0x7ff72014cf50 2024-02-18T10:01:09.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.974+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7201d47e0 con 0x7ff72014cf50 2024-02-18T10:01:09.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.975+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff720075150 con 0x7ff72014cf50 2024-02-18T10:01:09.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.975+0000 7ff707fff640 1 -- 172.21.15.118:0/2635544889 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7ff71800ad30 con 0x7ff72014cf50 2024-02-18T10:01:09.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.976+0000 7ff707fff640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff70c06bc70 0x7ff70c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:09.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.976+0000 7ff71f7fe640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff70c06bc70 0x7ff70c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:09.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.976+0000 7ff707fff640 1 -- 172.21.15.118:0/2635544889 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff718089f80 con 0x7ff72014cf50 2024-02-18T10:01:09.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.976+0000 7ff71f7fe640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff70c06bc70 0x7ff70c06e130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff71000a750 tx=0x7ff710008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:09.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:09.980+0000 7ff707fff640 1 -- 172.21.15.118:0/2635544889 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7180bd8c0 con 0x7ff72014cf50 2024-02-18T10:01:10.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.149+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7201d32d0 con 0x7ff72014cf50 2024-02-18T10:01:10.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.149+0000 7ff707fff640 1 -- 172.21.15.118:0/2635544889 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7180180a0 con 0x7ff72014cf50 2024-02-18T10:01:10.152 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff70c06bc70 msgr2=0x7ff70c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff70c06bc70 0x7ff70c06e130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff71000a750 tx=0x7ff710008040 comp rx=0 tx=0).stop 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72014cf50 msgr2=0x7ff7201d3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72014cf50 0x7ff7201d3fd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff71800c7a0 tx=0x7ff71800cc60 comp rx=0 tx=0).stop 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 shutdown_connections 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff70c06bc70 0x7ff70c06e130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff72014cf50 0x7ff7201d3fd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff720072a70 0x7ff7201d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 --2- 172.21.15.118:0/2635544889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7200713a0 0x7ff72013ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 >> 172.21.15.118:0/2635544889 conn(0x7ff7200ba410 msgr2=0x7ff7200a1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 shutdown_connections 2024-02-18T10:01:10.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.151+0000 7ff72613a640 1 -- 172.21.15.118:0/2635544889 wait complete. 2024-02-18T10:01:10.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:10.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.264+0000 7fa92c3d0640 1 Processor -- start 2024-02-18T10:01:10.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.264+0000 7fa92c3d0640 1 -- start start 2024-02-18T10:01:10.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92c3d0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9240ba2a0 0x7fa924145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92c3d0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9240a1950 con 0x7fa92406dac0 2024-02-18T10:01:10.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92c3d0640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa924072830 con 0x7fa9241464f0 2024-02-18T10:01:10.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92c3d0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa924071d50 con 0x7fa9240ba2a0 2024-02-18T10:01:10.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92996b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9240ba2a0 0x7fa924145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92a16c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa92406dac0 0x7fa924070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57212/0 (socket says 172.21.15.118:57212) 2024-02-18T10:01:10.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92996b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9240ba2a0 0x7fa924145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45866/0 (socket says 172.21.15.118:45866) 2024-02-18T10:01:10.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92a16c640 1 -- 172.21.15.118:0/1125733754 learned_addr learned my addr 172.21.15.118:0/1125733754 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:10.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.265+0000 7fa92996b640 1 -- 172.21.15.118:0/1125733754 >> v1:172.21.15.164:6789/0 conn(0x7fa9241464f0 legacy=0x7fa924148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:10.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.266+0000 7fa92996b640 1 -- 172.21.15.118:0/1125733754 >> v1:172.21.15.118:6789/0 conn(0x7fa92406dac0 legacy=0x7fa924070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.266+0000 7fa92996b640 1 -- 172.21.15.118:0/1125733754 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924072030 con 0x7fa9240ba2a0 2024-02-18T10:01:10.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.266+0000 7fa92996b640 1 --2- 172.21.15.118:0/1125733754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa924145fb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa9140097a0 tx=0x7fa91402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f56da2980d3b58 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.266+0000 7fa92916a640 1 -- 172.21.15.118:0/1125733754 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914031830 con 0x7fa9240ba2a0 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.266+0000 7fa92916a640 1 -- 172.21.15.118:0/1125733754 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914031990 con 0x7fa9240ba2a0 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.266+0000 7fa92916a640 1 -- 172.21.15.118:0/1125733754 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914031d20 con 0x7fa9240ba2a0 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.267+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1125733754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 msgr2=0x7fa924145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.267+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1125733754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa924145fb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa9140097a0 tx=0x7fa91402b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.267+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1125733754 shutdown_connections 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.267+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1125733754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa924145fb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.267+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1125733754 >> 172.21.15.118:0/1125733754 conn(0x7fa9240be420 msgr2=0x7fa9240be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.267+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1125733754 shutdown_connections 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.267+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1125733754 wait complete. 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.268+0000 7fa92c3d0640 1 Processor -- start 2024-02-18T10:01:10.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.268+0000 7fa92c3d0640 1 -- start start 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa92406dac0 0x7fa9240b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa9240b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9241464f0 0x7fa9240b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240b8440 con 0x7fa9240ba2a0 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240b7ba0 con 0x7fa9241464f0 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa924145960 con 0x7fa92406dac0 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa9240b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa9240b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45872/0 (socket says 172.21.15.118:45872) 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 -- 172.21.15.118:0/1549343277 learned_addr learned my addr 172.21.15.118:0/1549343277 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92a16c640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa92406dac0 0x7fa9240b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92a96d640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9241464f0 0x7fa9240b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 -- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa92406dac0 msgr2=0x7fa9240b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa92406dac0 0x7fa9240b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 -- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9241464f0 msgr2=0x7fa9240b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9241464f0 0x7fa9240b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 -- 172.21.15.118:0/1549343277 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009400 con 0x7fa9240ba2a0 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92a96d640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9241464f0 0x7fa9240b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92996b640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa9240b4650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098c0 tx=0x7fa9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa91affd640 1 -- 172.21.15.118:0/1549343277 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91403ba70 con 0x7fa9240ba2a0 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa91affd640 1 -- 172.21.15.118:0/1549343277 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91403bbf0 con 0x7fa9240ba2a0 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9240b7e80 con 0x7fa9240ba2a0 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa91affd640 1 -- 172.21.15.118:0/1549343277 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9140453f0 con 0x7fa9240ba2a0 2024-02-18T10:01:10.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.269+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9240b4b90 con 0x7fa9240ba2a0 2024-02-18T10:01:10.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.270+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9240b82a0 con 0x7fa9240ba2a0 2024-02-18T10:01:10.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.271+0000 7fa91affd640 1 -- 172.21.15.118:0/1549343277 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fa91404e450 con 0x7fa9240ba2a0 2024-02-18T10:01:10.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.271+0000 7fa91affd640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa90806bc70 0x7fa90806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.271+0000 7fa92a16c640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa90806bc70 0x7fa90806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.271+0000 7fa91affd640 1 -- 172.21.15.118:0/1549343277 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9140ac9e0 con 0x7fa9240ba2a0 2024-02-18T10:01:10.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.271+0000 7fa92a16c640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa90806bc70 0x7fa90806e130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa920000f60 tx=0x7fa920009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.275+0000 7fa91affd640 1 -- 172.21.15.118:0/1549343277 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9240b82a0 con 0x7fa9240ba2a0 2024-02-18T10:01:10.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.447+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9240b82a0 con 0x7fa9240ba2a0 2024-02-18T10:01:10.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.447+0000 7fa91affd640 1 -- 172.21.15.118:0/1549343277 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9240b82a0 con 0x7fa9240ba2a0 2024-02-18T10:01:10.450 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa90806bc70 msgr2=0x7fa90806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa90806bc70 0x7fa90806e130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa920000f60 tx=0x7fa920009040 comp rx=0 tx=0).stop 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 msgr2=0x7fa9240b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa9240b4650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9140098c0 tx=0x7fa9140046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 shutdown_connections 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa90806bc70 0x7fa90806e130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9241464f0 0x7fa9240b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9240ba2a0 0x7fa9240b4650 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 --2- 172.21.15.118:0/1549343277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa92406dac0 0x7fa9240b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 >> 172.21.15.118:0/1549343277 conn(0x7fa9240be420 msgr2=0x7fa9240bcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 shutdown_connections 2024-02-18T10:01:10.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.449+0000 7fa92c3d0640 1 -- 172.21.15.118:0/1549343277 wait complete. 2024-02-18T10:01:10.464 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.561+0000 7f38d5172640 1 Processor -- start 2024-02-18T10:01:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.561+0000 7f38d5172640 1 -- start start 2024-02-18T10:01:10.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38d5172640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 0x7f38d00ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38d5172640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00bb2d0 con 0x7f38d014cf60 2024-02-18T10:01:10.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38d5172640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d01441a0 con 0x7f38d0143dc0 2024-02-18T10:01:10.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38d5172640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d014d480 con 0x7f38d014a3b0 2024-02-18T10:01:10.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38ce59c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f38d014cf60 0x7f38d0149ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57218/0 (socket says 172.21.15.118:57218) 2024-02-18T10:01:10.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38ce59c640 1 -- 172.21.15.118:0/3540639174 learned_addr learned my addr 172.21.15.118:0/3540639174 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38cf59e640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 0x7f38d00ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546529683 0 0) 0x7f38d00bb2d0 con 0x7f38d014cf60 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.562+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b8003520 con 0x7f38d014cf60 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164413448 0 0) 0x7f38b8003520 con 0x7f38d014cf60 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 msgr2=0x7f38d00ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 0x7f38d00ba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 >> v1:172.21.15.164:6789/0 conn(0x7f38d0143dc0 legacy=0x7f38d00babc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d014d760 con 0x7f38d014cf60 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f38c0001670 con 0x7f38d014cf60 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 >> v1:172.21.15.118:6789/0 conn(0x7f38d014cf60 legacy=0x7f38d0149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38b8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b8004350 0x7f38b8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 0x7f38b8005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d014d480 con 0x7f38b80039a0 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b800b980 con 0x7f38b8004350 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b800bb40 con 0x7f38d014a3b0 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ced9d640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38b8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ce59c640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b8004350 0x7f38b8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cf59e640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 0x7f38b8005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ced9d640 1 -- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 msgr2=0x7f38b8005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ced9d640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 0x7f38b8005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ced9d640 1 -- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b8004350 msgr2=0x7f38b8004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ced9d640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b8004350 0x7f38b8004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ced9d640 1 -- 172.21.15.118:0/3540639174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8003520 con 0x7f38b80039a0 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38cf59e640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d014a3b0 0x7f38b8005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.563+0000 7f38ce59c640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38b8004350 0x7f38b8004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.564+0000 7f38ced9d640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38b8003d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38c4001860 tx=0x7f38b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7ed2ccc28b5955 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.564+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4033630 con 0x7f38b80039a0 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.564+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c40337b0 con 0x7f38b80039a0 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.564+0000 7f38cdd9b640 1 -- 172.21.15.118:0/3540639174 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4033b60 con 0x7f38b80039a0 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.564+0000 7f38d5172640 1 -- 172.21.15.118:0/3540639174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 msgr2=0x7f38b8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.564+0000 7f38d5172640 1 --2- 172.21.15.118:0/3540639174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38b8003d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38c4001860 tx=0x7f38b80057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.564+0000 7f38cf59e640 1 -- 172.21.15.118:0/3540639174 reap_dead start 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.565+0000 7f38d5172640 1 -- 172.21.15.118:0/3540639174 shutdown_connections 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.565+0000 7f38d5172640 1 -- 172.21.15.118:0/3540639174 >> 172.21.15.118:0/3540639174 conn(0x7f38d00a11c0 msgr2=0x7f38d00a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.565+0000 7f38d5172640 1 -- 172.21.15.118:0/3540639174 shutdown_connections 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.565+0000 7f38d5172640 1 -- 172.21.15.118:0/3540639174 wait complete. 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 Processor -- start 2024-02-18T10:01:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 -- start start 2024-02-18T10:01:10.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38d0148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d00beac0 0x7f38d014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38d014bc00 0x7f38d01415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0148f90 con 0x7f38b80039a0 2024-02-18T10:01:10.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d014c080 con 0x7f38d014bc00 2024-02-18T10:01:10.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.566+0000 7f38d5172640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00bdba0 con 0x7f38d00beac0 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38d0148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38d0148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45882/0 (socket says 172.21.15.118:45882) 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 -- 172.21.15.118:0/2819633972 learned_addr learned my addr 172.21.15.118:0/2819633972 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38cf59e640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38d014bc00 0x7f38d01415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 -- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d00beac0 msgr2=0x7f38d014b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ce59c640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d00beac0 0x7f38d014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d00beac0 0x7f38d014b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 -- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38d014bc00 msgr2=0x7f38d01415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38d014bc00 0x7f38d01415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 -- 172.21.15.118:0/2819633972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00bde80 con 0x7f38b80039a0 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38cf59e640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38d014bc00 0x7f38d01415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ce59c640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d00beac0 0x7f38d014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38ced9d640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38d0148a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38c402bdf0 tx=0x7f38c4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38b77fe640 1 -- 172.21.15.118:0/2819633972 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40035f0 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38b77fe640 1 -- 172.21.15.118:0/2819633972 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4003750 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d00be160 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38b77fe640 1 -- 172.21.15.118:0/2819633972 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4003ae0 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.567+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d013e150 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.568+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d0074af0 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.569+0000 7f38b77fe640 1 -- 172.21.15.118:0/2819633972 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f38c4003c40 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.569+0000 7f38b77fe640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f38bc06bc70 0x7f38bc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.569+0000 7f38b77fe640 1 -- 172.21.15.118:0/2819633972 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38c40ac4e0 con 0x7f38b80039a0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.569+0000 7f38ce59c640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f38bc06bc70 0x7f38bc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.569+0000 7f38ce59c640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f38bc06bc70 0x7f38bc06e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38c0001eb0 tx=0x7f38c0000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.573+0000 7f38b77fe640 1 -- 172.21.15.118:0/2819633972 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38c4076d50 con 0x7f38b80039a0 2024-02-18T10:01:10.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.744+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38d01410c0 con 0x7f38b80039a0 2024-02-18T10:01:10.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.745+0000 7f38b77fe640 1 -- 172.21.15.118:0/2819633972 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f38c407a410 con 0x7f38b80039a0 2024-02-18T10:01:10.748 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:10.748 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f38bc06bc70 msgr2=0x7f38bc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f38bc06bc70 0x7f38bc06e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38c0001eb0 tx=0x7f38c0000ed0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 msgr2=0x7f38d0148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38d0148a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f38c402bdf0 tx=0x7f38c4001230 comp rx=0 tx=0).stop 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 shutdown_connections 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f38bc06bc70 0x7f38bc06e130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38d014bc00 0x7f38d01415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f38d00beac0 0x7f38d014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 --2- 172.21.15.118:0/2819633972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f38b80039a0 0x7f38d0148a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 >> 172.21.15.118:0/2819633972 conn(0x7f38d00a11c0 msgr2=0x7f38d00bc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 shutdown_connections 2024-02-18T10:01:10.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.747+0000 7f38d5172640 1 -- 172.21.15.118:0/2819633972 wait complete. 2024-02-18T10:01:10.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:10.761 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:10.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.861+0000 7f892c6c0640 1 Processor -- start 2024-02-18T10:01:10.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.861+0000 7f892c6c0640 1 -- start start 2024-02-18T10:01:10.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892c6c0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f89240ba2a0 0x7f8924145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892c6c0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f8924148b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892c6c0640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240a1950 con 0x7f892406dac0 2024-02-18T10:01:10.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892c6c0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8924072830 con 0x7f89240ba2a0 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892c6c0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8924071d50 con 0x7f89241464f0 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f8929c5b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f89240ba2a0 0x7f8924145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892ac5d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f8924148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892ac5d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f8924148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:60688/0 (socket says 172.21.15.118:60688) 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.862+0000 7f892ac5d640 1 -- 172.21.15.118:0/1767911103 learned_addr learned my addr 172.21.15.118:0/1767911103 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.863+0000 7f8929c5b640 1 -- 172.21.15.118:0/1767911103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 msgr2=0x7f8924148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.863+0000 7f8929c5b640 1 --2- 172.21.15.118:0/1767911103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f8924148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.863+0000 7f8929c5b640 1 -- 172.21.15.118:0/1767911103 >> v1:172.21.15.164:6789/0 conn(0x7f892406dac0 legacy=0x7f8924070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.863+0000 7f8929c5b640 1 -- 172.21.15.118:0/1767911103 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924072030 con 0x7f89240ba2a0 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.863+0000 7f8929c5b640 1 --2- 172.21.15.118:0/1767911103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89240ba2a0 0x7f8924145fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89140097a0 tx=0x7f891402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df22484b0aeafdb2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892945a640 1 -- 172.21.15.118:0/1767911103 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914030610 con 0x7f89240ba2a0 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892945a640 1 -- 172.21.15.118:0/1767911103 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914030770 con 0x7f89240ba2a0 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892945a640 1 -- 172.21.15.118:0/1767911103 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914030b00 con 0x7f89240ba2a0 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 -- 172.21.15.118:0/1767911103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89240ba2a0 msgr2=0x7f8924145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 --2- 172.21.15.118:0/1767911103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89240ba2a0 0x7f8924145fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89140097a0 tx=0x7f891402b960 comp rx=0 tx=0).stop 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 -- 172.21.15.118:0/1767911103 shutdown_connections 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 --2- 172.21.15.118:0/1767911103 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f8924148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 --2- 172.21.15.118:0/1767911103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89240ba2a0 0x7f8924145fb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 -- 172.21.15.118:0/1767911103 >> 172.21.15.118:0/1767911103 conn(0x7f89240be420 msgr2=0x7f89240be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 -- 172.21.15.118:0/1767911103 shutdown_connections 2024-02-18T10:01:10.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.864+0000 7f892c6c0640 1 -- 172.21.15.118:0/1767911103 wait complete. 2024-02-18T10:01:10.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.865+0000 7f892c6c0640 1 Processor -- start 2024-02-18T10:01:10.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.865+0000 7f892c6c0640 1 -- start start 2024-02-18T10:01:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f892c6c0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f892406dac0 0x7f89241477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f892c6c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89240ba2a0 0x7f89241e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f892c6c0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f89241e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f892c6c0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8924147d10 con 0x7f89240ba2a0 2024-02-18T10:01:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f892c6c0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8924141870 con 0x7f892406dac0 2024-02-18T10:01:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f892c6c0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8924143220 con 0x7f89241464f0 2024-02-18T10:01:10.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89240ba2a0 0x7f89241e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89240ba2a0 0x7f89241e2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45894/0 (socket says 172.21.15.118:45894) 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 -- 172.21.15.118:0/2230029382 learned_addr learned my addr 172.21.15.118:0/2230029382 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f892ac5d640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f89241e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 -- 172.21.15.118:0/2230029382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 msgr2=0x7f89241e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f89241e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 -- 172.21.15.118:0/2230029382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f892406dac0 msgr2=0x7f89241477d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f892406dac0 0x7f89241477d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.866+0000 7f8929c5b640 1 -- 172.21.15.118:0/2230029382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8914009400 con 0x7f89240ba2a0 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.867+0000 7f8929c5b640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89240ba2a0 0x7f89241e2fc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f891402bf70 tx=0x7f8914004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.867+0000 7f891affd640 1 -- 172.21.15.118:0/2230029382 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891403e040 con 0x7f89240ba2a0 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.867+0000 7f891affd640 1 -- 172.21.15.118:0/2230029382 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914039cb0 con 0x7f89240ba2a0 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.867+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8924143500 con 0x7f89240ba2a0 2024-02-18T10:01:10.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.867+0000 7f891affd640 1 -- 172.21.15.118:0/2230029382 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914044630 con 0x7f89240ba2a0 2024-02-18T10:01:10.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.867+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8924142c80 con 0x7f89240ba2a0 2024-02-18T10:01:10.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.868+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8924143a20 con 0x7f89240ba2a0 2024-02-18T10:01:10.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.868+0000 7f891affd640 1 -- 172.21.15.118:0/2230029382 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f891404d3b0 con 0x7f89240ba2a0 2024-02-18T10:01:10.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.869+0000 7f891affd640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f890806bc70 0x7f890806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:10.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.869+0000 7f891affd640 1 -- 172.21.15.118:0/2230029382 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89140acd50 con 0x7f89240ba2a0 2024-02-18T10:01:10.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.869+0000 7f892a45c640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f890806bc70 0x7f890806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:10.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.869+0000 7f892a45c640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f890806bc70 0x7f890806e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8920001be0 tx=0x7f8920007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:10.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:10.873+0000 7f891affd640 1 -- 172.21.15.118:0/2230029382 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8924143a20 con 0x7f89240ba2a0 2024-02-18T10:01:11.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.041+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8924143a20 con 0x7f89240ba2a0 2024-02-18T10:01:11.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.041+0000 7f891affd640 1 -- 172.21.15.118:0/2230029382 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8924143a20 con 0x7f89240ba2a0 2024-02-18T10:01:11.044 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f890806bc70 msgr2=0x7f890806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f890806bc70 0x7f890806e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8920001be0 tx=0x7f8920007d50 comp rx=0 tx=0).stop 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89240ba2a0 msgr2=0x7f89241e2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89240ba2a0 0x7f89241e2fc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f891402bf70 tx=0x7f8914004730 comp rx=0 tx=0).stop 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 shutdown_connections 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f890806bc70 0x7f890806e130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89241464f0 0x7f89241e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89240ba2a0 0x7f89241e2fc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 --2- 172.21.15.118:0/2230029382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f892406dac0 0x7f89241477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 >> 172.21.15.118:0/2230029382 conn(0x7f89240be420 msgr2=0x7f892406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 shutdown_connections 2024-02-18T10:01:11.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.043+0000 7f892c6c0640 1 -- 172.21.15.118:0/2230029382 wait complete. 2024-02-18T10:01:11.056 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:11.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.156+0000 7f140c6df640 1 Processor -- start 2024-02-18T10:01:11.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.156+0000 7f140c6df640 1 -- start start 2024-02-18T10:01:11.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.156+0000 7f140c6df640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f14040a0920 0x7f140414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.156+0000 7f140c6df640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f14040ba8c0 0x7f14040bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.156+0000 7f140c6df640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140406bb30 con 0x7f1404145ea0 2024-02-18T10:01:11.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.156+0000 7f140c6df640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14040bed40 con 0x7f14040a0920 2024-02-18T10:01:11.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.156+0000 7f140c6df640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140406bdb0 con 0x7f14040ba8c0 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f1409c7a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f14040a0920 0x7f140414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f140a47b640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1404145ea0 0x7f14040be630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57232/0 (socket says 172.21.15.118:57232) 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f140a47b640 1 -- 172.21.15.118:0/3092521012 learned_addr learned my addr 172.21.15.118:0/3092521012 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f140ac7c640 1 --2- 172.21.15.118:0/3092521012 >> v2:172.21.15.164:3300/0 conn(0x7f14040ba8c0 0x7f14040bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f1409c7a640 1 -- 172.21.15.118:0/3092521012 >> v2:172.21.15.164:3300/0 conn(0x7f14040ba8c0 msgr2=0x7f14040bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f1409c7a640 1 --2- 172.21.15.118:0/3092521012 >> v2:172.21.15.164:3300/0 conn(0x7f14040ba8c0 0x7f14040bad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f1409c7a640 1 -- 172.21.15.118:0/3092521012 >> v1:172.21.15.118:6789/0 conn(0x7f1404145ea0 legacy=0x7f14040be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f1409c7a640 1 -- 172.21.15.118:0/3092521012 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140406c090 con 0x7f14040a0920 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.157+0000 7f1409479640 1 -- 172.21.15.118:0/3092521012 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409375280 0 0) 0x7f140406bb30 con 0x7f1404145ea0 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f1409c7a640 1 --2- 172.21.15.118:0/3092521012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f140414c3d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14040bc340 tx=0x7f13f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bf76ac91144f42 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f1409479640 1 -- 172.21.15.118:0/3092521012 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4031830 con 0x7f14040a0920 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f1409479640 1 -- 172.21.15.118:0/3092521012 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f4031990 con 0x7f14040a0920 2024-02-18T10:01:11.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f1409479640 1 -- 172.21.15.118:0/3092521012 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4031d20 con 0x7f14040a0920 2024-02-18T10:01:11.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 -- 172.21.15.118:0/3092521012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 msgr2=0x7f140414c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 --2- 172.21.15.118:0/3092521012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f140414c3d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14040bc340 tx=0x7f13f402b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 -- 172.21.15.118:0/3092521012 shutdown_connections 2024-02-18T10:01:11.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 --2- 172.21.15.118:0/3092521012 >> v2:172.21.15.164:3300/0 conn(0x7f14040ba8c0 0x7f14040bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 --2- 172.21.15.118:0/3092521012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f140414c3d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 -- 172.21.15.118:0/3092521012 >> 172.21.15.118:0/3092521012 conn(0x7f14040c1ad0 msgr2=0x7f14040bdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 -- 172.21.15.118:0/3092521012 shutdown_connections 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.158+0000 7f140c6df640 1 -- 172.21.15.118:0/3092521012 wait complete. 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.159+0000 7f140c6df640 1 Processor -- start 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.159+0000 7f140c6df640 1 -- start start 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140c6df640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f14040b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140c6df640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14040ba8c0 0x7f14041d6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140c6df640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1404145ea0 0x7f140414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140c6df640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040ba0d0 con 0x7f14040a0920 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140c6df640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14041d5cb0 con 0x7f14040ba8c0 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140c6df640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14041d4fb0 con 0x7f1404145ea0 2024-02-18T10:01:11.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f14040b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f14040b9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45914/0 (socket says 172.21.15.118:45914) 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 -- 172.21.15.118:0/3007237864 learned_addr learned my addr 172.21.15.118:0/3007237864 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 -- 172.21.15.118:0/3007237864 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1404145ea0 msgr2=0x7f140414df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1404145ea0 0x7f140414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 -- 172.21.15.118:0/3007237864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14040ba8c0 msgr2=0x7f14041d6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14040ba8c0 0x7f14041d6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 -- 172.21.15.118:0/3007237864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4009400 con 0x7f14040a0920 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.160+0000 7f140a47b640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f14040b9b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f140000c430 tx=0x7f140000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.161+0000 7f13faffd640 1 -- 172.21.15.118:0/3007237864 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14000074e0 con 0x7f14040a0920 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.161+0000 7f13faffd640 1 -- 172.21.15.118:0/3007237864 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1400007660 con 0x7f14040a0920 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.161+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14040a7120 con 0x7f14040a0920 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.161+0000 7f13faffd640 1 -- 172.21.15.118:0/3007237864 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400004a20 con 0x7f14040a0920 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.161+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14040a6e40 con 0x7f14040a0920 2024-02-18T10:01:11.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.162+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1404075150 con 0x7f14040a0920 2024-02-18T10:01:11.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.162+0000 7f13faffd640 1 -- 172.21.15.118:0/3007237864 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f1400004b80 con 0x7f14040a0920 2024-02-18T10:01:11.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.162+0000 7f13faffd640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f13e806bc70 0x7f13e806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.162+0000 7f1409c7a640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f13e806bc70 0x7f13e806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.162+0000 7f13faffd640 1 -- 172.21.15.118:0/3007237864 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f140008a500 con 0x7f14040a0920 2024-02-18T10:01:11.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.163+0000 7f1409c7a640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f13e806bc70 0x7f13e806e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13f4036000 tx=0x7f13f4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.167+0000 7f13faffd640 1 -- 172.21.15.118:0/3007237864 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1400054d70 con 0x7f14040a0920 2024-02-18T10:01:11.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.340+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14041d6570 con 0x7f14040a0920 2024-02-18T10:01:11.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.340+0000 7f13faffd640 1 -- 172.21.15.118:0/3007237864 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1400058430 con 0x7f14040a0920 2024-02-18T10:01:11.343 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:11.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f13e806bc70 msgr2=0x7f13e806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f13e806bc70 0x7f13e806e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13f4036000 tx=0x7f13f4030000 comp rx=0 tx=0).stop 2024-02-18T10:01:11.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 msgr2=0x7f14040b9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f14040b9b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f140000c430 tx=0x7f140000c8f0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 shutdown_connections 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f13e806bc70 0x7f13e806e130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1404145ea0 0x7f140414df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14040ba8c0 0x7f14041d6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 --2- 172.21.15.118:0/3007237864 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14040a0920 0x7f14040b9b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 >> 172.21.15.118:0/3007237864 conn(0x7f14040c1ad0 msgr2=0x7f1404145180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 shutdown_connections 2024-02-18T10:01:11.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.342+0000 7f140c6df640 1 -- 172.21.15.118:0/3007237864 wait complete. 2024-02-18T10:01:11.356 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:11.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.455+0000 7f87f0e55640 1 Processor -- start 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.455+0000 7f87f0e55640 1 -- start start 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87f0e55640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87ec14c870 0x7f87ec06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87f0e55640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f87ec06b700 0x7f87ec0bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87f0e55640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06bb40 0x7f87ec0c0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87f0e55640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0bda50 con 0x7f87ec14c870 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87f0e55640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec06cf20 con 0x7f87ec06b700 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87f0e55640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec06d130 con 0x7f87ec06bb40 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87ea59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87ec14c870 0x7f87ec06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87ea59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87ec14c870 0x7f87ec06c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45924/0 (socket says 172.21.15.118:45924) 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.456+0000 7f87ea59c640 1 -- 172.21.15.118:0/856593665 learned_addr learned my addr 172.21.15.118:0/856593665 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87ea59c640 1 -- 172.21.15.118:0/856593665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06bb40 msgr2=0x7f87ec0c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87ea59c640 1 --2- 172.21.15.118:0/856593665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06bb40 0x7f87ec0c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87e9d9b640 1 --2- 172.21.15.118:0/856593665 >> v2:172.21.15.164:3300/0 conn(0x7f87ec06b700 0x7f87ec0bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87ea59c640 1 -- 172.21.15.118:0/856593665 >> v2:172.21.15.164:3300/0 conn(0x7f87ec06b700 msgr2=0x7f87ec0bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87ea59c640 1 --2- 172.21.15.118:0/856593665 >> v2:172.21.15.164:3300/0 conn(0x7f87ec06b700 0x7f87ec0bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87ea59c640 1 -- 172.21.15.118:0/856593665 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0bdc30 con 0x7f87ec14c870 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87e9d9b640 1 --2- 172.21.15.118:0/856593665 >> v2:172.21.15.164:3300/0 conn(0x7f87ec06b700 0x7f87ec0bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87ea59c640 1 --2- 172.21.15.118:0/856593665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec06c9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0bd790 tx=0x7f87e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb7b7eea43c4250 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.457+0000 7f87e959a640 1 -- 172.21.15.118:0/856593665 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0030860 con 0x7f87ec14c870 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87e959a640 1 -- 172.21.15.118:0/856593665 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00309c0 con 0x7f87ec14c870 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87e959a640 1 -- 172.21.15.118:0/856593665 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0030d50 con 0x7f87ec14c870 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 -- 172.21.15.118:0/856593665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 msgr2=0x7f87ec06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 --2- 172.21.15.118:0/856593665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec06c9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0bd790 tx=0x7f87e002b9a0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 -- 172.21.15.118:0/856593665 shutdown_connections 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 --2- 172.21.15.118:0/856593665 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06bb40 0x7f87ec0c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 --2- 172.21.15.118:0/856593665 >> v2:172.21.15.164:3300/0 conn(0x7f87ec06b700 0x7f87ec0bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 --2- 172.21.15.118:0/856593665 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec06c9e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 -- 172.21.15.118:0/856593665 >> 172.21.15.118:0/856593665 conn(0x7f87ec0c1650 msgr2=0x7f87ec0c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 -- 172.21.15.118:0/856593665 shutdown_connections 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.458+0000 7f87f0e55640 1 -- 172.21.15.118:0/856593665 wait complete. 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.459+0000 7f87f0e55640 1 Processor -- start 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.459+0000 7f87f0e55640 1 -- start start 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87f0e55640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06b700 0x7f87ec0bab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87f0e55640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87ec06bb40 0x7f87ec1e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87f0e55640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec1d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87f0e55640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0bb0b0 con 0x7f87ec14c870 2024-02-18T10:01:11.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87f0e55640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1e1d20 con 0x7f87ec06bb40 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87f0e55640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1d2130 con 0x7f87ec06b700 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec1d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec1d6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45934/0 (socket says 172.21.15.118:45934) 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 -- 172.21.15.118:0/3696546740 learned_addr learned my addr 172.21.15.118:0/3696546740 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 -- 172.21.15.118:0/3696546740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06b700 msgr2=0x7f87ec0bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06b700 0x7f87ec0bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87e9d9b640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87ec06bb40 0x7f87ec1e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 -- 172.21.15.118:0/3696546740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87ec06bb40 msgr2=0x7f87ec1e17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87ec06bb40 0x7f87ec1e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 -- 172.21.15.118:0/3696546740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00094d0 con 0x7f87ec14c870 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.460+0000 7f87ead9d640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec1d6d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87e400b970 tx=0x7f87e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.461+0000 7f87daffd640 1 -- 172.21.15.118:0/3696546740 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400cb40 con 0x7f87ec14c870 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.461+0000 7f87daffd640 1 -- 172.21.15.118:0/3696546740 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e400ccc0 con 0x7f87ec14c870 2024-02-18T10:01:11.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.461+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec1d2410 con 0x7f87ec14c870 2024-02-18T10:01:11.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.461+0000 7f87daffd640 1 -- 172.21.15.118:0/3696546740 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4014680 con 0x7f87ec14c870 2024-02-18T10:01:11.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.461+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec1d2fa0 con 0x7f87ec14c870 2024-02-18T10:01:11.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.462+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec075150 con 0x7f87ec14c870 2024-02-18T10:01:11.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.462+0000 7f87daffd640 1 -- 172.21.15.118:0/3696546740 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f87e401d3b0 con 0x7f87ec14c870 2024-02-18T10:01:11.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.462+0000 7f87daffd640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87cc06bc70 0x7f87cc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.462+0000 7f87daffd640 1 -- 172.21.15.118:0/3696546740 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87e408a6f0 con 0x7f87ec14c870 2024-02-18T10:01:11.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.463+0000 7f87ea59c640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87cc06bc70 0x7f87cc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.463+0000 7f87ea59c640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87cc06bc70 0x7f87cc06e130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87e0036000 tx=0x7f87e003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.467+0000 7f87daffd640 1 -- 172.21.15.118:0/3696546740 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87e4054ed0 con 0x7f87ec14c870 2024-02-18T10:01:11.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.637+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87ec1d31c0 con 0x7f87ec14c870 2024-02-18T10:01:11.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.638+0000 7f87daffd640 1 -- 172.21.15.118:0/3696546740 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87e4019020 con 0x7f87ec14c870 2024-02-18T10:01:11.641 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87cc06bc70 msgr2=0x7f87cc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87cc06bc70 0x7f87cc06e130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f87e0036000 tx=0x7f87e003b040 comp rx=0 tx=0).stop 2024-02-18T10:01:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 msgr2=0x7f87ec1d6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec1d6d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87e400b970 tx=0x7f87e400be30 comp rx=0 tx=0).stop 2024-02-18T10:01:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 shutdown_connections 2024-02-18T10:01:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87cc06bc70 0x7f87cc06e130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87ec14c870 0x7f87ec1d6d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87ec06bb40 0x7f87ec1e17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 --2- 172.21.15.118:0/3696546740 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87ec06b700 0x7f87ec0bab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.639+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 >> 172.21.15.118:0/3696546740 conn(0x7f87ec0c1650 msgr2=0x7f87ec0bb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:11.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.640+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 shutdown_connections 2024-02-18T10:01:11.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.640+0000 7f87f0e55640 1 -- 172.21.15.118:0/3696546740 wait complete. 2024-02-18T10:01:11.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:11.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.751+0000 7fae478a3640 1 Processor -- start 2024-02-18T10:01:11.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.751+0000 7fae478a3640 1 -- start start 2024-02-18T10:01:11.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.751+0000 7fae478a3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae40145f80 0x7fae4006eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.751+0000 7fae478a3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fae400bab60 0x7fae4014f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae478a3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4014f240 con 0x7fae400baf80 2024-02-18T10:01:11.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae478a3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4006f080 con 0x7fae400bab60 2024-02-18T10:01:11.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae478a3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4006f260 con 0x7fae40145f80 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae44e3e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fae400bab60 0x7fae4014f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae45e40640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fae400baf80 0x7fae40072090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57240/0 (socket says 172.21.15.118:57240) 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae44e3e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fae400bab60 0x7fae4014f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45940/0 (socket says 172.21.15.118:45940) 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae45e40640 1 -- 172.21.15.118:0/1206680806 learned_addr learned my addr 172.21.15.118:0/1206680806 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae4563f640 1 --2- 172.21.15.118:0/1206680806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae40145f80 0x7fae4006eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae44e3e640 1 -- 172.21.15.118:0/1206680806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae40145f80 msgr2=0x7fae4006eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae44e3e640 1 --2- 172.21.15.118:0/1206680806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae40145f80 0x7fae4006eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae44e3e640 1 -- 172.21.15.118:0/1206680806 >> v1:172.21.15.118:6789/0 conn(0x7fae400baf80 legacy=0x7fae40072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae44e3e640 1 -- 172.21.15.118:0/1206680806 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4006f540 con 0x7fae400bab60 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.752+0000 7fae37fff640 1 -- 172.21.15.118:0/1206680806 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566706055 0 0) 0x7fae4014f240 con 0x7fae400baf80 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae44e3e640 1 --2- 172.21.15.118:0/1206680806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4014f6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae300097a0 tx=0x7fae3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19986e15e6657044 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae37fff640 1 -- 172.21.15.118:0/1206680806 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30031830 con 0x7fae400bab60 2024-02-18T10:01:11.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae37fff640 1 -- 172.21.15.118:0/1206680806 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30031990 con 0x7fae400bab60 2024-02-18T10:01:11.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae37fff640 1 -- 172.21.15.118:0/1206680806 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30031d20 con 0x7fae400bab60 2024-02-18T10:01:11.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae478a3640 1 -- 172.21.15.118:0/1206680806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 msgr2=0x7fae4014f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae478a3640 1 --2- 172.21.15.118:0/1206680806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4014f6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae300097a0 tx=0x7fae3002b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae478a3640 1 -- 172.21.15.118:0/1206680806 shutdown_connections 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae478a3640 1 --2- 172.21.15.118:0/1206680806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4014f6d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae478a3640 1 --2- 172.21.15.118:0/1206680806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae40145f80 0x7fae4006eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.753+0000 7fae478a3640 1 -- 172.21.15.118:0/1206680806 >> 172.21.15.118:0/1206680806 conn(0x7fae400a11c0 msgr2=0x7fae400a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.754+0000 7fae478a3640 1 -- 172.21.15.118:0/1206680806 shutdown_connections 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.754+0000 7fae478a3640 1 -- 172.21.15.118:0/1206680806 wait complete. 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.754+0000 7fae478a3640 1 Processor -- start 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae478a3640 1 -- start start 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae478a3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4009ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae478a3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae400baf80 0x7fae401e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae478a3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae40145f80 0x7fae401e2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae478a3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4009ef90 con 0x7fae400bab60 2024-02-18T10:01:11.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae478a3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae401e1a90 con 0x7fae40145f80 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae478a3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4009f1f0 con 0x7fae400baf80 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4009ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4009ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45950/0 (socket says 172.21.15.118:45950) 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 -- 172.21.15.118:0/3014518339 learned_addr learned my addr 172.21.15.118:0/3014518339 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae45e40640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae40145f80 0x7fae401e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae44e3e640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae400baf80 0x7fae401e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 -- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae400baf80 msgr2=0x7fae401e1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae400baf80 0x7fae401e1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 -- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae40145f80 msgr2=0x7fae401e2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae40145f80 0x7fae401e2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.755+0000 7fae4563f640 1 -- 172.21.15.118:0/3014518339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30009400 con 0x7fae400bab60 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.756+0000 7fae4563f640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4009ea50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00e870 tx=0x7fae3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.756+0000 7fae35ffb640 1 -- 172.21.15.118:0/3014518339 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0094f0 con 0x7fae400bab60 2024-02-18T10:01:11.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.756+0000 7fae35ffb640 1 -- 172.21.15.118:0/3014518339 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c00c940 con 0x7fae400bab60 2024-02-18T10:01:11.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.756+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4009fd30 con 0x7fae400bab60 2024-02-18T10:01:11.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.756+0000 7fae35ffb640 1 -- 172.21.15.118:0/3014518339 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00ccf0 con 0x7fae400bab60 2024-02-18T10:01:11.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.756+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae400a02f0 con 0x7fae400bab60 2024-02-18T10:01:11.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.757+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae40074af0 con 0x7fae400bab60 2024-02-18T10:01:11.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.757+0000 7fae35ffb640 1 -- 172.21.15.118:0/3014518339 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fae3c013470 con 0x7fae400bab60 2024-02-18T10:01:11.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.758+0000 7fae35ffb640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fae2406bc70 0x7fae2406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:11.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.758+0000 7fae35ffb640 1 -- 172.21.15.118:0/3014518339 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae3c08a860 con 0x7fae400bab60 2024-02-18T10:01:11.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.758+0000 7fae44e3e640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fae2406bc70 0x7fae2406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:11.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.758+0000 7fae44e3e640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fae2406bc70 0x7fae2406e130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae30036000 tx=0x7fae30008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:11.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.762+0000 7fae35ffb640 1 -- 172.21.15.118:0/3014518339 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae3c055040 con 0x7fae400bab60 2024-02-18T10:01:11.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.937+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae4006fb90 con 0x7fae400bab60 2024-02-18T10:01:11.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.938+0000 7fae35ffb640 1 -- 172.21.15.118:0/3014518339 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fae3c058700 con 0x7fae400bab60 2024-02-18T10:01:11.941 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:11.941 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:11.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fae2406bc70 msgr2=0x7fae2406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fae2406bc70 0x7fae2406e130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae30036000 tx=0x7fae30008030 comp rx=0 tx=0).stop 2024-02-18T10:01:11.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 msgr2=0x7fae4009ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:11.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4009ea50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00e870 tx=0x7fae3c00ed30 comp rx=0 tx=0).stop 2024-02-18T10:01:11.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 shutdown_connections 2024-02-18T10:01:11.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fae2406bc70 0x7fae2406e130 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fae40145f80 0x7fae401e2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fae400baf80 0x7fae401e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 --2- 172.21.15.118:0/3014518339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae400bab60 0x7fae4009ea50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:11.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 >> 172.21.15.118:0/3014518339 conn(0x7fae400a11c0 msgr2=0x7fae4006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:11.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 shutdown_connections 2024-02-18T10:01:11.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:11.940+0000 7fae478a3640 1 -- 172.21.15.118:0/3014518339 wait complete. 2024-02-18T10:01:11.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:11.954 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:12.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.054+0000 7f1457993640 1 Processor -- start 2024-02-18T10:01:12.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.054+0000 7f1457993640 1 -- start start 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1457993640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f14500711e0 0x7f145014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1457993640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1450072be0 0x7f14500b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1457993640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145006b3f0 con 0x7f145006af80 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1457993640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500bab50 con 0x7f1450072be0 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1457993640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500ba680 con 0x7f14500711e0 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1454f2e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1450072be0 0x7f14500b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1454f2e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1450072be0 0x7f14500b91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45960/0 (socket says 172.21.15.118:45960) 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1454f2e640 1 -- 172.21.15.118:0/2536008947 learned_addr learned my addr 172.21.15.118:0/2536008947 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f145572f640 1 --2- 172.21.15.118:0/2536008947 >> v2:172.21.15.164:3300/0 conn(0x7f14500711e0 0x7f145014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1454f2e640 1 -- 172.21.15.118:0/2536008947 >> v2:172.21.15.164:3300/0 conn(0x7f14500711e0 msgr2=0x7f145014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1454f2e640 1 --2- 172.21.15.118:0/2536008947 >> v2:172.21.15.164:3300/0 conn(0x7f14500711e0 0x7f145014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1454f2e640 1 -- 172.21.15.118:0/2536008947 >> v1:172.21.15.118:6789/0 conn(0x7f145006af80 legacy=0x7f1450149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1447fff640 1 -- 172.21.15.118:0/2536008947 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395666480 0 0) 0x7f145006b3f0 con 0x7f145006af80 2024-02-18T10:01:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.055+0000 7f1454f2e640 1 -- 172.21.15.118:0/2536008947 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500ba280 con 0x7f1450072be0 2024-02-18T10:01:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.056+0000 7f1454f2e640 1 --2- 172.21.15.118:0/2536008947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450072be0 0x7f14500b91e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f145006bcc0 tx=0x7f144002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda64c782b37382e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.056+0000 7f1447fff640 1 -- 172.21.15.118:0/2536008947 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440030860 con 0x7f1450072be0 2024-02-18T10:01:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.056+0000 7f1447fff640 1 -- 172.21.15.118:0/2536008947 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14400309c0 con 0x7f1450072be0 2024-02-18T10:01:12.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.056+0000 7f1447fff640 1 -- 172.21.15.118:0/2536008947 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440030d50 con 0x7f1450072be0 2024-02-18T10:01:12.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 -- 172.21.15.118:0/2536008947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450072be0 msgr2=0x7f14500b91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 --2- 172.21.15.118:0/2536008947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450072be0 0x7f14500b91e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f145006bcc0 tx=0x7f144002b9a0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 -- 172.21.15.118:0/2536008947 shutdown_connections 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 --2- 172.21.15.118:0/2536008947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450072be0 0x7f14500b91e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 --2- 172.21.15.118:0/2536008947 >> v2:172.21.15.164:3300/0 conn(0x7f14500711e0 0x7f145014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 -- 172.21.15.118:0/2536008947 >> 172.21.15.118:0/2536008947 conn(0x7f14500be420 msgr2=0x7f14500be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 -- 172.21.15.118:0/2536008947 shutdown_connections 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.057+0000 7f1457993640 1 -- 172.21.15.118:0/2536008947 wait complete. 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.058+0000 7f1457993640 1 Processor -- start 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.058+0000 7f1457993640 1 -- start start 2024-02-18T10:01:12.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006af80 0x7f145014f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500711e0 0x7f145009fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1450072be0 0x7f14500a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145014fd70 con 0x7f145006af80 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14500a3820 con 0x7f14500711e0 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14500a02e0 con 0x7f1450072be0 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006af80 0x7f145014f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006af80 0x7f145014f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45974/0 (socket says 172.21.15.118:45974) 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 -- 172.21.15.118:0/329299677 learned_addr learned my addr 172.21.15.118:0/329299677 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1454f2e640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500711e0 0x7f145009fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 -- 172.21.15.118:0/329299677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1450072be0 msgr2=0x7f14500a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1450072be0 0x7f14500a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 -- 172.21.15.118:0/329299677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500711e0 msgr2=0x7f145009fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500711e0 0x7f145009fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 -- 172.21.15.118:0/329299677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400094d0 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f145572f640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006af80 0x7f145014f830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f144c007ef0 tx=0x7f144c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1445ffb640 1 -- 172.21.15.118:0/329299677 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c014620 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1445ffb640 1 -- 172.21.15.118:0/329299677 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c014780 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14500a4310 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1445ffb640 1 -- 172.21.15.118:0/329299677 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c014b30 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.059+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14500a3a70 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.060+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1450075150 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.061+0000 7f1445ffb640 1 -- 172.21.15.118:0/329299677 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f144c014c90 con 0x7f145006af80 2024-02-18T10:01:12.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.061+0000 7f1445ffb640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143406bca0 0x7f143406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.061+0000 7f1445ffb640 1 -- 172.21.15.118:0/329299677 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f144c08b120 con 0x7f145006af80 2024-02-18T10:01:12.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.061+0000 7f1454f2e640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143406bca0 0x7f143406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.061+0000 7f1454f2e640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143406bca0 0x7f143406e160 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1440036000 tx=0x7f144003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.065+0000 7f1445ffb640 1 -- 172.21.15.118:0/329299677 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f144c055990 con 0x7f145006af80 2024-02-18T10:01:12.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.237+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1450074af0 con 0x7f145006af80 2024-02-18T10:01:12.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.237+0000 7f1445ffb640 1 -- 172.21.15.118:0/329299677 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f144c059050 con 0x7f145006af80 2024-02-18T10:01:12.240 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:12.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143406bca0 msgr2=0x7f143406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143406bca0 0x7f143406e160 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1440036000 tx=0x7f144003b040 comp rx=0 tx=0).stop 2024-02-18T10:01:12.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006af80 msgr2=0x7f145014f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006af80 0x7f145014f830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f144c007ef0 tx=0x7f144c00e4b0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 shutdown_connections 2024-02-18T10:01:12.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143406bca0 0x7f143406e160 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1450072be0 0x7f14500a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500711e0 0x7f145009fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 --2- 172.21.15.118:0/329299677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006af80 0x7f145014f830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.239+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 >> 172.21.15.118:0/329299677 conn(0x7f14500be420 msgr2=0x7f14500bc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:12.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.240+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 shutdown_connections 2024-02-18T10:01:12.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.240+0000 7f1457993640 1 -- 172.21.15.118:0/329299677 wait complete. 2024-02-18T10:01:12.253 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.352+0000 7f7115ed4640 1 Processor -- start 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f7115ed4640 1 -- start start 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f7115ed4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711014c870 0x7f711006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f7115ed4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71100c0220 0x7f7110156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f7115ed4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711006d130 con 0x7f711006b700 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f7115ed4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71100bda50 con 0x7f71100c0220 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f7115ed4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711006cf20 con 0x7f711014c870 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f710ffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71100c0220 0x7f7110156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f710effd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f711006b700 0x7f71100bfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57258/0 (socket says 172.21.15.118:57258) 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.353+0000 7f710effd640 1 -- 172.21.15.118:0/1226500224 learned_addr learned my addr 172.21.15.118:0/1226500224 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710f7fe640 1 --2- 172.21.15.118:0/1226500224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711014c870 0x7f711006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710ffff640 1 -- 172.21.15.118:0/1226500224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711014c870 msgr2=0x7f711006c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710e7fc640 1 -- 172.21.15.118:0/1226500224 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994273865 0 0) 0x7f711006d130 con 0x7f711006b700 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710ffff640 1 --2- 172.21.15.118:0/1226500224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711014c870 0x7f711006c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710ffff640 1 -- 172.21.15.118:0/1226500224 >> v1:172.21.15.118:6789/0 conn(0x7f711006b700 legacy=0x7f71100bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710ffff640 1 -- 172.21.15.118:0/1226500224 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100bdc30 con 0x7f71100c0220 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710f7fe640 1 --2- 172.21.15.118:0/1226500224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711014c870 0x7f711006c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710ffff640 1 --2- 172.21.15.118:0/1226500224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f7110156490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7108009d90 tx=0x7f710802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0b1a9d49d5af0a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710e7fc640 1 -- 172.21.15.118:0/1226500224 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710802cce0 con 0x7f71100c0220 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710e7fc640 1 -- 172.21.15.118:0/1226500224 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710802ce40 con 0x7f71100c0220 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.354+0000 7f710e7fc640 1 -- 172.21.15.118:0/1226500224 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108034660 con 0x7f71100c0220 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 -- 172.21.15.118:0/1226500224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 msgr2=0x7f7110156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1226500224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f7110156490 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7108009d90 tx=0x7f710802bf30 comp rx=0 tx=0).stop 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 -- 172.21.15.118:0/1226500224 shutdown_connections 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1226500224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f7110156490 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1226500224 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711014c870 0x7f711006c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 -- 172.21.15.118:0/1226500224 >> 172.21.15.118:0/1226500224 conn(0x7f71100c1650 msgr2=0x7f71100c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 -- 172.21.15.118:0/1226500224 shutdown_connections 2024-02-18T10:01:12.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.355+0000 7f7115ed4640 1 -- 172.21.15.118:0/1226500224 wait complete. 2024-02-18T10:01:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.356+0000 7f7115ed4640 1 Processor -- start 2024-02-18T10:01:12.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.356+0000 7f7115ed4640 1 -- start start 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f7115ed4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711006b700 0x7f71101e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f7115ed4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f71100a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f7115ed4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f711014c870 0x7f71100a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f7115ed4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101e52d0 con 0x7f71100c0220 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f7115ed4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101e5920 con 0x7f711014c870 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f7115ed4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71100a5410 con 0x7f711006b700 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f71100a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f71100a6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45998/0 (socket says 172.21.15.118:45998) 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 -- 172.21.15.118:0/1275005268 learned_addr learned my addr 172.21.15.118:0/1275005268 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 -- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711006b700 msgr2=0x7f71101e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710ffff640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f711014c870 0x7f71100a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710f7fe640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711006b700 0x7f71101e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711006b700 0x7f71101e4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 -- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f711014c870 msgr2=0x7f71100a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f711014c870 0x7f71100a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 -- 172.21.15.118:0/1275005268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108009a70 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.357+0000 7f710effd640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f71100a6140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f710000c500 tx=0x7f710000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.358+0000 7f70f7fff640 1 -- 172.21.15.118:0/1275005268 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100007560 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.358+0000 7f70f7fff640 1 -- 172.21.15.118:0/1275005268 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71000047e0 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.358+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71100a5cb0 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.358+0000 7f70f7fff640 1 -- 172.21.15.118:0/1275005268 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100004b90 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.358+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71100b4e20 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.359+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7110075150 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.359+0000 7f70f7fff640 1 -- 172.21.15.118:0/1275005268 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f7100004cf0 con 0x7f71100c0220 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.359+0000 7f70f7fff640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70fc06bca0 0x7f70fc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.360+0000 7f70f7fff640 1 -- 172.21.15.118:0/1275005268 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7100089c10 con 0x7f71100c0220 2024-02-18T10:01:12.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.360+0000 7f710f7fe640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70fc06bca0 0x7f70fc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.360+0000 7f710f7fe640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70fc06bca0 0x7f70fc06e160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f710400b840 tx=0x7f7104008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.364+0000 7f70f7fff640 1 -- 172.21.15.118:0/1275005268 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7100054480 con 0x7f71100c0220 2024-02-18T10:01:12.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.533+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71100b8270 con 0x7f71100c0220 2024-02-18T10:01:12.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.533+0000 7f70f7fff640 1 -- 172.21.15.118:0/1275005268 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71000180a0 con 0x7f71100c0220 2024-02-18T10:01:12.536 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70fc06bca0 msgr2=0x7f70fc06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70fc06bca0 0x7f70fc06e160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f710400b840 tx=0x7f7104008040 comp rx=0 tx=0).stop 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 msgr2=0x7f71100a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f71100a6140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f710000c500 tx=0x7f710000c9c0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 shutdown_connections 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70fc06bca0 0x7f70fc06e160 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f711014c870 0x7f71100a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71100c0220 0x7f71100a6140 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 --2- 172.21.15.118:0/1275005268 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f711006b700 0x7f71101e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 >> 172.21.15.118:0/1275005268 conn(0x7f71100c1650 msgr2=0x7f7110148cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:12.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 shutdown_connections 2024-02-18T10:01:12.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.535+0000 7f7115ed4640 1 -- 172.21.15.118:0/1275005268 wait complete. 2024-02-18T10:01:12.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:12.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.648+0000 7fdc1a8eb640 1 Processor -- start 2024-02-18T10:01:12.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.648+0000 7fdc1a8eb640 1 -- start start 2024-02-18T10:01:12.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc1a8eb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdc14143dc0 0x7fdc140b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc1a8eb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc140a4160 0x7fdc140b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc1a8eb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140b3590 con 0x7fdc14149fa0 2024-02-18T10:01:12.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc1a8eb640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc14072e50 con 0x7fdc14143dc0 2024-02-18T10:01:12.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc1a8eb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140b3870 con 0x7fdc140a4160 2024-02-18T10:01:12.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc13fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdc14143dc0 0x7fdc140b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc13fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdc14143dc0 0x7fdc140b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46008/0 (socket says 172.21.15.118:46008) 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc13fff640 1 -- 172.21.15.118:0/1839400411 learned_addr learned my addr 172.21.15.118:0/1839400411 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc137fe640 1 --2- 172.21.15.118:0/1839400411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc140a4160 0x7fdc140b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc13fff640 1 -- 172.21.15.118:0/1839400411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc140a4160 msgr2=0x7fdc140b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc13fff640 1 --2- 172.21.15.118:0/1839400411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc140a4160 0x7fdc140b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc13fff640 1 -- 172.21.15.118:0/1839400411 >> v1:172.21.15.164:6789/0 conn(0x7fdc14149fa0 legacy=0x7fdc1406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.649+0000 7fdc13fff640 1 -- 172.21.15.118:0/1839400411 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14149a80 con 0x7fdc14143dc0 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc13fff640 1 --2- 172.21.15.118:0/1839400411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc14143dc0 0x7fdc140b5030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009870 tx=0x7fdc0802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377bfbf97bc83ed5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc12ffd640 1 -- 172.21.15.118:0/1839400411 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc080317c0 con 0x7fdc14143dc0 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc12ffd640 1 -- 172.21.15.118:0/1839400411 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08031920 con 0x7fdc14143dc0 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc12ffd640 1 -- 172.21.15.118:0/1839400411 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08031cb0 con 0x7fdc14143dc0 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/1839400411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc14143dc0 msgr2=0x7fdc140b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/1839400411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc14143dc0 0x7fdc140b5030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009870 tx=0x7fdc0802b860 comp rx=0 tx=0).stop 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/1839400411 shutdown_connections 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/1839400411 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc140a4160 0x7fdc140b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/1839400411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc14143dc0 0x7fdc140b5030 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/1839400411 >> 172.21.15.118:0/1839400411 conn(0x7fdc1406bed0 msgr2=0x7fdc1406c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:12.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/1839400411 shutdown_connections 2024-02-18T10:01:12.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.650+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/1839400411 wait complete. 2024-02-18T10:01:12.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.651+0000 7fdc1a8eb640 1 Processor -- start 2024-02-18T10:01:12.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc1a8eb640 1 -- start start 2024-02-18T10:01:12.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc1a8eb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc14143dc0 0x7fdc140b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc1a8eb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc14149fa0 0x7fdc140a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc1a8eb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc140a1a50 0x7fdc141e2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc1a8eb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140a2de0 con 0x7fdc140a1a50 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc1a8eb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140a15c0 con 0x7fdc14149fa0 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc1a8eb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140b61b0 con 0x7fdc14143dc0 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc18e88640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc140a1a50 0x7fdc141e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc18e88640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc140a1a50 0x7fdc141e2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46012/0 (socket says 172.21.15.118:46012) 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.652+0000 7fdc18e88640 1 -- 172.21.15.118:0/291212242 learned_addr learned my addr 172.21.15.118:0/291212242 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc137fe640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc14149fa0 0x7fdc140a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc13fff640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc14143dc0 0x7fdc140b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc18e88640 1 -- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc14143dc0 msgr2=0x7fdc140b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc18e88640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc14143dc0 0x7fdc140b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc18e88640 1 -- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc14149fa0 msgr2=0x7fdc140a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc18e88640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc14149fa0 0x7fdc140a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc18e88640 1 -- 172.21.15.118:0/291212242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080094d0 con 0x7fdc140a1a50 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc137fe640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc14149fa0 0x7fdc140a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:12.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc13fff640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc14143dc0 0x7fdc140b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc18e88640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc140a1a50 0x7fdc141e2840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c780 tx=0x7fdc0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc10ff9640 1 -- 172.21.15.118:0/291212242 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c004b60 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc10ff9640 1 -- 172.21.15.118:0/291212242 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c00ce90 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc140a2fc0 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc10ff9640 1 -- 172.21.15.118:0/291212242 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c00a850 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.653+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc140b5030 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.654+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc140a1770 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.654+0000 7fdc10ff9640 1 -- 172.21.15.118:0/291212242 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fdc0c00a9b0 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.655+0000 7fdc10ff9640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdc0006bc70 0x7fdc0006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.655+0000 7fdc10ff9640 1 -- 172.21.15.118:0/291212242 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc0c08a9f0 con 0x7fdc140a1a50 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.655+0000 7fdc13fff640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdc0006bc70 0x7fdc0006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.655+0000 7fdc13fff640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdc0006bc70 0x7fdc0006e130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc08036000 tx=0x7fdc0803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.659+0000 7fdc10ff9640 1 -- 172.21.15.118:0/291212242 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc140a1770 con 0x7fdc140a1a50 2024-02-18T10:01:12.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.834+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc14075150 con 0x7fdc140a1a50 2024-02-18T10:01:12.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.835+0000 7fdc10ff9640 1 -- 172.21.15.118:0/291212242 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc0c058c70 con 0x7fdc140a1a50 2024-02-18T10:01:12.838 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdc0006bc70 msgr2=0x7fdc0006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdc0006bc70 0x7fdc0006e130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdc08036000 tx=0x7fdc0803d040 comp rx=0 tx=0).stop 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc140a1a50 msgr2=0x7fdc141e2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc140a1a50 0x7fdc141e2840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c780 tx=0x7fdc0c00cc40 comp rx=0 tx=0).stop 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 shutdown_connections 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdc0006bc70 0x7fdc0006e130 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdc140a1a50 0x7fdc141e2840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc14149fa0 0x7fdc140a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 --2- 172.21.15.118:0/291212242 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdc14143dc0 0x7fdc140b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 >> 172.21.15.118:0/291212242 conn(0x7fdc1406bed0 msgr2=0x7fdc14142a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 shutdown_connections 2024-02-18T10:01:12.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.837+0000 7fdc1a8eb640 1 -- 172.21.15.118:0/291212242 wait complete. 2024-02-18T10:01:12.850 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.947+0000 7f28dcdbc640 1 Processor -- start 2024-02-18T10:01:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.947+0000 7f28dcdbc640 1 -- start start 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28dcdbc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d814c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28dcdbc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28d80bd240 0x7f28d80bf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28dcdbc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f28d80bfe60 0x7f28d814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28dcdbc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80bdbb0 con 0x7f28d80bd240 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28dcdbc640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d814be60 con 0x7f28d80bfe60 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28dcdbc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d814c140 con 0x7f28d806bc20 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28d80bd240 0x7f28d80bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28d80bd240 0x7f28d80bf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46024/0 (socket says 172.21.15.118:46024) 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3431396063 learned_addr learned my addr 172.21.15.118:0/3431396063 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d659c640 1 --2- 172.21.15.118:0/3431396063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d6d9d640 1 --2- 172.21.15.118:0/3431396063 >> v2:172.21.15.164:3300/0 conn(0x7f28d80bfe60 0x7f28d814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3431396063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 msgr2=0x7f28d814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 --2- 172.21.15.118:0/3431396063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3431396063 >> v2:172.21.15.164:3300/0 conn(0x7f28d80bfe60 msgr2=0x7f28d814f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 --2- 172.21.15.118:0/3431396063 >> v2:172.21.15.164:3300/0 conn(0x7f28d80bfe60 0x7f28d814f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3431396063 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d814c420 con 0x7f28d80bd240 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.948+0000 7f28d6d9d640 1 --2- 172.21.15.118:0/3431396063 >> v2:172.21.15.164:3300/0 conn(0x7f28d80bfe60 0x7f28d814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.949+0000 7f28d5d9b640 1 --2- 172.21.15.118:0/3431396063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d80bf260 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28d806b330 tx=0x7f28cc02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fc6de6e53868d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.949+0000 7f28d559a640 1 -- 172.21.15.118:0/3431396063 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0317d0 con 0x7f28d80bd240 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.949+0000 7f28d559a640 1 -- 172.21.15.118:0/3431396063 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc031930 con 0x7f28d80bd240 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.949+0000 7f28d559a640 1 -- 172.21.15.118:0/3431396063 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc031cc0 con 0x7f28d80bd240 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3431396063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 msgr2=0x7f28d80bf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3431396063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d80bf260 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28d806b330 tx=0x7f28cc02b870 comp rx=0 tx=0).stop 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3431396063 shutdown_connections 2024-02-18T10:01:12.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3431396063 >> v2:172.21.15.164:3300/0 conn(0x7f28d80bfe60 0x7f28d814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3431396063 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d80bf260 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3431396063 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3431396063 >> 172.21.15.118:0/3431396063 conn(0x7f28d80c1850 msgr2=0x7f28d80c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3431396063 shutdown_connections 2024-02-18T10:01:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.950+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3431396063 wait complete. 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.951+0000 7f28dcdbc640 1 Processor -- start 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.951+0000 7f28dcdbc640 1 -- start start 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d80bb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d8149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d80bfe60 0x7f28d81441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d814a3f0 con 0x7f28d80bd240 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80b81b0 con 0x7f28d80bfe60 2024-02-18T10:01:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80b4f90 con 0x7f28d806bc20 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d8149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d8149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46040/0 (socket says 172.21.15.118:46040) 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3735466736 learned_addr learned my addr 172.21.15.118:0/3735466736 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d659c640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d80bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d6d9d640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d80bfe60 0x7f28d81441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 msgr2=0x7f28d80bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d80bb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d80bfe60 msgr2=0x7f28d81441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d80bfe60 0x7f28d81441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 -- 172.21.15.118:0/3735466736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0094d0 con 0x7f28d80bd240 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d6d9d640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d80bfe60 0x7f28d81441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28d5d9b640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d8149eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28cc02b8b0 tx=0x7f28cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28c6ffd640 1 -- 172.21.15.118:0/3735466736 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc032870 con 0x7f28d80bd240 2024-02-18T10:01:12.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28c6ffd640 1 -- 172.21.15.118:0/3735466736 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc032a10 con 0x7f28d80bd240 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d80b5530 con 0x7f28d80bd240 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28c6ffd640 1 -- 172.21.15.118:0/3735466736 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc032dc0 con 0x7f28d80bd240 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.952+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d80b79b0 con 0x7f28d80bd240 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.953+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d80a2500 con 0x7f28d80bd240 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.954+0000 7f28c6ffd640 1 -- 172.21.15.118:0/3735466736 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f28cc030070 con 0x7f28d80bd240 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.954+0000 7f28c6ffd640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f28b806bca0 0x7f28b806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.954+0000 7f28d659c640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f28b806bca0 0x7f28b806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.954+0000 7f28c6ffd640 1 -- 172.21.15.118:0/3735466736 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28cc0ac610 con 0x7f28d80bd240 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.954+0000 7f28d659c640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f28b806bca0 0x7f28b806e160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f28d81e2840 tx=0x7f28c8009830 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:12.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:12.958+0000 7f28c6ffd640 1 -- 172.21.15.118:0/3735466736 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28cc076e10 con 0x7f28d80bd240 2024-02-18T10:01:13.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.131+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28d8074af0 con 0x7f28d80bd240 2024-02-18T10:01:13.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.132+0000 7f28c6ffd640 1 -- 172.21.15.118:0/3735466736 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f28cc07a4d0 con 0x7f28d80bd240 2024-02-18T10:01:13.135 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:13.135 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f28b806bca0 msgr2=0x7f28b806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f28b806bca0 0x7f28b806e160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f28d81e2840 tx=0x7f28c8009830 comp rx=0 tx=0).stop 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 msgr2=0x7f28d8149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d8149eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28cc02b8b0 tx=0x7f28cc0046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 shutdown_connections 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f28b806bca0 0x7f28b806e160 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28d80bfe60 0x7f28d81441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28d80bd240 0x7f28d8149eb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 --2- 172.21.15.118:0/3735466736 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28d806bc20 0x7f28d80bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 >> 172.21.15.118:0/3735466736 conn(0x7f28d80c1850 msgr2=0x7f28d80a1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 shutdown_connections 2024-02-18T10:01:13.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.134+0000 7f28dcdbc640 1 -- 172.21.15.118:0/3735466736 wait complete. 2024-02-18T10:01:13.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:13.148 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:13.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.248+0000 7f9d2ca00640 1 Processor -- start 2024-02-18T10:01:13.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.248+0000 7f9d2ca00640 1 -- start start 2024-02-18T10:01:13.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d2ca00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9d280bbc60 0x7f9d2814f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d2ca00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9d280bc040 0x7f9d28145a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d2ca00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d28145fb0 0x7f9d280ba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d2ca00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d280bd390 con 0x7f9d280bbc60 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d2ca00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d280bc6c0 con 0x7f9d280bc040 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d2ca00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2806cb90 con 0x7f9d28145fb0 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9d280bbc60 0x7f9d2814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9d280bbc60 0x7f9d2814f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46052/0 (socket says 172.21.15.118:46052) 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 -- 172.21.15.118:0/2637993715 learned_addr learned my addr 172.21.15.118:0/2637993715 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 -- 172.21.15.118:0/2637993715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d28145fb0 msgr2=0x7f9d280ba700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 --2- 172.21.15.118:0/2637993715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d28145fb0 0x7f9d280ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 -- 172.21.15.118:0/2637993715 >> v2:172.21.15.164:3300/0 conn(0x7f9d280bc040 msgr2=0x7f9d28145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 --2- 172.21.15.118:0/2637993715 >> v2:172.21.15.164:3300/0 conn(0x7f9d280bc040 0x7f9d28145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.249+0000 7f9d26d9d640 1 -- 172.21.15.118:0/2637993715 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280bd600 con 0x7f9d280bbc60 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d26d9d640 1 --2- 172.21.15.118:0/2637993715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bbc60 0x7f9d2814f030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9d2808aff0 tx=0x7f9d1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada04df1b83bdb98 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2659c640 1 -- 172.21.15.118:0/2637993715 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18030860 con 0x7f9d280bbc60 2024-02-18T10:01:13.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2659c640 1 -- 172.21.15.118:0/2637993715 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d180309c0 con 0x7f9d280bbc60 2024-02-18T10:01:13.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2659c640 1 -- 172.21.15.118:0/2637993715 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18030d50 con 0x7f9d280bbc60 2024-02-18T10:01:13.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 -- 172.21.15.118:0/2637993715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bbc60 msgr2=0x7f9d2814f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/2637993715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bbc60 0x7f9d2814f030 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9d2808aff0 tx=0x7f9d1802b9a0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 -- 172.21.15.118:0/2637993715 shutdown_connections 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/2637993715 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d28145fb0 0x7f9d280ba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/2637993715 >> v2:172.21.15.164:3300/0 conn(0x7f9d280bc040 0x7f9d28145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/2637993715 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bbc60 0x7f9d2814f030 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 -- 172.21.15.118:0/2637993715 >> 172.21.15.118:0/2637993715 conn(0x7f9d280c14c0 msgr2=0x7f9d280c18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.250+0000 7f9d2ca00640 1 -- 172.21.15.118:0/2637993715 shutdown_connections 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.251+0000 7f9d2ca00640 1 -- 172.21.15.118:0/2637993715 wait complete. 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 Processor -- start 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 -- start start 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d280bbc60 0x7f9d28146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bc040 0x7f9d280a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28145fb0 0x7f9d28144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d28147600 con 0x7f9d280bc040 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d281494c0 con 0x7f9d28145fb0 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d2ca00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d28145530 con 0x7f9d280bbc60 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d1ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bc040 0x7f9d280a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d1ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bc040 0x7f9d280a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46054/0 (socket says 172.21.15.118:46054) 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.252+0000 7f9d1ffff640 1 -- 172.21.15.118:0/3659809699 learned_addr learned my addr 172.21.15.118:0/3659809699 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:13.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d26d9d640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d280bbc60 0x7f9d28146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d2759e640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28145fb0 0x7f9d28144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1ffff640 1 -- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d280bbc60 msgr2=0x7f9d28146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1ffff640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d280bbc60 0x7f9d28146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1ffff640 1 -- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28145fb0 msgr2=0x7f9d28144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1ffff640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28145fb0 0x7f9d28144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1ffff640 1 -- 172.21.15.118:0/3659809699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d180094d0 con 0x7f9d280bc040 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1ffff640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bc040 0x7f9d280a6c30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b4a0 tx=0x7f9d1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1f7fe640 1 -- 172.21.15.118:0/3659809699 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10010610 con 0x7f9d280bc040 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1f7fe640 1 -- 172.21.15.118:0/3659809699 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d10010770 con 0x7f9d280bc040 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d1f7fe640 1 -- 172.21.15.118:0/3659809699 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10010b20 con 0x7f9d280bc040 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d280a6470 con 0x7f9d280bc040 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.253+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d280c1b60 con 0x7f9d280bc040 2024-02-18T10:01:13.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.254+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2814ca60 con 0x7f9d280bc040 2024-02-18T10:01:13.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.254+0000 7f9d1f7fe640 1 -- 172.21.15.118:0/3659809699 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9d10010c80 con 0x7f9d280bc040 2024-02-18T10:01:13.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.255+0000 7f9d1f7fe640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9d0806bc70 0x7f9d0806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.255+0000 7f9d26d9d640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9d0806bc70 0x7f9d0806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.255+0000 7f9d1f7fe640 1 -- 172.21.15.118:0/3659809699 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d1008a3b0 con 0x7f9d280bc040 2024-02-18T10:01:13.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.255+0000 7f9d26d9d640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9d0806bc70 0x7f9d0806e130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d18036000 tx=0x7f9d18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.259+0000 7f9d1f7fe640 1 -- 172.21.15.118:0/3659809699 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d2814ca60 con 0x7f9d280bc040 2024-02-18T10:01:13.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.430+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d2814ca30 con 0x7f9d280bc040 2024-02-18T10:01:13.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.430+0000 7f9d1f7fe640 1 -- 172.21.15.118:0/3659809699 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d10054c20 con 0x7f9d280bc040 2024-02-18T10:01:13.433 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:13.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9d0806bc70 msgr2=0x7f9d0806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9d0806bc70 0x7f9d0806e130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d18036000 tx=0x7f9d18008030 comp rx=0 tx=0).stop 2024-02-18T10:01:13.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bc040 msgr2=0x7f9d280a6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bc040 0x7f9d280a6c30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b4a0 tx=0x7f9d1000b960 comp rx=0 tx=0).stop 2024-02-18T10:01:13.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 shutdown_connections 2024-02-18T10:01:13.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9d0806bc70 0x7f9d0806e130 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28145fb0 0x7f9d28144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d280bc040 0x7f9d280a6c30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 --2- 172.21.15.118:0/3659809699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9d280bbc60 0x7f9d28146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 >> 172.21.15.118:0/3659809699 conn(0x7f9d280c14c0 msgr2=0x7f9d280a0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:13.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 shutdown_connections 2024-02-18T10:01:13.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.432+0000 7f9d2ca00640 1 -- 172.21.15.118:0/3659809699 wait complete. 2024-02-18T10:01:13.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:13.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.545+0000 7fdbb8148640 1 Processor -- start 2024-02-18T10:01:13.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.545+0000 7fdbb8148640 1 -- start start 2024-02-18T10:01:13.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.545+0000 7fdbb8148640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdbb0149560 0x7fdbb014f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.545+0000 7fdbb8148640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb006c040 0x7fdbb00bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb8148640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdbb00bf5b0 0x7fdbb006e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb8148640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb00ba650 con 0x7fdbb0149560 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb8148640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb006c480 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb8148640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0149940 con 0x7fdbb006c040 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdbb0149560 0x7fdbb014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdbb0149560 0x7fdbb014f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46060/0 (socket says 172.21.15.118:46060) 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 -- 172.21.15.118:0/278421861 learned_addr learned my addr 172.21.15.118:0/278421861 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb56e3640 1 --2- 172.21.15.118:0/278421861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb006c040 0x7fdbb00bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb66e5640 1 --2- 172.21.15.118:0/278421861 >> v2:172.21.15.164:3300/0 conn(0x7fdbb00bf5b0 0x7fdbb006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 -- 172.21.15.118:0/278421861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb006c040 msgr2=0x7fdbb00bb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 --2- 172.21.15.118:0/278421861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb006c040 0x7fdbb00bb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 -- 172.21.15.118:0/278421861 >> v2:172.21.15.164:3300/0 conn(0x7fdbb00bf5b0 msgr2=0x7fdbb006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 --2- 172.21.15.118:0/278421861 >> v2:172.21.15.164:3300/0 conn(0x7fdbb00bf5b0 0x7fdbb006e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb5ee4640 1 -- 172.21.15.118:0/278421861 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb00b2c80 con 0x7fdbb0149560 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb56e3640 1 --2- 172.21.15.118:0/278421861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb006c040 0x7fdbb00bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.546+0000 7fdbb66e5640 1 --2- 172.21.15.118:0/278421861 >> v2:172.21.15.164:3300/0 conn(0x7fdbb00bf5b0 0x7fdbb006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb5ee4640 1 --2- 172.21.15.118:0/278421861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0149560 0x7fdbb014f450 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0071de0 tx=0x7fdbac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b405cb3e80b0816a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb4ee2640 1 -- 172.21.15.118:0/278421861 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0317e0 con 0x7fdbb0149560 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb4ee2640 1 -- 172.21.15.118:0/278421861 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac031940 con 0x7fdbb0149560 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb4ee2640 1 -- 172.21.15.118:0/278421861 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac031cd0 con 0x7fdbb0149560 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 -- 172.21.15.118:0/278421861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0149560 msgr2=0x7fdbb014f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 --2- 172.21.15.118:0/278421861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0149560 0x7fdbb014f450 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0071de0 tx=0x7fdbac02b880 comp rx=0 tx=0).stop 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 -- 172.21.15.118:0/278421861 shutdown_connections 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 --2- 172.21.15.118:0/278421861 >> v2:172.21.15.164:3300/0 conn(0x7fdbb00bf5b0 0x7fdbb006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 --2- 172.21.15.118:0/278421861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb006c040 0x7fdbb00bb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 --2- 172.21.15.118:0/278421861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb0149560 0x7fdbb014f450 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 -- 172.21.15.118:0/278421861 >> 172.21.15.118:0/278421861 conn(0x7fdbb006adc0 msgr2=0x7fdbb006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:13.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 -- 172.21.15.118:0/278421861 shutdown_connections 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.547+0000 7fdbb8148640 1 -- 172.21.15.118:0/278421861 wait complete. 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.548+0000 7fdbb8148640 1 Processor -- start 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.548+0000 7fdbb8148640 1 -- start start 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb8148640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdbb006c040 0x7fdbb00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb8148640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb00bf5b0 0x7fdbb00b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb8148640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb0149560 0x7fdbb014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb8148640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01e1ee0 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb8148640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01e2720 con 0x7fdbb006c040 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb8148640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01e20d0 con 0x7fdbb0149560 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb00bf5b0 0x7fdbb00b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb00bf5b0 0x7fdbb00b8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46062/0 (socket says 172.21.15.118:46062) 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 -- 172.21.15.118:0/2500050143 learned_addr learned my addr 172.21.15.118:0/2500050143 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 -- 172.21.15.118:0/2500050143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb0149560 msgr2=0x7fdbb014a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb0149560 0x7fdbb014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 -- 172.21.15.118:0/2500050143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdbb006c040 msgr2=0x7fdbb00b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb5ee4640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdbb006c040 0x7fdbb00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdbb006c040 0x7fdbb00b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.549+0000 7fdbb56e3640 1 -- 172.21.15.118:0/2500050143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0094d0 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.550+0000 7fdbb56e3640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb00bf5b0 0x7fdbb00b8ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c7f0 tx=0x7fdba000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.550+0000 7fdba67fc640 1 -- 172.21.15.118:0/2500050143 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0007820 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.550+0000 7fdba67fc640 1 -- 172.21.15.118:0/2500050143 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0007980 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.550+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb01e23b0 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.550+0000 7fdba67fc640 1 -- 172.21.15.118:0/2500050143 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0007d30 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.550+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb00b91e0 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.551+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb00b9400 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.551+0000 7fdba67fc640 1 -- 172.21.15.118:0/2500050143 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fdba00113f0 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.552+0000 7fdba67fc640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdb9406bc70 0x7fdb9406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.552+0000 7fdbb5ee4640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdb9406bc70 0x7fdb9406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.552+0000 7fdba67fc640 1 -- 172.21.15.118:0/2500050143 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdba008aa30 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.552+0000 7fdbb5ee4640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdb9406bc70 0x7fdb9406e130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdbac036000 tx=0x7fdbac03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.556+0000 7fdba67fc640 1 -- 172.21.15.118:0/2500050143 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdba0055220 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.726+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbb0075150 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.726+0000 7fdba67fc640 1 -- 172.21.15.118:0/2500050143 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdba00588e0 con 0x7fdbb00bf5b0 2024-02-18T10:01:13.729 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdb9406bc70 msgr2=0x7fdb9406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdb9406bc70 0x7fdb9406e130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdbac036000 tx=0x7fdbac03d040 comp rx=0 tx=0).stop 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb00bf5b0 msgr2=0x7fdbb00b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb00bf5b0 0x7fdbb00b8ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c7f0 tx=0x7fdba000ccb0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 shutdown_connections 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fdb9406bc70 0x7fdb9406e130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdbb0149560 0x7fdbb014a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbb00bf5b0 0x7fdbb00b8ca0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 --2- 172.21.15.118:0/2500050143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdbb006c040 0x7fdbb00b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 >> 172.21.15.118:0/2500050143 conn(0x7fdbb006adc0 msgr2=0x7fdbb00bb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 shutdown_connections 2024-02-18T10:01:13.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.728+0000 7fdbb8148640 1 -- 172.21.15.118:0/2500050143 wait complete. 2024-02-18T10:01:13.741 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:13.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.842+0000 7f29b680e640 1 Processor -- start 2024-02-18T10:01:13.845 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.842+0000 7f29b680e640 1 -- start start 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29b680e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29b0143e10 0x7f29b00bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29b680e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b006f930 0x7f29b0149c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29b680e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b014d460 con 0x7f29b014cf80 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29b680e640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b014d740 con 0x7f29b0143e10 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29b680e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b014da20 con 0x7f29b006f930 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29affff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29b0143e10 0x7f29b00bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29affff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f29b0143e10 0x7f29b00bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46068/0 (socket says 172.21.15.118:46068) 2024-02-18T10:01:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29affff640 1 -- 172.21.15.118:0/1906069342 learned_addr learned my addr 172.21.15.118:0/1906069342 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29af7fe640 1 --2- 172.21.15.118:0/1906069342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b006f930 0x7f29b0149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29affff640 1 -- 172.21.15.118:0/1906069342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b006f930 msgr2=0x7f29b0149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29affff640 1 --2- 172.21.15.118:0/1906069342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b006f930 0x7f29b0149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29affff640 1 -- 172.21.15.118:0/1906069342 >> v1:172.21.15.118:6789/0 conn(0x7f29b014cf80 legacy=0x7f29b006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29aeffd640 1 -- 172.21.15.118:0/1906069342 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161581860 0 0) 0x7f29b014d460 con 0x7f29b014cf80 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.843+0000 7f29affff640 1 -- 172.21.15.118:0/1906069342 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b014dd00 con 0x7f29b0143e10 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29affff640 1 --2- 172.21.15.118:0/1906069342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b0143e10 0x7f29b00bf600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009870 tx=0x7f29a002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b833c0e7be2794 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29aeffd640 1 -- 172.21.15.118:0/1906069342 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a002f840 con 0x7f29b0143e10 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29aeffd640 1 -- 172.21.15.118:0/1906069342 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a002f9a0 con 0x7f29b0143e10 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29aeffd640 1 -- 172.21.15.118:0/1906069342 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a002fd30 con 0x7f29b0143e10 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 -- 172.21.15.118:0/1906069342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b0143e10 msgr2=0x7f29b00bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 --2- 172.21.15.118:0/1906069342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b0143e10 0x7f29b00bf600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009870 tx=0x7f29a002ba20 comp rx=0 tx=0).stop 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 -- 172.21.15.118:0/1906069342 shutdown_connections 2024-02-18T10:01:13.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 --2- 172.21.15.118:0/1906069342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b006f930 0x7f29b0149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 --2- 172.21.15.118:0/1906069342 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b0143e10 0x7f29b00bf600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 -- 172.21.15.118:0/1906069342 >> 172.21.15.118:0/1906069342 conn(0x7f29b006adc0 msgr2=0x7f29b006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 -- 172.21.15.118:0/1906069342 shutdown_connections 2024-02-18T10:01:13.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.844+0000 7f29b680e640 1 -- 172.21.15.118:0/1906069342 wait complete. 2024-02-18T10:01:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.845+0000 7f29b680e640 1 Processor -- start 2024-02-18T10:01:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b680e640 1 -- start start 2024-02-18T10:01:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b680e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b0143e10 0x7f29b01e1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b680e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b014cf80 0x7f29b014c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b680e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b01e56b0 0x7f29b00b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b680e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00b9090 con 0x7f29b014cf80 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b680e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b01e5220 con 0x7f29b0143e10 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b680e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00b8db0 con 0x7f29b01e56b0 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b014cf80 0x7f29b014c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b014cf80 0x7f29b014c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46072/0 (socket says 172.21.15.118:46072) 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29af7fe640 1 -- 172.21.15.118:0/3194461562 learned_addr learned my addr 172.21.15.118:0/3194461562 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29b4dab640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b01e56b0 0x7f29b00b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.846+0000 7f29affff640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b0143e10 0x7f29b01e1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29af7fe640 1 -- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b01e56b0 msgr2=0x7f29b00b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29af7fe640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b01e56b0 0x7f29b00b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29af7fe640 1 -- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b0143e10 msgr2=0x7f29b01e1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29af7fe640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b0143e10 0x7f29b01e1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29af7fe640 1 -- 172.21.15.118:0/3194461562 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00094d0 con 0x7f29b014cf80 2024-02-18T10:01:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29af7fe640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b014cf80 0x7f29b014c530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f29a400d800 tx=0x7f29a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29acff9640 1 -- 172.21.15.118:0/3194461562 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400b6c0 con 0x7f29b014cf80 2024-02-18T10:01:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29acff9640 1 -- 172.21.15.118:0/3194461562 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a400b820 con 0x7f29b014cf80 2024-02-18T10:01:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b01e4bd0 con 0x7f29b014cf80 2024-02-18T10:01:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29acff9640 1 -- 172.21.15.118:0/3194461562 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400bbb0 con 0x7f29b014cf80 2024-02-18T10:01:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.847+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b00b8940 con 0x7f29b014cf80 2024-02-18T10:01:13.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.848+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b01e4a30 con 0x7f29b014cf80 2024-02-18T10:01:13.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.848+0000 7f29acff9640 1 -- 172.21.15.118:0/3194461562 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f29a400bd10 con 0x7f29b014cf80 2024-02-18T10:01:13.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.849+0000 7f29acff9640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f299c06bc70 0x7f299c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:13.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.849+0000 7f29acff9640 1 -- 172.21.15.118:0/3194461562 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29a408ac70 con 0x7f29b014cf80 2024-02-18T10:01:13.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.849+0000 7f29affff640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f299c06bc70 0x7f299c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:13.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.849+0000 7f29affff640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f299c06bc70 0x7f299c06e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f29a0036000 tx=0x7f29a0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:13.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:13.853+0000 7f29acff9640 1 -- 172.21.15.118:0/3194461562 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29b01e4a30 con 0x7f29b014cf80 2024-02-18T10:01:14.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.025+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29b01e4a30 con 0x7f29b014cf80 2024-02-18T10:01:14.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.026+0000 7f29acff9640 1 -- 172.21.15.118:0/3194461562 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29b01e4a30 con 0x7f29b014cf80 2024-02-18T10:01:14.028 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:14.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.027+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f299c06bc70 msgr2=0x7f299c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.027+0000 7f29b680e640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f299c06bc70 0x7f299c06e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f29a0036000 tx=0x7f29a0008030 comp rx=0 tx=0).stop 2024-02-18T10:01:14.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.027+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b014cf80 msgr2=0x7f29b014c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.027+0000 7f29b680e640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b014cf80 0x7f29b014c530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f29a400d800 tx=0x7f29a400dcc0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 shutdown_connections 2024-02-18T10:01:14.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f299c06bc70 0x7f299c06e130 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f29b01e56b0 0x7f29b00b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29b014cf80 0x7f29b014c530 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 --2- 172.21.15.118:0/3194461562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b0143e10 0x7f29b01e1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 >> 172.21.15.118:0/3194461562 conn(0x7f29b006adc0 msgr2=0x7f29b0148560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:14.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 shutdown_connections 2024-02-18T10:01:14.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.028+0000 7f29b680e640 1 -- 172.21.15.118:0/3194461562 wait complete. 2024-02-18T10:01:14.062 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-18T10:01:14.062 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:14.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.159+0000 7fcf479e2640 1 Processor -- start 2024-02-18T10:01:14.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.159+0000 7fcf479e2640 1 -- start start 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf479e2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcf400a0ce0 0x7fcf400ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf479e2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf4014cfd0 0x7fcf4014d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf479e2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf400b4f90 con 0x7fcf40143e10 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf479e2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf40072fe0 con 0x7fcf400a0ce0 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf479e2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401441f0 con 0x7fcf4014cfd0 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf44f7d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcf400a0ce0 0x7fcf400ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf44f7d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcf400a0ce0 0x7fcf400ba180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:35950/0 (socket says 172.21.15.118:35950) 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf45f7f640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf4014cfd0 0x7fcf4014d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf44f7d640 1 -- 172.21.15.118:0/3610187670 learned_addr learned my addr 172.21.15.118:0/3610187670 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:14.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf4577e640 1 --1- 172.21.15.118:0/3610187670 >> v1:172.21.15.164:6789/0 conn(0x7fcf40143e10 0x7fcf40070fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:39898/0 (socket says 172.21.15.118:39898) 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf45f7f640 1 -- 172.21.15.118:0/3610187670 >> v2:172.21.15.164:3300/0 conn(0x7fcf400a0ce0 msgr2=0x7fcf400ba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf45f7f640 1 --2- 172.21.15.118:0/3610187670 >> v2:172.21.15.164:3300/0 conn(0x7fcf400a0ce0 0x7fcf400ba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf45f7f640 1 -- 172.21.15.118:0/3610187670 >> v1:172.21.15.164:6789/0 conn(0x7fcf40143e10 legacy=0x7fcf40070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.160+0000 7fcf45f7f640 1 -- 172.21.15.118:0/3610187670 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400716f0 con 0x7fcf4014cfd0 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.161+0000 7fcf45f7f640 1 --2- 172.21.15.118:0/3610187670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf4014cfd0 0x7fcf4014d480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009d90 tx=0x7fcf3802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed1da610b69c86c server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.161+0000 7fcf37fff640 1 -- 172.21.15.118:0/3610187670 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3802cce0 con 0x7fcf4014cfd0 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.161+0000 7fcf37fff640 1 -- 172.21.15.118:0/3610187670 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3802ce40 con 0x7fcf4014cfd0 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.161+0000 7fcf37fff640 1 -- 172.21.15.118:0/3610187670 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38034660 con 0x7fcf4014cfd0 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 -- 172.21.15.118:0/3610187670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf4014cfd0 msgr2=0x7fcf4014d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 --2- 172.21.15.118:0/3610187670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf4014cfd0 0x7fcf4014d480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009d90 tx=0x7fcf3802bf30 comp rx=0 tx=0).stop 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 -- 172.21.15.118:0/3610187670 shutdown_connections 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 --2- 172.21.15.118:0/3610187670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf4014cfd0 0x7fcf4014d480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 --2- 172.21.15.118:0/3610187670 >> v2:172.21.15.164:3300/0 conn(0x7fcf400a0ce0 0x7fcf400ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 -- 172.21.15.118:0/3610187670 >> 172.21.15.118:0/3610187670 conn(0x7fcf4006bcf0 msgr2=0x7fcf4006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:14.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 -- 172.21.15.118:0/3610187670 shutdown_connections 2024-02-18T10:01:14.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.162+0000 7fcf479e2640 1 -- 172.21.15.118:0/3610187670 wait complete. 2024-02-18T10:01:14.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.163+0000 7fcf479e2640 1 Processor -- start 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.163+0000 7fcf479e2640 1 -- start start 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf479e2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf400a0ce0 0x7fcf401e0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf479e2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf40143e10 0x7fcf401478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf479e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf4014cfd0 0x7fcf400bca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf479e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401df690 con 0x7fcf4014cfd0 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf479e2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4013b610 con 0x7fcf400a0ce0 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf479e2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400b8440 con 0x7fcf40143e10 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf4014cfd0 0x7fcf400bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf4014cfd0 0x7fcf400bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46074/0 (socket says 172.21.15.118:46074) 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 -- 172.21.15.118:0/517127946 learned_addr learned my addr 172.21.15.118:0/517127946 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf4577e640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf400a0ce0 0x7fcf401e0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf44f7d640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf40143e10 0x7fcf401478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 -- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf40143e10 msgr2=0x7fcf401478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf40143e10 0x7fcf401478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 -- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf400a0ce0 msgr2=0x7fcf401e0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf400a0ce0 0x7fcf401e0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 -- 172.21.15.118:0/517127946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38009a70 con 0x7fcf4014cfd0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf45f7f640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf4014cfd0 0x7fcf400bca40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009d90 tx=0x7fcf38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf35ffb640 1 -- 172.21.15.118:0/517127946 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3803d600 con 0x7fcf4014cfd0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf35ffb640 1 -- 172.21.15.118:0/517127946 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3803d780 con 0x7fcf4014cfd0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf401e05c0 con 0x7fcf4014cfd0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.164+0000 7fcf35ffb640 1 -- 172.21.15.118:0/517127946 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3803db30 con 0x7fcf4014cfd0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.165+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf401df880 con 0x7fcf4014cfd0 2024-02-18T10:01:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.165+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf40074af0 con 0x7fcf4014cfd0 2024-02-18T10:01:14.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.166+0000 7fcf35ffb640 1 -- 172.21.15.118:0/517127946 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fcf3803b040 con 0x7fcf4014cfd0 2024-02-18T10:01:14.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.166+0000 7fcf35ffb640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcf2406bc70 0x7fcf2406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.166+0000 7fcf35ffb640 1 -- 172.21.15.118:0/517127946 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf380acc70 con 0x7fcf4014cfd0 2024-02-18T10:01:14.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.166+0000 7fcf4577e640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcf2406bc70 0x7fcf2406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.167+0000 7fcf4577e640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcf2406bc70 0x7fcf2406e130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c007fd0 tx=0x7fcf3c007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.171+0000 7fcf35ffb640 1 -- 172.21.15.118:0/517127946 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf38077500 con 0x7fcf4014cfd0 2024-02-18T10:01:14.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.342+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf400ba7d0 con 0x7fcf4014cfd0 2024-02-18T10:01:14.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.343+0000 7fcf35ffb640 1 -- 172.21.15.118:0/517127946 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fcf3804e090 con 0x7fcf4014cfd0 2024-02-18T10:01:14.346 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:14.346 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcf2406bc70 msgr2=0x7fcf2406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcf2406bc70 0x7fcf2406e130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c007fd0 tx=0x7fcf3c007e80 comp rx=0 tx=0).stop 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf4014cfd0 msgr2=0x7fcf400bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf4014cfd0 0x7fcf400bca40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009d90 tx=0x7fcf38004a40 comp rx=0 tx=0).stop 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 shutdown_connections 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcf2406bc70 0x7fcf2406e130 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf4014cfd0 0x7fcf400bca40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcf40143e10 0x7fcf401478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 --2- 172.21.15.118:0/517127946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf400a0ce0 0x7fcf401e0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 >> 172.21.15.118:0/517127946 conn(0x7fcf4006bcf0 msgr2=0x7fcf400723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:14.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 shutdown_connections 2024-02-18T10:01:14.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.345+0000 7fcf479e2640 1 -- 172.21.15.118:0/517127946 wait complete. 2024-02-18T10:01:14.358 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:14.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.458+0000 7f19c139e640 1 Processor -- start 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.458+0000 7f19c139e640 1 -- start start 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19c139e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19bc0bae10 0x7f19bc0c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19c139e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19c139e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0bb1f0 con 0x7f19bc14c1d0 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19c139e640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0bc9d0 con 0x7f19bc0bae10 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19c139e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0bc550 con 0x7f19bc0b49c0 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19bbfff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19bc0bae10 0x7f19bc0c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19c0b9d640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f19bc14c1d0 0x7f19bc14f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57282/0 (socket says 172.21.15.118:57282) 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19c0b9d640 1 -- 172.21.15.118:0/2882953478 learned_addr learned my addr 172.21.15.118:0/2882953478 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:14.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19bbfff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19bc0bae10 0x7f19bc0c09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46080/0 (socket says 172.21.15.118:46080) 2024-02-18T10:01:14.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19bbfff640 1 -- 172.21.15.118:0/2882953478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 msgr2=0x7f19bc14bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:14.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19bbfff640 1 --2- 172.21.15.118:0/2882953478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19bbfff640 1 -- 172.21.15.118:0/2882953478 >> v1:172.21.15.118:6789/0 conn(0x7f19bc14c1d0 legacy=0x7f19bc14f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19bbfff640 1 -- 172.21.15.118:0/2882953478 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0a0aa0 con 0x7f19bc0bae10 2024-02-18T10:01:14.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.459+0000 7f19baffd640 1 -- 172.21.15.118:0/2882953478 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043646499 0 0) 0x7f19bc0bb1f0 con 0x7f19bc14c1d0 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.460+0000 7f19bbfff640 1 --2- 172.21.15.118:0/2882953478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc0bae10 0x7f19bc0c09e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0097d0 tx=0x7f19ac02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd1eb5b201eeeb3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.460+0000 7f19baffd640 1 -- 172.21.15.118:0/2882953478 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac031800 con 0x7f19bc0bae10 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.460+0000 7f19baffd640 1 -- 172.21.15.118:0/2882953478 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac031960 con 0x7f19bc0bae10 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.460+0000 7f19baffd640 1 -- 172.21.15.118:0/2882953478 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac031cf0 con 0x7f19bc0bae10 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.460+0000 7f19c139e640 1 -- 172.21.15.118:0/2882953478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc0bae10 msgr2=0x7f19bc0c09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.460+0000 7f19c139e640 1 --2- 172.21.15.118:0/2882953478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc0bae10 0x7f19bc0c09e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0097d0 tx=0x7f19ac02b8a0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.461+0000 7f19c139e640 1 -- 172.21.15.118:0/2882953478 shutdown_connections 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.461+0000 7f19c139e640 1 --2- 172.21.15.118:0/2882953478 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc14bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.461+0000 7f19c139e640 1 --2- 172.21.15.118:0/2882953478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc0bae10 0x7f19bc0c09e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.461+0000 7f19c139e640 1 -- 172.21.15.118:0/2882953478 >> 172.21.15.118:0/2882953478 conn(0x7f19bc0c1510 msgr2=0x7f19bc0c1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:14.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.461+0000 7f19c139e640 1 -- 172.21.15.118:0/2882953478 shutdown_connections 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.461+0000 7f19c139e640 1 -- 172.21.15.118:0/2882953478 wait complete. 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.462+0000 7f19c139e640 1 Processor -- start 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.462+0000 7f19c139e640 1 -- start start 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc0bae10 0x7f19bc1e1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc14c1d0 0x7f19bc1d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0a5df0 con 0x7f19bc14c1d0 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc1d7810 con 0x7f19bc0bae10 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0b7300 con 0x7f19bc0b49c0 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc14c1d0 0x7f19bc1d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc14c1d0 0x7f19bc1d6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46096/0 (socket says 172.21.15.118:46096) 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 -- 172.21.15.118:0/1858135043 learned_addr learned my addr 172.21.15.118:0/1858135043 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19bbfff640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19bb7fe640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc0bae10 0x7f19bc1e1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 -- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 msgr2=0x7f19bc0a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc0a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 -- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc0bae10 msgr2=0x7f19bc1e1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc0bae10 0x7f19bc1e1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 -- 172.21.15.118:0/1858135043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac009400 con 0x7f19bc14c1d0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19bbfff640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc0a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c0b9d640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc14c1d0 0x7f19bc1d6c70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19b400c700 tx=0x7f19b400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19b8ff9640 1 -- 172.21.15.118:0/1858135043 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400ce10 con 0x7f19bc14c1d0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19b8ff9640 1 -- 172.21.15.118:0/1858135043 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400a640 con 0x7f19bc14c1d0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc0a6470 con 0x7f19bc14c1d0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19b8ff9640 1 -- 172.21.15.118:0/1858135043 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400aa70 con 0x7f19bc14c1d0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.463+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc0a22a0 con 0x7f19bc14c1d0 2024-02-18T10:01:14.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.464+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc068130 con 0x7f19bc14c1d0 2024-02-18T10:01:14.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.465+0000 7f19b8ff9640 1 -- 172.21.15.118:0/1858135043 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f19b400abd0 con 0x7f19bc14c1d0 2024-02-18T10:01:14.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.465+0000 7f19b8ff9640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f19a806bc70 0x7f19a806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.465+0000 7f19b8ff9640 1 -- 172.21.15.118:0/1858135043 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19b4089f00 con 0x7f19bc14c1d0 2024-02-18T10:01:14.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.465+0000 7f19bbfff640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f19a806bc70 0x7f19a806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.466+0000 7f19bbfff640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f19a806bc70 0x7f19a806e130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19ac036000 tx=0x7f19ac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.469+0000 7f19b8ff9640 1 -- 172.21.15.118:0/1858135043 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19b4054770 con 0x7f19bc14c1d0 2024-02-18T10:01:14.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.640+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19bc0b7470 con 0x7f19bc14c1d0 2024-02-18T10:01:14.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.640+0000 7f19b8ff9640 1 -- 172.21.15.118:0/1858135043 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19b4018020 con 0x7f19bc14c1d0 2024-02-18T10:01:14.643 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:14.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f19a806bc70 msgr2=0x7f19a806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f19a806bc70 0x7f19a806e130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19ac036000 tx=0x7f19ac008030 comp rx=0 tx=0).stop 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc14c1d0 msgr2=0x7f19bc1d6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc14c1d0 0x7f19bc1d6c70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19b400c700 tx=0x7f19b400cbc0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 shutdown_connections 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f19a806bc70 0x7f19a806e130 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19bc14c1d0 0x7f19bc1d6c70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19bc0bae10 0x7f19bc1e1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 --2- 172.21.15.118:0/1858135043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19bc0b49c0 0x7f19bc0a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 >> 172.21.15.118:0/1858135043 conn(0x7f19bc0c1510 msgr2=0x7f19bc0bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 shutdown_connections 2024-02-18T10:01:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.642+0000 7f19c139e640 1 -- 172.21.15.118:0/1858135043 wait complete. 2024-02-18T10:01:14.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:14.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.755+0000 7fafe8925640 1 Processor -- start 2024-02-18T10:01:14.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.755+0000 7fafe8925640 1 -- start start 2024-02-18T10:01:14.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe8925640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafe40b5fc0 0x7fafe406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe8925640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe40a51e0 0x7fafe414a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe8925640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe4149ff0 con 0x7fafe406fea0 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe8925640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe4070280 con 0x7fafe40b5fc0 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe8925640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40b4a60 con 0x7fafe40a51e0 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe1d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fafe40b5fc0 0x7fafe406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe259c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fafe406fea0 0x7fafe40b4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57292/0 (socket says 172.21.15.118:57292) 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe259c640 1 -- 172.21.15.118:0/1344467827 learned_addr learned my addr 172.21.15.118:0/1344467827 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe2d9d640 1 --2- 172.21.15.118:0/1344467827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe40a51e0 0x7fafe414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe1d9b640 1 -- 172.21.15.118:0/1344467827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe40a51e0 msgr2=0x7fafe414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe1d9b640 1 --2- 172.21.15.118:0/1344467827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe40a51e0 0x7fafe414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe1d9b640 1 -- 172.21.15.118:0/1344467827 >> v1:172.21.15.118:6789/0 conn(0x7fafe406fea0 legacy=0x7fafe40b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe159a640 1 -- 172.21.15.118:0/1344467827 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062820999 0 0) 0x7fafe4149ff0 con 0x7fafe406fea0 2024-02-18T10:01:14.760 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.756+0000 7fafe1d9b640 1 -- 172.21.15.118:0/1344467827 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40b6510 con 0x7fafe40b5fc0 2024-02-18T10:01:14.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.757+0000 7fafe1d9b640 1 --2- 172.21.15.118:0/1344467827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe406f0e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafd80097a0 tx=0x7fafd802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a5a8321ef5f145 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.757+0000 7fafe159a640 1 -- 172.21.15.118:0/1344467827 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd802e070 con 0x7fafe40b5fc0 2024-02-18T10:01:14.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.757+0000 7fafe159a640 1 -- 172.21.15.118:0/1344467827 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd80315a0 con 0x7fafe40b5fc0 2024-02-18T10:01:14.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.757+0000 7fafe159a640 1 -- 172.21.15.118:0/1344467827 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8031930 con 0x7fafe40b5fc0 2024-02-18T10:01:14.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 -- 172.21.15.118:0/1344467827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 msgr2=0x7fafe406f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 --2- 172.21.15.118:0/1344467827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe406f0e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafd80097a0 tx=0x7fafd802b840 comp rx=0 tx=0).stop 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 -- 172.21.15.118:0/1344467827 shutdown_connections 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 --2- 172.21.15.118:0/1344467827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe40a51e0 0x7fafe414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 --2- 172.21.15.118:0/1344467827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe406f0e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 -- 172.21.15.118:0/1344467827 >> 172.21.15.118:0/1344467827 conn(0x7fafe40bbe30 msgr2=0x7fafe40bc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 -- 172.21.15.118:0/1344467827 shutdown_connections 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.758+0000 7fafe8925640 1 -- 172.21.15.118:0/1344467827 wait complete. 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.759+0000 7fafe8925640 1 Processor -- start 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.759+0000 7fafe8925640 1 -- start start 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe8925640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe406fea0 0x7fafe414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe8925640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafe40a51e0 0x7fafe40b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe8925640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe40b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe8925640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe414d1f0 con 0x7fafe40b5fc0 2024-02-18T10:01:14.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe8925640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40b7a10 con 0x7fafe40a51e0 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe8925640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe414dc20 con 0x7fafe406fea0 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe40b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe40b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46114/0 (socket says 172.21.15.118:46114) 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 -- 172.21.15.118:0/2196267354 learned_addr learned my addr 172.21.15.118:0/2196267354 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe259c640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe406fea0 0x7fafe414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe1d9b640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafe40a51e0 0x7fafe40b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 -- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe406fea0 msgr2=0x7fafe414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe406fea0 0x7fafe414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 -- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafe40a51e0 msgr2=0x7fafe40b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafe40a51e0 0x7fafe40b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 -- 172.21.15.118:0/2196267354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009400 con 0x7fafe40b5fc0 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe1d9b640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafe40a51e0 0x7fafe40b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe2d9d640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe40b74d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007e90 tx=0x7fafdc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafd2ffd640 1 -- 172.21.15.118:0/2196267354 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc014420 con 0x7fafe40b5fc0 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafd2ffd640 1 -- 172.21.15.118:0/2196267354 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc014580 con 0x7fafe40b5fc0 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafd2ffd640 1 -- 172.21.15.118:0/2196267354 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc014930 con 0x7fafe40b5fc0 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.760+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe414c5f0 con 0x7fafe40b5fc0 2024-02-18T10:01:14.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.761+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe414afc0 con 0x7fafe40b5fc0 2024-02-18T10:01:14.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.761+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe4075150 con 0x7fafe40b5fc0 2024-02-18T10:01:14.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.762+0000 7fafd2ffd640 1 -- 172.21.15.118:0/2196267354 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fafdc014a90 con 0x7fafe40b5fc0 2024-02-18T10:01:14.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.762+0000 7fafd2ffd640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fafc406bca0 0x7fafc406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:14.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.762+0000 7fafd2ffd640 1 -- 172.21.15.118:0/2196267354 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafdc08b050 con 0x7fafe40b5fc0 2024-02-18T10:01:14.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.762+0000 7fafe259c640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fafc406bca0 0x7fafc406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:14.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.763+0000 7fafe259c640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fafc406bca0 0x7fafc406e160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafd4007fd0 tx=0x7fafd4007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:14.769 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.767+0000 7fafd2ffd640 1 -- 172.21.15.118:0/2196267354 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fafdc0557a0 con 0x7fafe40b5fc0 2024-02-18T10:01:14.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.938+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafe4074af0 con 0x7fafe40b5fc0 2024-02-18T10:01:14.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.939+0000 7fafd2ffd640 1 -- 172.21.15.118:0/2196267354 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafdc058e60 con 0x7fafe40b5fc0 2024-02-18T10:01:14.941 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:14.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fafc406bca0 msgr2=0x7fafc406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fafc406bca0 0x7fafc406e160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafd4007fd0 tx=0x7fafd4007de0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 msgr2=0x7fafe40b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:14.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe40b74d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007e90 tx=0x7fafdc00e4b0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 shutdown_connections 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fafc406bca0 0x7fafc406e160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fafe40b5fc0 0x7fafe40b74d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafe40a51e0 0x7fafe40b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 --2- 172.21.15.118:0/2196267354 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fafe406fea0 0x7fafe414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.940+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 >> 172.21.15.118:0/2196267354 conn(0x7fafe40bbe30 msgr2=0x7fafe40a44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.941+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 shutdown_connections 2024-02-18T10:01:14.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:14.941+0000 7fafe8925640 1 -- 172.21.15.118:0/2196267354 wait complete. 2024-02-18T10:01:14.954 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:15.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.053+0000 7f1ef0572640 1 Processor -- start 2024-02-18T10:01:15.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.053+0000 7f1ef0572640 1 -- start start 2024-02-18T10:01:15.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1ef0572640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80711e0 0x7f1ee814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1ef0572640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ee80b91e0 0x7f1ee806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1ef0572640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee80ba280 con 0x7f1ee8072be0 2024-02-18T10:01:15.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1ef0572640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee80bab50 con 0x7f1ee80b91e0 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1ef0572640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80ba680 con 0x7f1ee80711e0 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1eedb0d640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1ee8072be0 0x7f1ee8149050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57302/0 (socket says 172.21.15.118:57302) 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1eedb0d640 1 -- 172.21.15.118:0/2092870713 learned_addr learned my addr 172.21.15.118:0/2092870713 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1eeeb0f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ee80b91e0 0x7f1ee806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1eeeb0f640 1 -- 172.21.15.118:0/2092870713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80711e0 msgr2=0x7f1ee814bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.054+0000 7f1eeeb0f640 1 --2- 172.21.15.118:0/2092870713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80711e0 0x7f1ee814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.055+0000 7f1eeeb0f640 1 -- 172.21.15.118:0/2092870713 >> v1:172.21.15.118:6789/0 conn(0x7f1ee8072be0 legacy=0x7f1ee8149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.055+0000 7f1eed30c640 1 -- 172.21.15.118:0/2092870713 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238702706 0 0) 0x7f1ee80ba280 con 0x7f1ee8072be0 2024-02-18T10:01:15.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.055+0000 7f1eeeb0f640 1 -- 172.21.15.118:0/2092870713 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee80ba870 con 0x7f1ee80b91e0 2024-02-18T10:01:15.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.055+0000 7f1eeeb0f640 1 --2- 172.21.15.118:0/2092870713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80b91e0 0x7f1ee806af80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097a0 tx=0x7f1ee002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84041c2e43d39ad server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.055+0000 7f1eed30c640 1 -- 172.21.15.118:0/2092870713 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0031830 con 0x7f1ee80b91e0 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.055+0000 7f1eed30c640 1 -- 172.21.15.118:0/2092870713 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0031990 con 0x7f1ee80b91e0 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.055+0000 7f1eed30c640 1 -- 172.21.15.118:0/2092870713 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0031d20 con 0x7f1ee80b91e0 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 -- 172.21.15.118:0/2092870713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80b91e0 msgr2=0x7f1ee806af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 --2- 172.21.15.118:0/2092870713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80b91e0 0x7f1ee806af80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097a0 tx=0x7f1ee002b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 -- 172.21.15.118:0/2092870713 shutdown_connections 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 --2- 172.21.15.118:0/2092870713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80b91e0 0x7f1ee806af80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 --2- 172.21.15.118:0/2092870713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80711e0 0x7f1ee814bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 -- 172.21.15.118:0/2092870713 >> 172.21.15.118:0/2092870713 conn(0x7f1ee80be420 msgr2=0x7f1ee80be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 -- 172.21.15.118:0/2092870713 shutdown_connections 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.056+0000 7f1ef0572640 1 -- 172.21.15.118:0/2092870713 wait complete. 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.057+0000 7f1ef0572640 1 Processor -- start 2024-02-18T10:01:15.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.057+0000 7f1ef0572640 1 -- start start 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80711e0 0x7f1ee8145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee8072be0 0x7f1ee80a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b91e0 0x7f1ee8142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee8145c90 con 0x7f1ee80711e0 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee80a09b0 con 0x7f1ee8072be0 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee809e660 con 0x7f1ee80b91e0 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80711e0 0x7f1ee8145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80711e0 0x7f1ee8145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46144/0 (socket says 172.21.15.118:46144) 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 -- 172.21.15.118:0/208854330 learned_addr learned my addr 172.21.15.118:0/208854330 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eedb0d640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee8072be0 0x7f1ee80a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eeeb0f640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b91e0 0x7f1ee8142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 -- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b91e0 msgr2=0x7f1ee8142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b91e0 0x7f1ee8142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 -- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee8072be0 msgr2=0x7f1ee80a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee8072be0 0x7f1ee80a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 -- 172.21.15.118:0/208854330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee0009400 con 0x7f1ee80711e0 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1eee30e640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80711e0 0x7f1ee8145750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800ba80 tx=0x7f1ed800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ee6ffd640 1 -- 172.21.15.118:0/208854330 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800cc00 con 0x7f1ee80711e0 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ee6ffd640 1 -- 172.21.15.118:0/208854330 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed800cd80 con 0x7f1ee80711e0 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ee6ffd640 1 -- 172.21.15.118:0/208854330 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8014680 con 0x7f1ee80711e0 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee81453a0 con 0x7f1ee80711e0 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.058+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee809e2f0 con 0x7f1ee80711e0 2024-02-18T10:01:15.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.059+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee809de70 con 0x7f1ee80711e0 2024-02-18T10:01:15.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.060+0000 7f1ee6ffd640 1 -- 172.21.15.118:0/208854330 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f1ed801d3b0 con 0x7f1ee80711e0 2024-02-18T10:01:15.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.060+0000 7f1ee6ffd640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1ed406bc70 0x7f1ed406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.060+0000 7f1ee6ffd640 1 -- 172.21.15.118:0/208854330 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed808a5f0 con 0x7f1ee80711e0 2024-02-18T10:01:15.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.060+0000 7f1eedb0d640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1ed406bc70 0x7f1ed406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.061+0000 7f1eedb0d640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1ed406bc70 0x7f1ed406e130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ee814faf0 tx=0x7f1edc007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.064+0000 7f1ee6ffd640 1 -- 172.21.15.118:0/208854330 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ee809de70 con 0x7f1ee80711e0 2024-02-18T10:01:15.238 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.236+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ee809de70 con 0x7f1ee80711e0 2024-02-18T10:01:15.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.236+0000 7f1ee6ffd640 1 -- 172.21.15.118:0/208854330 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ee809de70 con 0x7f1ee80711e0 2024-02-18T10:01:15.239 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1ed406bc70 msgr2=0x7f1ed406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1ed406bc70 0x7f1ed406e130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ee814faf0 tx=0x7f1edc007d50 comp rx=0 tx=0).stop 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80711e0 msgr2=0x7f1ee8145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80711e0 0x7f1ee8145750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800ba80 tx=0x7f1ed800bf40 comp rx=0 tx=0).stop 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 shutdown_connections 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1ed406bc70 0x7f1ed406e130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1ee80b91e0 0x7f1ee8142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ee8072be0 0x7f1ee80a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 --2- 172.21.15.118:0/208854330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ee80711e0 0x7f1ee8145750 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 >> 172.21.15.118:0/208854330 conn(0x7f1ee80be420 msgr2=0x7f1ee814a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:15.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 shutdown_connections 2024-02-18T10:01:15.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.238+0000 7f1ef0572640 1 -- 172.21.15.118:0/208854330 wait complete. 2024-02-18T10:01:15.251 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-02-18T10:01:15.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.348+0000 7f625580e640 1 Processor -- start 2024-02-18T10:01:15.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.348+0000 7f625580e640 1 -- start start 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f625580e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f62500ba1a0 0x7f625006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f625580e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625006f0b0 0x7f6250145c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f625580e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6250070fe0 con 0x7f6250071f80 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f625580e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625006e0b0 con 0x7f62500ba1a0 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f625580e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6250072e50 con 0x7f625006f0b0 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f624e7fc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f62500ba1a0 0x7f625006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f624f7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625006f0b0 0x7f6250145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f624e7fc640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f62500ba1a0 0x7f625006eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:36002/0 (socket says 172.21.15.118:36002) 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f624effd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6250071f80 0x7f6250072690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:39912/0 (socket says 172.21.15.118:39912) 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.349+0000 7f624e7fc640 1 -- 172.21.15.118:0/3897811315 learned_addr learned my addr 172.21.15.118:0/3897811315 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.350+0000 7f624f7fe640 1 -- 172.21.15.118:0/3897811315 >> v2:172.21.15.164:3300/0 conn(0x7f62500ba1a0 msgr2=0x7f625006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.350+0000 7f624f7fe640 1 --2- 172.21.15.118:0/3897811315 >> v2:172.21.15.164:3300/0 conn(0x7f62500ba1a0 0x7f625006eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.350+0000 7f624f7fe640 1 -- 172.21.15.118:0/3897811315 >> v1:172.21.15.164:6789/0 conn(0x7f6250071f80 legacy=0x7f6250072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.350+0000 7f624f7fe640 1 -- 172.21.15.118:0/3897811315 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250071280 con 0x7f625006f0b0 2024-02-18T10:01:15.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.350+0000 7f624e7fc640 1 --2- 172.21.15.118:0/3897811315 >> v2:172.21.15.164:3300/0 conn(0x7f62500ba1a0 0x7f625006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:01:15.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f624f7fe640 1 --2- 172.21.15.118:0/3897811315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625006f0b0 0x7f6250145c50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f62480097a0 tx=0x7f624802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5e53a8ec13d96a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f624dffb640 1 -- 172.21.15.118:0/3897811315 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248030610 con 0x7f625006f0b0 2024-02-18T10:01:15.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f624dffb640 1 -- 172.21.15.118:0/3897811315 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6248030770 con 0x7f625006f0b0 2024-02-18T10:01:15.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f624dffb640 1 -- 172.21.15.118:0/3897811315 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248030b00 con 0x7f625006f0b0 2024-02-18T10:01:15.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 -- 172.21.15.118:0/3897811315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625006f0b0 msgr2=0x7f6250145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 --2- 172.21.15.118:0/3897811315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625006f0b0 0x7f6250145c50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f62480097a0 tx=0x7f624802b960 comp rx=0 tx=0).stop 2024-02-18T10:01:15.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 -- 172.21.15.118:0/3897811315 shutdown_connections 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 --2- 172.21.15.118:0/3897811315 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625006f0b0 0x7f6250145c50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 --2- 172.21.15.118:0/3897811315 >> v2:172.21.15.164:3300/0 conn(0x7f62500ba1a0 0x7f625006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 -- 172.21.15.118:0/3897811315 >> 172.21.15.118:0/3897811315 conn(0x7f625006bcf0 msgr2=0x7f625006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 -- 172.21.15.118:0/3897811315 shutdown_connections 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.351+0000 7f625580e640 1 -- 172.21.15.118:0/3897811315 wait complete. 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.352+0000 7f625580e640 1 Processor -- start 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f625580e640 1 -- start start 2024-02-18T10:01:15.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f625580e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625006f0b0 0x7f625014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f625580e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6250071f80 0x7f625009e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f625580e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62500ba1a0 0x7f62500a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f625580e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625014fb20 con 0x7f6250071f80 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f625580e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625014fd00 con 0x7f625006f0b0 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f625580e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625009ec40 con 0x7f62500ba1a0 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f624e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6250071f80 0x7f625009e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f624e7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6250071f80 0x7f625009e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46156/0 (socket says 172.21.15.118:46156) 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.353+0000 7f624e7fc640 1 -- 172.21.15.118:0/1369971366 learned_addr learned my addr 172.21.15.118:0/1369971366 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624f7fe640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62500ba1a0 0x7f62500a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624effd640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625006f0b0 0x7f625014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624e7fc640 1 -- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62500ba1a0 msgr2=0x7f62500a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624e7fc640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62500ba1a0 0x7f62500a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624e7fc640 1 -- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625006f0b0 msgr2=0x7f625014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624e7fc640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625006f0b0 0x7f625014f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624e7fc640 1 -- 172.21.15.118:0/1369971366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440094d0 con 0x7f6250071f80 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624effd640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625006f0b0 0x7f625014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f624e7fc640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6250071f80 0x7f625009e150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f624400e9b0 tx=0x7f624400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f6237fff640 1 -- 172.21.15.118:0/1369971366 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400c9a0 con 0x7f6250071f80 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f6237fff640 1 -- 172.21.15.118:0/1369971366 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624400cb00 con 0x7f6250071f80 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6248009400 con 0x7f6250071f80 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f6237fff640 1 -- 172.21.15.118:0/1369971366 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400ce70 con 0x7f6250071f80 2024-02-18T10:01:15.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.354+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625014cf20 con 0x7f6250071f80 2024-02-18T10:01:15.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.355+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62501e1aa0 con 0x7f6250071f80 2024-02-18T10:01:15.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.355+0000 7f6237fff640 1 -- 172.21.15.118:0/1369971366 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f6244013470 con 0x7f6250071f80 2024-02-18T10:01:15.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.356+0000 7f6237fff640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f623c06bc70 0x7f623c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.356+0000 7f624effd640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f623c06bc70 0x7f623c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.356+0000 7f6237fff640 1 -- 172.21.15.118:0/1369971366 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f624408ad50 con 0x7f6250071f80 2024-02-18T10:01:15.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.356+0000 7f624effd640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f623c06bc70 0x7f623c06e130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6240007fd0 tx=0x7f6240009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.360+0000 7f6237fff640 1 -- 172.21.15.118:0/1369971366 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f624408e030 con 0x7f6250071f80 2024-02-18T10:01:15.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.597+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f6250074af0 con 0x7f6250071f80 2024-02-18T10:01:15.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.829+0000 7f6237fff640 1 -- 172.21.15.118:0/1369971366 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v43) v1 ==== 166+0+0 (secure 0 0 0) 0x7f6244055530 con 0x7f6250071f80 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f623c06bc70 msgr2=0x7f623c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f623c06bc70 0x7f623c06e130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6240007fd0 tx=0x7f6240009040 comp rx=0 tx=0).stop 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6250071f80 msgr2=0x7f625009e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6250071f80 0x7f625009e150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f624400e9b0 tx=0x7f624400ee70 comp rx=0 tx=0).stop 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 shutdown_connections 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f623c06bc70 0x7f623c06e130 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62500ba1a0 0x7f62500a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6250071f80 0x7f625009e150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 --2- 172.21.15.118:0/1369971366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625006f0b0 0x7f625014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 >> 172.21.15.118:0/1369971366 conn(0x7f625006bcf0 msgr2=0x7f625006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 shutdown_connections 2024-02-18T10:01:15.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.831+0000 7f625580e640 1 -- 172.21.15.118:0/1369971366 wait complete. 2024-02-18T10:01:15.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-18T10:01:15.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.945+0000 7f347fb0c640 1 Processor -- start 2024-02-18T10:01:15.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.945+0000 7f347fb0c640 1 -- start start 2024-02-18T10:01:15.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347fb0c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347806f930 0x7f3478149c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347fb0c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f347814cf80 0x7f347814a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347fb0c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34780bfd10 con 0x7f3478143e10 2024-02-18T10:01:15.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347fb0c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347814d460 con 0x7f347814cf80 2024-02-18T10:01:15.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347fb0c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347814d740 con 0x7f347806f930 2024-02-18T10:01:15.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347d0a7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347806f930 0x7f3478149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347e0a9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f347814cf80 0x7f347814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347d0a7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347806f930 0x7f3478149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:60960/0 (socket says 172.21.15.118:60960) 2024-02-18T10:01:15.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347e0a9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f347814cf80 0x7f347814a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:36014/0 (socket says 172.21.15.118:36014) 2024-02-18T10:01:15.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347d0a7640 1 -- 172.21.15.118:0/3344224548 learned_addr learned my addr 172.21.15.118:0/3344224548 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:15.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347e0a9640 1 -- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347806f930 msgr2=0x7f3478149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347e0a9640 1 --2- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347806f930 0x7f3478149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347e0a9640 1 -- 172.21.15.118:0/3344224548 >> v1:172.21.15.164:6789/0 conn(0x7f3478143e10 legacy=0x7f34780bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347e0a9640 1 -- 172.21.15.118:0/3344224548 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347814da20 con 0x7f347814cf80 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.946+0000 7f347d0a7640 1 --2- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347806f930 0x7f3478149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.947+0000 7f347e0a9640 1 --2- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f347814cf80 0x7f347814a140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3470009d90 tx=0x7f347002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d990f67a12c757 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.947+0000 7f347c8a6640 1 -- 172.21.15.118:0/3344224548 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347002cce0 con 0x7f347814cf80 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.947+0000 7f347c8a6640 1 -- 172.21.15.118:0/3344224548 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347002ce40 con 0x7f347814cf80 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.947+0000 7f347c8a6640 1 -- 172.21.15.118:0/3344224548 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470034660 con 0x7f347814cf80 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 -- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f347814cf80 msgr2=0x7f347814a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 --2- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f347814cf80 0x7f347814a140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3470009d90 tx=0x7f347002bf30 comp rx=0 tx=0).stop 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 -- 172.21.15.118:0/3344224548 shutdown_connections 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 --2- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f347814cf80 0x7f347814a140 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 --2- 172.21.15.118:0/3344224548 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347806f930 0x7f3478149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 -- 172.21.15.118:0/3344224548 >> 172.21.15.118:0/3344224548 conn(0x7f347806adc0 msgr2=0x7f347806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:15.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 -- 172.21.15.118:0/3344224548 shutdown_connections 2024-02-18T10:01:15.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.948+0000 7f347fb0c640 1 -- 172.21.15.118:0/3344224548 wait complete. 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.949+0000 7f347fb0c640 1 Processor -- start 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.949+0000 7f347fb0c640 1 -- start start 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3478143e10 0x7f34781d6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347814cf80 0x7f34781466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34781d2da0 0x7f34781e3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34781e2f50 con 0x7f3478143e10 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478146c20 con 0x7f34781d2da0 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34781d3ed0 con 0x7f347814cf80 2024-02-18T10:01:15.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3478143e10 0x7f34781d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3478143e10 0x7f34781d6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46170/0 (socket says 172.21.15.118:46170) 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 -- 172.21.15.118:0/1706910428 learned_addr learned my addr 172.21.15.118:0/1706910428 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d0a7640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347814cf80 0x7f34781466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347e0a9640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34781d2da0 0x7f34781e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 -- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347814cf80 msgr2=0x7f34781466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347814cf80 0x7f34781466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 -- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34781d2da0 msgr2=0x7f34781e3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34781d2da0 0x7f34781e3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 -- 172.21.15.118:0/1706910428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34680094d0 con 0x7f3478143e10 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347d8a8640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3478143e10 0x7f34781d6730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f347400c430 tx=0x7f347400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f346e7fc640 1 -- 172.21.15.118:0/1706910428 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740052d0 con 0x7f3478143e10 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f346e7fc640 1 -- 172.21.15.118:0/1706910428 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3474005450 con 0x7f3478143e10 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3470009a70 con 0x7f3478143e10 2024-02-18T10:01:15.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f346e7fc640 1 -- 172.21.15.118:0/1706910428 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474007260 con 0x7f3478143e10 2024-02-18T10:01:15.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.950+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3478146fd0 con 0x7f3478143e10 2024-02-18T10:01:15.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.951+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3478075150 con 0x7f3478143e10 2024-02-18T10:01:15.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.952+0000 7f346e7fc640 1 -- 172.21.15.118:0/1706910428 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f34740073c0 con 0x7f3478143e10 2024-02-18T10:01:15.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.952+0000 7f346e7fc640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f345c06bc70 0x7f345c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:15.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.952+0000 7f347d0a7640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f345c06bc70 0x7f345c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:15.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.952+0000 7f346e7fc640 1 -- 172.21.15.118:0/1706910428 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3474089a90 con 0x7f3478143e10 2024-02-18T10:01:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.953+0000 7f347d0a7640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f345c06bc70 0x7f345c06e130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f34780bf080 tx=0x7f3468009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:15.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:15.957+0000 7f346e7fc640 1 -- 172.21.15.118:0/1706910428 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34740543b0 con 0x7f3478143e10 2024-02-18T10:01:16.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.127+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3478149950 con 0x7f3478143e10 2024-02-18T10:01:16.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.130+0000 7f346e7fc640 1 -- 172.21.15.118:0/1706910428 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3474057a70 con 0x7f3478143e10 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f345c06bc70 msgr2=0x7f345c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f345c06bc70 0x7f345c06e130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f34780bf080 tx=0x7f3468009240 comp rx=0 tx=0).stop 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3478143e10 msgr2=0x7f34781d6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3478143e10 0x7f34781d6730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f347400c430 tx=0x7f347400c8f0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 shutdown_connections 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f345c06bc70 0x7f345c06e130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34781d2da0 0x7f34781e3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f347814cf80 0x7f34781466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 --2- 172.21.15.118:0/1706910428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3478143e10 0x7f34781d6730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 >> 172.21.15.118:0/1706910428 conn(0x7f347806adc0 msgr2=0x7f3478147a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:16.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 shutdown_connections 2024-02-18T10:01:16.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.132+0000 7f347fb0c640 1 -- 172.21.15.118:0/1706910428 wait complete. 2024-02-18T10:01:16.145 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-18T10:01:16.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-18T10:01:16.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-18T10:01:16.320 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-18T10:01:16.433 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-18T10:01:16.433 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:01:16.433 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T10:01:16.486 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:01:16.486 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T10:01:16.537 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:01:16.537 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T10:01:16.587 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:16.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.687+0000 7fe2fa8d4640 1 Processor -- start 2024-02-18T10:01:16.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.687+0000 7fe2fa8d4640 1 -- start start 2024-02-18T10:01:16.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2fa8d4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 0x7fe2f4148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:16.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2fa8d4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2f4072060 0x7fe2f41531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:16.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2fa8d4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f4149450 con 0x7fe2f4072bd0 2024-02-18T10:01:16.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2fa8d4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f4143100 con 0x7fe2f4072060 2024-02-18T10:01:16.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2fa8d4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4070510 con 0x7fe2f4142d20 2024-02-18T10:01:16.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2f8e71640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2f4072060 0x7fe2f41531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2f8e71640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2f4072060 0x7fe2f41531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46172/0 (socket says 172.21.15.118:46172) 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2f8e71640 1 -- 172.21.15.118:0/1607821867 learned_addr learned my addr 172.21.15.118:0/1607821867 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2f8e71640 1 -- 172.21.15.118:0/1607821867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 msgr2=0x7fe2f4148900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2f8e71640 1 --2- 172.21.15.118:0/1607821867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 0x7fe2f4148900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2f8e71640 1 -- 172.21.15.118:0/1607821867 >> v1:172.21.15.164:6789/0 conn(0x7fe2f4072bd0 legacy=0x7fe2f4071950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.688+0000 7fe2f8e71640 1 -- 172.21.15.118:0/1607821867 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f406ff90 con 0x7fe2f4072060 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2f8e71640 1 --2- 172.21.15.118:0/1607821867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f41531e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00d150 tx=0x7fe2ec02e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4e09e269a122fa server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2f2ffd640 1 -- 172.21.15.118:0/1607821867 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec02ea90 con 0x7fe2f4072060 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2f2ffd640 1 -- 172.21.15.118:0/1607821867 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec02ebf0 con 0x7fe2f4072060 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2f2ffd640 1 -- 172.21.15.118:0/1607821867 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec009600 con 0x7fe2f4072060 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/1607821867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 msgr2=0x7fe2f41531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:16.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/1607821867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f41531e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00d150 tx=0x7fe2ec02e0f0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/1607821867 shutdown_connections 2024-02-18T10:01:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/1607821867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f41531e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/1607821867 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 0x7fe2f4148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.689+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/1607821867 >> 172.21.15.118:0/1607821867 conn(0x7fe2f40b9ca0 msgr2=0x7fe2f40ba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.690+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/1607821867 shutdown_connections 2024-02-18T10:01:16.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.690+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/1607821867 wait complete. 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 Processor -- start 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 -- start start 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f40b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2f4072bd0 0x7fe2f406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 0x7fe2f41dd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f406d420 con 0x7fe2f4072060 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f414b710 con 0x7fe2f4072bd0 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2fa8d4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40b6b50 con 0x7fe2f4142d20 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2f3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f40b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2f3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f40b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46186/0 (socket says 172.21.15.118:46186) 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.691+0000 7fe2f3fff640 1 -- 172.21.15.118:0/2771760667 learned_addr learned my addr 172.21.15.118:0/2771760667 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:16.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f3fff640 1 -- 172.21.15.118:0/2771760667 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 msgr2=0x7fe2f41dd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f3fff640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 0x7fe2f41dd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f3fff640 1 -- 172.21.15.118:0/2771760667 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2f4072bd0 msgr2=0x7fe2f406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f37fe640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2f4072bd0 0x7fe2f406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f3fff640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2f4072bd0 0x7fe2f406cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f3fff640 1 -- 172.21.15.118:0/2771760667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec00bd40 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f3fff640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f40b2b80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400b410 tx=0x7fe2e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f0ff9640 1 -- 172.21.15.118:0/2771760667 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4011830 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f0ff9640 1 -- 172.21.15.118:0/2771760667 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4011990 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f41dd710 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2f0ff9640 1 -- 172.21.15.118:0/2771760667 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4011d40 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.692+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40b6da0 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.693+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f4074af0 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.693+0000 7fe2f0ff9640 1 -- 172.21.15.118:0/2771760667 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe2e401a410 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.694+0000 7fe2f0ff9640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe2e006bca0 0x7fe2e006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.694+0000 7fe2f0ff9640 1 -- 172.21.15.118:0/2771760667 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2e408a340 con 0x7fe2f4072060 2024-02-18T10:01:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.694+0000 7fe2f37fe640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe2e006bca0 0x7fe2e006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:16.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.694+0000 7fe2f37fe640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe2e006bca0 0x7fe2e006e160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4140400 tx=0x7fe2e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:16.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.698+0000 7fe2f0ff9640 1 -- 172.21.15.118:0/2771760667 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2e4054b20 con 0x7fe2f4072060 2024-02-18T10:01:16.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.871+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2f41408e0 con 0x7fe2f4072060 2024-02-18T10:01:16.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.872+0000 7fe2f0ff9640 1 -- 172.21.15.118:0/2771760667 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fe2e40581e0 con 0x7fe2f4072060 2024-02-18T10:01:16.874 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:16.875 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe2e006bca0 msgr2=0x7fe2e006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe2e006bca0 0x7fe2e006e160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4140400 tx=0x7fe2e8008040 comp rx=0 tx=0).stop 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 msgr2=0x7fe2f40b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f40b2b80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400b410 tx=0x7fe2e400b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 shutdown_connections 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe2e006bca0 0x7fe2e006e160 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe2f4142d20 0x7fe2f41dd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2f4072bd0 0x7fe2f406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 --2- 172.21.15.118:0/2771760667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2f4072060 0x7fe2f40b2b80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 >> 172.21.15.118:0/2771760667 conn(0x7fe2f40b9ca0 msgr2=0x7fe2f41411e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 shutdown_connections 2024-02-18T10:01:16.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.874+0000 7fe2fa8d4640 1 -- 172.21.15.118:0/2771760667 wait complete. 2024-02-18T10:01:16.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:16.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:16.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.987+0000 7f7359e0e640 1 Processor -- start 2024-02-18T10:01:16.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.987+0000 7f7359e0e640 1 -- start start 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f7359e0e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 0x7f735406f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f7359e0e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735406f6d0 con 0x7f735406d9d0 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f7359e0e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540bbc00 con 0x7f735414c790 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f7359e0e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540b65c0 con 0x7f735406bf60 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f734affd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f735406d9d0 0x7f735406fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57312/0 (socket says 172.21.15.118:57312) 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f734affd640 1 -- 172.21.15.118:0/1425080615 learned_addr learned my addr 172.21.15.118:0/1425080615 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509193264 0 0) 0x7f735406f6d0 con 0x7f735406d9d0 2024-02-18T10:01:16.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7340003520 con 0x7f735406d9d0 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.988+0000 7f73537fe640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 0x7f735406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477123730 0 0) 0x7f7340003520 con 0x7f735406d9d0 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 msgr2=0x7f735406f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 0x7f735406f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 >> v1:172.21.15.164:6789/0 conn(0x7f735414c790 legacy=0x7f7354156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735414bcd0 con 0x7f735406d9d0 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f733c001670 con 0x7f735406d9d0 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 >> v1:172.21.15.118:6789/0 conn(0x7f735406d9d0 legacy=0x7f735406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 0x7f73400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7340003f20 0x7f73400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7340004d00 0x7f7340005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540b65c0 con 0x7f7340004d00 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734000baf0 con 0x7f7340003f20 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734000bcb0 con 0x7f735406bf60 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7353fff640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7340004d00 0x7f7340005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f734affd640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7340003f20 0x7f73400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f73537fe640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 0x7f73400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7353fff640 1 -- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 msgr2=0x7f73400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7353fff640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 0x7f73400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7353fff640 1 -- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7340003f20 msgr2=0x7f73400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7353fff640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7340003f20 0x7f73400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f7353fff640 1 -- 172.21.15.118:0/1425080615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340003520 con 0x7f7340004d00 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.989+0000 7f73537fe640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f735406bf60 0x7f73400039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.990+0000 7f7353fff640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7340004d00 0x7f7340005180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f734c001e50 tx=0x7f73400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aa1e7b98c9c404 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.990+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c003b70 con 0x7f7340004d00 2024-02-18T10:01:17.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.990+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c003cd0 con 0x7f7340004d00 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.990+0000 7f7352ffd640 1 -- 172.21.15.118:0/1425080615 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c005310 con 0x7f7340004d00 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.990+0000 7f7359e0e640 1 -- 172.21.15.118:0/1425080615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7340004d00 msgr2=0x7f7340005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.990+0000 7f7359e0e640 1 --2- 172.21.15.118:0/1425080615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7340004d00 0x7f7340005180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f734c001e50 tx=0x7f73400057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.990+0000 7f7353fff640 1 -- 172.21.15.118:0/1425080615 reap_dead start 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.991+0000 7f7359e0e640 1 -- 172.21.15.118:0/1425080615 shutdown_connections 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.991+0000 7f7359e0e640 1 -- 172.21.15.118:0/1425080615 >> 172.21.15.118:0/1425080615 conn(0x7f73540bbe30 msgr2=0x7f73540bc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.991+0000 7f7359e0e640 1 -- 172.21.15.118:0/1425080615 shutdown_connections 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.991+0000 7f7359e0e640 1 -- 172.21.15.118:0/1425080615 wait complete. 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 Processor -- start 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 -- start start 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7340004d00 0x7f73541e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f735414fbf0 0x7f735414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f735414e260 0x7f73540a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73541e5ce0 con 0x7f735414fbf0 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735414ec20 con 0x7f735414e260 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f7359e0e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735414cc80 con 0x7f7340004d00 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f734affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f735414fbf0 0x7f735414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f734affd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f735414fbf0 0x7f735414dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46194/0 (socket says 172.21.15.118:46194) 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.992+0000 7f734affd640 1 -- 172.21.15.118:0/919341859 learned_addr learned my addr 172.21.15.118:0/919341859 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f734affd640 1 -- 172.21.15.118:0/919341859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7340004d00 msgr2=0x7f73541e57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f734affd640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7340004d00 0x7f73541e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f7353fff640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f735414e260 0x7f73540a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f734affd640 1 -- 172.21.15.118:0/919341859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f735414e260 msgr2=0x7f73540a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f734affd640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f735414e260 0x7f73540a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f734affd640 1 -- 172.21.15.118:0/919341859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735414cf60 con 0x7f735414fbf0 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f734affd640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f735414fbf0 0x7f735414dd20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f733c0011e0 tx=0x7f733c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f7350ff9640 1 -- 172.21.15.118:0/919341859 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00f9c0 con 0x7f735414fbf0 2024-02-18T10:01:17.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f7350ff9640 1 -- 172.21.15.118:0/919341859 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c00fb40 con 0x7f735414fbf0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735414d240 con 0x7f735414fbf0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f7350ff9640 1 -- 172.21.15.118:0/919341859 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0133f0 con 0x7f735414fbf0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.993+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735414d800 con 0x7f735414fbf0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.994+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354075150 con 0x7f735414fbf0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.994+0000 7f7350ff9640 1 -- 172.21.15.118:0/919341859 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f733c013550 con 0x7f735414fbf0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.995+0000 7f7350ff9640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f733406bca0 0x7f733406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.995+0000 7f73537fe640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f733406bca0 0x7f733406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.995+0000 7f7350ff9640 1 -- 172.21.15.118:0/919341859 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f733c08a8c0 con 0x7f735414fbf0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.995+0000 7f73537fe640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f733406bca0 0x7f733406e160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7344009930 tx=0x7f7344008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:16.999+0000 7f7350ff9640 1 -- 172.21.15.118:0/919341859 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f733c0550a0 con 0x7f735414fbf0 2024-02-18T10:01:17.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.169+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7354074af0 con 0x7f735414fbf0 2024-02-18T10:01:17.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.170+0000 7f7350ff9640 1 -- 172.21.15.118:0/919341859 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f733c058760 con 0x7f735414fbf0 2024-02-18T10:01:17.173 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:17.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.171+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f733406bca0 msgr2=0x7f733406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.171+0000 7f7359e0e640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f733406bca0 0x7f733406e160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7344009930 tx=0x7f7344008040 comp rx=0 tx=0).stop 2024-02-18T10:01:17.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.171+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f735414fbf0 msgr2=0x7f735414dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.171+0000 7f7359e0e640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f735414fbf0 0x7f735414dd20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f733c0011e0 tx=0x7f733c007720 comp rx=0 tx=0).stop 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 shutdown_connections 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f733406bca0 0x7f733406e160 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f735414e260 0x7f73540a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f735414fbf0 0x7f735414dd20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 --2- 172.21.15.118:0/919341859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7340004d00 0x7f73541e57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 >> 172.21.15.118:0/919341859 conn(0x7f73540bbe30 msgr2=0x7f7354149a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 shutdown_connections 2024-02-18T10:01:17.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.172+0000 7f7359e0e640 1 -- 172.21.15.118:0/919341859 wait complete. 2024-02-18T10:01:17.185 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:17.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.285+0000 7f699a2f2640 1 Processor -- start 2024-02-18T10:01:17.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.285+0000 7f699a2f2640 1 -- start start 2024-02-18T10:01:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699a2f2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f69940b9bc0 0x7f69940717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699a2f2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 0x7f699406d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699a2f2640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69940b5360 con 0x7f699406deb0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699a2f2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6994146370 con 0x7f69940b9bc0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699a2f2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699406e560 con 0x7f69940725c0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699888f640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f699406deb0 0x7f699406abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57320/0 (socket says 172.21.15.118:57320) 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699888f640 1 -- 172.21.15.118:0/462081931 learned_addr learned my addr 172.21.15.118:0/462081931 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6993fff640 1 --2- 172.21.15.118:0/462081931 >> v2:172.21.15.164:3300/0 conn(0x7f69940b9bc0 0x7f69940717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f69937fe640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 0x7f699406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730630518 0 0) 0x7f69940b5360 con 0x7f699406deb0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f697c003520 con 0x7f699406deb0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 330096999 0 0) 0x7f697c003520 con 0x7f699406deb0 2024-02-18T10:01:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 msgr2=0x7f699406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 0x7f699406d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 >> v2:172.21.15.164:3300/0 conn(0x7f69940b9bc0 msgr2=0x7f69940717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 --2- 172.21.15.118:0/462081931 >> v2:172.21.15.164:3300/0 conn(0x7f69940b9bc0 0x7f69940717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994071dc0 con 0x7f699406deb0 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f698c0019f0 con 0x7f699406deb0 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 >> v1:172.21.15.118:6789/0 conn(0x7f699406deb0 legacy=0x7f699406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c003970 0x7f697c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 0x7f697c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f697c004d00 0x7f697c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6994146370 con 0x7f697c004d00 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c00b980 con 0x7f697c003970 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c00bac0 con 0x7f69940725c0 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f699888f640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f697c004d00 0x7f697c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f6993fff640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c003970 0x7f697c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.286+0000 7f69937fe640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 0x7f697c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f699888f640 1 -- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 msgr2=0x7f697c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f699888f640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f69940725c0 0x7f697c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f699888f640 1 -- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c003970 msgr2=0x7f697c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f699888f640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f697c003970 0x7f697c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f699888f640 1 -- 172.21.15.118:0/462081931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c003520 con 0x7f697c004d00 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f699888f640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f697c004d00 0x7f697c005180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f698c00a8d0 tx=0x7f697c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3354e9094ddfe8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c034630 con 0x7f697c004d00 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c02f070 con 0x7f697c004d00 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.287+0000 7f6992ffd640 1 -- 172.21.15.118:0/462081931 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c0349d0 con 0x7f697c004d00 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.288+0000 7f699a2f2640 1 -- 172.21.15.118:0/462081931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f697c004d00 msgr2=0x7f697c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.288+0000 7f699a2f2640 1 --2- 172.21.15.118:0/462081931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f697c004d00 0x7f697c005180 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f698c00a8d0 tx=0x7f697c0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.288+0000 7f699888f640 1 -- 172.21.15.118:0/462081931 reap_dead start 2024-02-18T10:01:17.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.288+0000 7f699a2f2640 1 -- 172.21.15.118:0/462081931 shutdown_connections 2024-02-18T10:01:17.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.288+0000 7f699a2f2640 1 -- 172.21.15.118:0/462081931 >> 172.21.15.118:0/462081931 conn(0x7f699406bed0 msgr2=0x7f699406c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:17.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.288+0000 7f699a2f2640 1 -- 172.21.15.118:0/462081931 shutdown_connections 2024-02-18T10:01:17.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.288+0000 7f699a2f2640 1 -- 172.21.15.118:0/462081931 wait complete. 2024-02-18T10:01:17.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.289+0000 7f699a2f2640 1 Processor -- start 2024-02-18T10:01:17.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.289+0000 7f699a2f2640 1 -- start start 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699a2f2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f699414e7f0 0x7f69941435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699a2f2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6994143ae0 0x7f6994141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699a2f2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6994141b90 0x7f699409f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699a2f2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699409e9b0 con 0x7f6994143ae0 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699a2f2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69940a02b0 con 0x7f699414e7f0 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699a2f2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6994142990 con 0x7f6994141b90 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6994143ae0 0x7f6994141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6994143ae0 0x7f6994141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46212/0 (socket says 172.21.15.118:46212) 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 -- 172.21.15.118:0/3956840568 learned_addr learned my addr 172.21.15.118:0/3956840568 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:17.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f6993fff640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f699414e7f0 0x7f69941435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699888f640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6994141b90 0x7f699409f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 -- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6994141b90 msgr2=0x7f699409f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6994141b90 0x7f699409f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 -- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f699414e7f0 msgr2=0x7f69941435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f699414e7f0 0x7f69941435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 -- 172.21.15.118:0/3956840568 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940a0870 con 0x7f6994143ae0 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f6993fff640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f699414e7f0 0x7f69941435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f69937fe640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6994143ae0 0x7f6994141650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f69880119a0 tx=0x7f6988011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f6990ff9640 1 -- 172.21.15.118:0/3956840568 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800faf0 con 0x7f6994143ae0 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f6990ff9640 1 -- 172.21.15.118:0/3956840568 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800fc50 con 0x7f6994143ae0 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69940a0b50 con 0x7f6994143ae0 2024-02-18T10:01:17.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.290+0000 7f6990ff9640 1 -- 172.21.15.118:0/3956840568 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988014440 con 0x7f6994143ae0 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.291+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699414ebd0 con 0x7f6994143ae0 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.292+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6994075150 con 0x7f6994143ae0 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.292+0000 7f6990ff9640 1 -- 172.21.15.118:0/3956840568 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f69880145a0 con 0x7f6994143ae0 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.292+0000 7f6990ff9640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f698006bc70 0x7f698006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.293+0000 7f6993fff640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f698006bc70 0x7f698006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.293+0000 7f6990ff9640 1 -- 172.21.15.118:0/3956840568 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f698808b010 con 0x7f6994143ae0 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.293+0000 7f6993fff640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f698006bc70 0x7f698006e130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6984009bc0 tx=0x7f6984008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.297+0000 7f6990ff9640 1 -- 172.21.15.118:0/3956840568 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6988055880 con 0x7f6994143ae0 2024-02-18T10:01:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.465+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69940bd170 con 0x7f6994143ae0 2024-02-18T10:01:17.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.465+0000 7f6990ff9640 1 -- 172.21.15.118:0/3956840568 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6988058f40 con 0x7f6994143ae0 2024-02-18T10:01:17.468 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f698006bc70 msgr2=0x7f698006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f698006bc70 0x7f698006e130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6984009bc0 tx=0x7f6984008040 comp rx=0 tx=0).stop 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6994143ae0 msgr2=0x7f6994141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6994143ae0 0x7f6994141650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f69880119a0 tx=0x7f6988011e60 comp rx=0 tx=0).stop 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 shutdown_connections 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f698006bc70 0x7f698006e130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6994141b90 0x7f699409f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6994143ae0 0x7f6994141650 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 --2- 172.21.15.118:0/3956840568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f699414e7f0 0x7f69941435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 >> 172.21.15.118:0/3956840568 conn(0x7f699406bed0 msgr2=0x7f69940bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 shutdown_connections 2024-02-18T10:01:17.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.467+0000 7f699a2f2640 1 -- 172.21.15.118:0/3956840568 wait complete. 2024-02-18T10:01:17.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:17.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.580+0000 7fb5fe22e640 1 Processor -- start 2024-02-18T10:01:17.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.580+0000 7fb5fe22e640 1 -- start start 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5fe22e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5f8143d30 0x7fb5f80b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5fe22e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f814d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5fe22e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80b3b30 con 0x7fb5f80a4160 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5fe22e640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f814d0d0 con 0x7fb5f8143d30 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5fe22e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80b4570 con 0x7fb5f814d4f0 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f77fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5f8143d30 0x7fb5f80b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f77fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb5f8143d30 0x7fb5f80b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46222/0 (socket says 172.21.15.118:46222) 2024-02-18T10:01:17.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f77fe640 1 -- 172.21.15.118:0/2642098536 learned_addr learned my addr 172.21.15.118:0/2642098536 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f7fff640 1 --2- 172.21.15.118:0/2642098536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f77fe640 1 -- 172.21.15.118:0/2642098536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 msgr2=0x7fb5f814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f77fe640 1 --2- 172.21.15.118:0/2642098536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f814d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f77fe640 1 -- 172.21.15.118:0/2642098536 >> v1:172.21.15.164:6789/0 conn(0x7fb5f80a4160 legacy=0x7fb5f80b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.581+0000 7fb5f77fe640 1 -- 172.21.15.118:0/2642098536 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f8072dd0 con 0x7fb5f8143d30 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.582+0000 7fb5f77fe640 1 --2- 172.21.15.118:0/2642098536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f8143d30 0x7fb5f80b5030 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009870 tx=0x7fb5e802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fdc10001202387 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.582+0000 7fb5f67fc640 1 -- 172.21.15.118:0/2642098536 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8030840 con 0x7fb5f8143d30 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.582+0000 7fb5f67fc640 1 -- 172.21.15.118:0/2642098536 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e80309a0 con 0x7fb5f8143d30 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.582+0000 7fb5f67fc640 1 -- 172.21.15.118:0/2642098536 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8030d30 con 0x7fb5f8143d30 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.582+0000 7fb5fe22e640 1 -- 172.21.15.118:0/2642098536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f8143d30 msgr2=0x7fb5f80b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.582+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/2642098536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f8143d30 0x7fb5f80b5030 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009870 tx=0x7fb5e802b980 comp rx=0 tx=0).stop 2024-02-18T10:01:17.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.583+0000 7fb5fe22e640 1 -- 172.21.15.118:0/2642098536 shutdown_connections 2024-02-18T10:01:17.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.583+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/2642098536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f814d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.583+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/2642098536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f8143d30 0x7fb5f80b5030 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.583+0000 7fb5fe22e640 1 -- 172.21.15.118:0/2642098536 >> 172.21.15.118:0/2642098536 conn(0x7fb5f806bed0 msgr2=0x7fb5f806c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:17.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.583+0000 7fb5fe22e640 1 -- 172.21.15.118:0/2642098536 shutdown_connections 2024-02-18T10:01:17.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.583+0000 7fb5fe22e640 1 -- 172.21.15.118:0/2642098536 wait complete. 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 Processor -- start 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 -- start start 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5f8143d30 0x7fb5f8146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f80b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f80b59a0 0x7fb5f80b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80b5e10 con 0x7fb5f80b59a0 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f8148a50 con 0x7fb5f8143d30 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5fe22e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80b76d0 con 0x7fb5f814d4f0 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f80b59a0 0x7fb5f80b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f80b59a0 0x7fb5f80b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46234/0 (socket says 172.21.15.118:46234) 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5f7fff640 1 -- 172.21.15.118:0/8478634 learned_addr learned my addr 172.21.15.118:0/8478634 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.584+0000 7fb5f77fe640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5f8143d30 0x7fb5f8146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5f6ffd640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f80b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5f7fff640 1 -- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 msgr2=0x7fb5f80b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5f7fff640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f80b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5f7fff640 1 -- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5f8143d30 msgr2=0x7fb5f8146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5f7fff640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5f8143d30 0x7fb5f8146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5f7fff640 1 -- 172.21.15.118:0/8478634 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80094d0 con 0x7fb5f80b59a0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5f7fff640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f80b59a0 0x7fb5f80b6390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000efc0 tx=0x7fb5f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5dffff640 1 -- 172.21.15.118:0/8478634 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0009ba0 con 0x7fb5f80b59a0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5dffff640 1 -- 172.21.15.118:0/8478634 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f000f040 con 0x7fb5f80b59a0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f80b79b0 con 0x7fb5f80b59a0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5dffff640 1 -- 172.21.15.118:0/8478634 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00146c0 con 0x7fb5f80b59a0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.585+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80b7f70 con 0x7fb5f80b59a0 2024-02-18T10:01:17.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.586+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f8075150 con 0x7fb5f80b59a0 2024-02-18T10:01:17.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.586+0000 7fb5dffff640 1 -- 172.21.15.118:0/8478634 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fb5f0014820 con 0x7fb5f80b59a0 2024-02-18T10:01:17.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.587+0000 7fb5dffff640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb5e406bc70 0x7fb5e406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.587+0000 7fb5f77fe640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb5e406bc70 0x7fb5e406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.587+0000 7fb5dffff640 1 -- 172.21.15.118:0/8478634 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5f008b160 con 0x7fb5f80b59a0 2024-02-18T10:01:17.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.587+0000 7fb5f77fe640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb5e406bc70 0x7fb5e406e130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8036000 tx=0x7fb5e8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.591+0000 7fb5dffff640 1 -- 172.21.15.118:0/8478634 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5f0055a00 con 0x7fb5f80b59a0 2024-02-18T10:01:17.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.762+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5f8074af0 con 0x7fb5f80b59a0 2024-02-18T10:01:17.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.762+0000 7fb5dffff640 1 -- 172.21.15.118:0/8478634 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5f00590c0 con 0x7fb5f80b59a0 2024-02-18T10:01:17.765 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb5e406bc70 msgr2=0x7fb5e406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb5e406bc70 0x7fb5e406e130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8036000 tx=0x7fb5e8008030 comp rx=0 tx=0).stop 2024-02-18T10:01:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f80b59a0 msgr2=0x7fb5f80b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f80b59a0 0x7fb5f80b6390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000efc0 tx=0x7fb5f000c490 comp rx=0 tx=0).stop 2024-02-18T10:01:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 shutdown_connections 2024-02-18T10:01:17.767 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb5e406bc70 0x7fb5e406e130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb5f80b59a0 0x7fb5f80b6390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb5f814d4f0 0x7fb5f80b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 --2- 172.21.15.118:0/8478634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb5f8143d30 0x7fb5f8146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 >> 172.21.15.118:0/8478634 conn(0x7fb5f806bed0 msgr2=0x7fb5f814b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 shutdown_connections 2024-02-18T10:01:17.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.764+0000 7fb5fe22e640 1 -- 172.21.15.118:0/8478634 wait complete. 2024-02-18T10:01:17.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-18T10:01:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.877+0000 7fa5e7d0d640 1 Processor -- start 2024-02-18T10:01:17.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.877+0000 7fa5e7d0d640 1 -- start start 2024-02-18T10:01:17.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.877+0000 7fa5e7d0d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa5e014fa00 0x7fa5e01544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.877+0000 7fa5e7d0d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 0x7fa5e0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.877+0000 7fa5e7d0d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e006d600 con 0x7fa5e006bcf0 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.877+0000 7fa5e7d0d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e0070080 con 0x7fa5e014fa00 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.877+0000 7fa5e7d0d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e006ec70 con 0x7fa5e006c0d0 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e5aa9640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa5e006bcf0 0x7fa5e014f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57332/0 (socket says 172.21.15.118:57332) 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e5aa9640 1 -- 172.21.15.118:0/3437244415 learned_addr learned my addr 172.21.15.118:0/3437244415 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41497837 0 0) 0x7fa5e006d600 con 0x7fa5e006bcf0 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e62aa640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 0x7fa5e0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5cc003520 con 0x7fa5e006bcf0 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e52a8640 1 --2- 172.21.15.118:0/3437244415 >> v2:172.21.15.164:3300/0 conn(0x7fa5e014fa00 0x7fa5e01544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 113260461 0 0) 0x7fa5cc003520 con 0x7fa5e006bcf0 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 msgr2=0x7fa5e0156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 0x7fa5e0156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 >> v2:172.21.15.164:3300/0 conn(0x7fa5e014fa00 msgr2=0x7fa5e01544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 --2- 172.21.15.118:0/3437244415 >> v2:172.21.15.164:3300/0 conn(0x7fa5e014fa00 0x7fa5e01544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e006ef50 con 0x7fa5e006bcf0 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fa5dc001670 con 0x7fa5e006bcf0 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 >> v1:172.21.15.118:6789/0 conn(0x7fa5e006bcf0 legacy=0x7fa5e014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 0x7fa5cc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc003ef0 0x7fa5cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5cc004d00 0x7fa5cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0070080 con 0x7fa5cc003ef0 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e006ec70 con 0x7fa5cc004d00 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc00b980 con 0x7fa5e006c0d0 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e52a8640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc003ef0 0x7fa5cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e5aa9640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 0x7fa5cc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e62aa640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5cc004d00 0x7fa5cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e52a8640 1 -- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 msgr2=0x7fa5cc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e52a8640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5e006c0d0 0x7fa5cc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e52a8640 1 -- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5cc004d00 msgr2=0x7fa5cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.878+0000 7fa5e52a8640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5cc004d00 0x7fa5cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.879+0000 7fa5e52a8640 1 -- 172.21.15.118:0/3437244415 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc003520 con 0x7fa5cc003ef0 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.879+0000 7fa5e52a8640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc003ef0 0x7fa5cc0047c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009ac0 tx=0x7fa5cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1f94813e214d9d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.879+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d002c6d0 con 0x7fa5cc003ef0 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.879+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d002c830 con 0x7fa5cc003ef0 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.879+0000 7fa5e4aa7640 1 -- 172.21.15.118:0/3437244415 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d002cbc0 con 0x7fa5cc003ef0 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.880+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/3437244415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc003ef0 msgr2=0x7fa5cc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.880+0000 7fa5e7d0d640 1 --2- 172.21.15.118:0/3437244415 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc003ef0 0x7fa5cc0047c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009ac0 tx=0x7fa5cc0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.880+0000 7fa5e62aa640 1 -- 172.21.15.118:0/3437244415 reap_dead start 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.880+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/3437244415 shutdown_connections 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.880+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/3437244415 >> 172.21.15.118:0/3437244415 conn(0x7fa5e00bbea0 msgr2=0x7fa5e00bc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:17.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.880+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/3437244415 shutdown_connections 2024-02-18T10:01:17.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.880+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/3437244415 wait complete. 2024-02-18T10:01:17.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.881+0000 7fa5e7d0d640 1 Processor -- start 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.881+0000 7fa5e7d0d640 1 -- start start 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5cc003ef0 0x7fa5e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e00b8280 0x7fa5e0140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e00a2a70 0x7fa5e00a2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b9070 con 0x7fa5e00a2a70 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b7df0 con 0x7fa5e00b8280 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00a3510 con 0x7fa5cc003ef0 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e00a2a70 0x7fa5e00a2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e00a2a70 0x7fa5e00a2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46242/0 (socket says 172.21.15.118:46242) 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 -- 172.21.15.118:0/698090392 learned_addr learned my addr 172.21.15.118:0/698090392 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e5aa9640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5cc003ef0 0x7fa5e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e52a8640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e00b8280 0x7fa5e0140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 -- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5cc003ef0 msgr2=0x7fa5e00b8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5cc003ef0 0x7fa5e00b8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 -- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e00b8280 msgr2=0x7fa5e0140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e00b8280 0x7fa5e0140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 -- 172.21.15.118:0/698090392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e01463b0 con 0x7fa5e00a2a70 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e52a8640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e00b8280 0x7fa5e0140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e62aa640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e00a2a70 0x7fa5e00a2f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa5e006e7b0 tx=0x7fa5d800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5d67fc640 1 -- 172.21.15.118:0/698090392 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800e040 con 0x7fa5e00a2a70 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5d67fc640 1 -- 172.21.15.118:0/698090392 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d800f040 con 0x7fa5e00a2a70 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e00b6830 con 0x7fa5e00a2a70 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5d67fc640 1 -- 172.21.15.118:0/698090392 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8015430 con 0x7fa5e00a2a70 2024-02-18T10:01:17.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.882+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e00b77a0 con 0x7fa5e00a2a70 2024-02-18T10:01:17.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.883+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e0068130 con 0x7fa5e00a2a70 2024-02-18T10:01:17.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.884+0000 7fa5d67fc640 1 -- 172.21.15.118:0/698090392 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fa5d8015590 con 0x7fa5e00a2a70 2024-02-18T10:01:17.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.884+0000 7fa5d67fc640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa5c406bc70 0x7fa5c406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:17.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.884+0000 7fa5d67fc640 1 -- 172.21.15.118:0/698090392 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5d808ad90 con 0x7fa5e00a2a70 2024-02-18T10:01:17.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.884+0000 7fa5e5aa9640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa5c406bc70 0x7fa5c406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:17.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.885+0000 7fa5e5aa9640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa5c406bc70 0x7fa5c406e130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc001050 tx=0x7fa5dc0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:17.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:17.888+0000 7fa5d67fc640 1 -- 172.21.15.118:0/698090392 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5d8055570 con 0x7fa5e00a2a70 2024-02-18T10:01:18.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.074+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa5e00b7fa0 con 0x7fa5e00a2a70 2024-02-18T10:01:18.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.074+0000 7fa5d67fc640 1 -- 172.21.15.118:0/698090392 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa5e00b7fa0 con 0x7fa5e00a2a70 2024-02-18T10:01:18.077 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-02-18T10:01:18.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa5c406bc70 msgr2=0x7fa5c406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa5c406bc70 0x7fa5c406e130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc001050 tx=0x7fa5dc0078f0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e00a2a70 msgr2=0x7fa5e00a2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e00a2a70 0x7fa5e00a2f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa5e006e7b0 tx=0x7fa5d800f1b0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 shutdown_connections 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa5c406bc70 0x7fa5c406e130 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5e00a2a70 0x7fa5e00a2f20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5e00b8280 0x7fa5e0140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 --2- 172.21.15.118:0/698090392 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5cc003ef0 0x7fa5e00b8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.076+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 >> 172.21.15.118:0/698090392 conn(0x7fa5e00bbea0 msgr2=0x7fa5e0143a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.077+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 shutdown_connections 2024-02-18T10:01:18.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.077+0000 7fa5e7d0d640 1 -- 172.21.15.118:0/698090392 wait complete. 2024-02-18T10:01:18.090 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-18T10:01:18.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:18.090 DEBUG:teuthology.orchestra.run.smithi204:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-18T10:01:18.188 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-02-18T10:01:18.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:18.189 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-18T10:01:18.249 INFO:tasks.cephfs.cephfs_test_case:[] 2024-02-18T10:01:18.249 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:18.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.348+0000 7f87ed3d7640 1 Processor -- start 2024-02-18T10:01:18.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.348+0000 7f87ed3d7640 1 -- start start 2024-02-18T10:01:18.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.348+0000 7f87ed3d7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e80a6e60 0x7f87e806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87ed3d7640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87e81546d0 0x7f87e8156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87ed3d7640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80b4aa0 con 0x7f87e814bf20 2024-02-18T10:01:18.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87ed3d7640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80b4cf0 con 0x7f87e81546d0 2024-02-18T10:01:18.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87ed3d7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80a7350 con 0x7f87e80a6e60 2024-02-18T10:01:18.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87e77fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87e81546d0 0x7f87e8156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87de7fc640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f87e814bf20 0x7f87e814c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57334/0 (socket says 172.21.15.118:57334) 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87de7fc640 1 -- 172.21.15.118:0/1439159196 learned_addr learned my addr 172.21.15.118:0/1439159196 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87e6ffd640 1 --2- 172.21.15.118:0/1439159196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e80a6e60 0x7f87e806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87e77fe640 1 -- 172.21.15.118:0/1439159196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e80a6e60 msgr2=0x7f87e806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87e77fe640 1 --2- 172.21.15.118:0/1439159196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e80a6e60 0x7f87e806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87e77fe640 1 -- 172.21.15.118:0/1439159196 >> v1:172.21.15.118:6789/0 conn(0x7f87e814bf20 legacy=0x7f87e814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.349+0000 7f87e77fe640 1 -- 172.21.15.118:0/1439159196 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80c1140 con 0x7f87e81546d0 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87e77fe640 1 --2- 172.21.15.118:0/1439159196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e81546d0 0x7f87e8156ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009d90 tx=0x7f87e002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d68dc14692cab0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87e67fc640 1 -- 172.21.15.118:0/1439159196 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e002cb30 con 0x7f87e81546d0 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87e67fc640 1 -- 172.21.15.118:0/1439159196 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e002cc90 con 0x7f87e81546d0 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87e67fc640 1 -- 172.21.15.118:0/1439159196 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0034440 con 0x7f87e81546d0 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 -- 172.21.15.118:0/1439159196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e81546d0 msgr2=0x7f87e8156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/1439159196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e81546d0 0x7f87e8156ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009d90 tx=0x7f87e002bd80 comp rx=0 tx=0).stop 2024-02-18T10:01:18.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 -- 172.21.15.118:0/1439159196 shutdown_connections 2024-02-18T10:01:18.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/1439159196 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e81546d0 0x7f87e8156ac0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/1439159196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e80a6e60 0x7f87e806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 -- 172.21.15.118:0/1439159196 >> 172.21.15.118:0/1439159196 conn(0x7f87e80c15b0 msgr2=0x7f87e80c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:18.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 -- 172.21.15.118:0/1439159196 shutdown_connections 2024-02-18T10:01:18.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.350+0000 7f87ed3d7640 1 -- 172.21.15.118:0/1439159196 wait complete. 2024-02-18T10:01:18.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.351+0000 7f87ed3d7640 1 Processor -- start 2024-02-18T10:01:18.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87ed3d7640 1 -- start start 2024-02-18T10:01:18.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87ed3d7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e80a6e60 0x7f87e8147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87ed3d7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e814bf20 0x7f87e80b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87ed3d7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e81546d0 0x7f87e8148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87ed3d7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8149410 con 0x7f87e80a6e60 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87ed3d7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e81e18b0 con 0x7f87e81546d0 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87ed3d7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80b4e30 con 0x7f87e814bf20 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e80a6e60 0x7f87e8147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e6ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e80a6e60 0x7f87e8147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46250/0 (socket says 172.21.15.118:46250) 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e6ffd640 1 -- 172.21.15.118:0/3686604523 learned_addr learned my addr 172.21.15.118:0/3686604523 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e77fe640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e81546d0 0x7f87e8148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87de7fc640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e814bf20 0x7f87e80b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e6ffd640 1 -- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e814bf20 msgr2=0x7f87e80b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e6ffd640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e814bf20 0x7f87e80b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e6ffd640 1 -- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e81546d0 msgr2=0x7f87e8148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.352+0000 7f87e6ffd640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e81546d0 0x7f87e8148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87e6ffd640 1 -- 172.21.15.118:0/3686604523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0009a70 con 0x7f87e80a6e60 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87e77fe640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e81546d0 0x7f87e8148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87e6ffd640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e80a6e60 0x7f87e8147230 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87d800d5f0 tx=0x7f87d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87dffff640 1 -- 172.21.15.118:0/3686604523 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80125f0 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87dffff640 1 -- 172.21.15.118:0/3686604523 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8012750 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e80bb230 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87dffff640 1 -- 172.21.15.118:0/3686604523 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012b00 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.353+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e81e1da0 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.354+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e8074af0 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.354+0000 7f87dffff640 1 -- 172.21.15.118:0/3686604523 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f87d8012c60 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.355+0000 7f87dffff640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87c806bc70 0x7f87c806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.355+0000 7f87dffff640 1 -- 172.21.15.118:0/3686604523 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87d808aca0 con 0x7f87e80a6e60 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.355+0000 7f87de7fc640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87c806bc70 0x7f87c806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.355+0000 7f87de7fc640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87c806bc70 0x7f87c806e130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87e80bb6a0 tx=0x7f87d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.359+0000 7f87dffff640 1 -- 172.21.15.118:0/3686604523 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87d8055480 con 0x7f87e80a6e60 2024-02-18T10:01:18.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.563+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87e80bd170 con 0x7f87e80a6e60 2024-02-18T10:01:18.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.564+0000 7f87dffff640 1 -- 172.21.15.118:0/3686604523 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7f87d8058b40 con 0x7f87e80a6e60 2024-02-18T10:01:18.567 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:18.567 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:01:18.567 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87c806bc70 msgr2=0x7f87c806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87c806bc70 0x7f87c806e130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87e80bb6a0 tx=0x7f87d0009040 comp rx=0 tx=0).stop 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e80a6e60 msgr2=0x7f87e8147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e80a6e60 0x7f87e8147230 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87d800d5f0 tx=0x7f87d800dab0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 shutdown_connections 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87c806bc70 0x7f87c806e130 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e81546d0 0x7f87e8148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87e814bf20 0x7f87e80b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 --2- 172.21.15.118:0/3686604523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87e80a6e60 0x7f87e8147230 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 >> 172.21.15.118:0/3686604523 conn(0x7f87e80c15b0 msgr2=0x7f87e80a0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:18.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 shutdown_connections 2024-02-18T10:01:18.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.566+0000 7f87ed3d7640 1 -- 172.21.15.118:0/3686604523 wait complete. 2024-02-18T10:01:18.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:18.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.677+0000 7f0ee7af4640 1 Processor -- start 2024-02-18T10:01:18.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.677+0000 7f0ee7af4640 1 -- start start 2024-02-18T10:01:18.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.677+0000 7f0ee7af4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 0x7f0ee014c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.677+0000 7f0ee7af4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ee00bf260 0x7f0ee01565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee7af4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee014be60 con 0x7f0ee006bc20 2024-02-18T10:01:18.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee7af4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee00bdbb0 con 0x7f0ee00bf260 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee7af4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00bf6d0 con 0x7f0ee00bd240 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee5890640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0ee006bc20 0x7f0ee00bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33646/0 (socket says 172.21.15.118:33646) 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee5890640 1 -- 172.21.15.118:0/1377208365 learned_addr learned my addr 172.21.15.118:0/1377208365 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926013372 0 0) 0x7f0ee014be60 con 0x7f0ee006bc20 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ecc003520 con 0x7f0ee006bc20 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2789354128 0 0) 0x7f0ecc003520 con 0x7f0ee006bc20 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 msgr2=0x7f0ee014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 0x7f0ee014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 >> v2:172.21.15.164:3300/0 conn(0x7f0ee00bf260 msgr2=0x7f0ee01565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 --2- 172.21.15.118:0/1377208365 >> v2:172.21.15.164:3300/0 conn(0x7f0ee00bf260 0x7f0ee01565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee014c140 con 0x7f0ee006bc20 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f0edc001690 con 0x7f0ee006bc20 2024-02-18T10:01:18.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 >> v1:172.21.15.118:6789/0 conn(0x7f0ee006bc20 legacy=0x7f0ee00bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ecc003970 0x7f0ecc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 0x7f0ecc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ecc004d50 0x7f0ecc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00bdbb0 con 0x7f0ecc003970 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00bf6d0 con 0x7f0ecc004d50 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc00bc80 con 0x7f0ee00bd240 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee5890640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ecc003970 0x7f0ecc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee508f640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 0x7f0ecc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.678+0000 7f0ee6091640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ecc004d50 0x7f0ecc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee5890640 1 -- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 msgr2=0x7f0ecc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee5890640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 0x7f0ecc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee5890640 1 -- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ecc004d50 msgr2=0x7f0ecc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee5890640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ecc004d50 0x7f0ecc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee5890640 1 -- 172.21.15.118:0/1377208365 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc003520 con 0x7f0ecc003970 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee508f640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ee00bd240 0x7f0ecc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee5890640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ecc003970 0x7f0ecc003d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0edc007fd0 tx=0x7f0ecc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8998077091f65a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc005ad0 con 0x7f0ecc003970 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc005c30 con 0x7f0ecc003970 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.679+0000 7f0ee488e640 1 -- 172.21.15.118:0/1377208365 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc02c8d0 con 0x7f0ecc003970 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.680+0000 7f0ee7af4640 1 -- 172.21.15.118:0/1377208365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ecc003970 msgr2=0x7f0ecc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.680+0000 7f0ee7af4640 1 --2- 172.21.15.118:0/1377208365 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ecc003970 0x7f0ecc003d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0edc007fd0 tx=0x7f0ecc0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.680+0000 7f0ee6091640 1 -- 172.21.15.118:0/1377208365 reap_dead start 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.680+0000 7f0ee7af4640 1 -- 172.21.15.118:0/1377208365 shutdown_connections 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.680+0000 7f0ee7af4640 1 -- 172.21.15.118:0/1377208365 >> 172.21.15.118:0/1377208365 conn(0x7f0ee00c1850 msgr2=0x7f0ee00c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.680+0000 7f0ee7af4640 1 -- 172.21.15.118:0/1377208365 shutdown_connections 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.680+0000 7f0ee7af4640 1 -- 172.21.15.118:0/1377208365 wait complete. 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.681+0000 7f0ee7af4640 1 Processor -- start 2024-02-18T10:01:18.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.681+0000 7f0ee7af4640 1 -- start start 2024-02-18T10:01:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ecc003970 0x7f0ee01e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee00bb220 0x7f0ee00bb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee00b78d0 0x7f0ee00b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00b4860 con 0x7f0ee00bb220 2024-02-18T10:01:18.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00b9ae0 con 0x7f0ee00b78d0 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01e1f30 con 0x7f0ecc003970 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee00bb220 0x7f0ee00bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee00bb220 0x7f0ee00bb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48678/0 (socket says 172.21.15.118:48678) 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 -- 172.21.15.118:0/3643285972 learned_addr learned my addr 172.21.15.118:0/3643285972 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee5890640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ecc003970 0x7f0ee01e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee6091640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee00b78d0 0x7f0ee00b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 -- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ecc003970 msgr2=0x7f0ee01e26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ecc003970 0x7f0ee01e26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 -- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee00b78d0 msgr2=0x7f0ee00b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee00b78d0 0x7f0ee00b7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 -- 172.21.15.118:0/3643285972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00b9520 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee508f640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee00bb220 0x7f0ee00bb660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000d5b0 tx=0x7f0ed000da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ed67fc640 1 -- 172.21.15.118:0/3643285972 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0004020 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ed67fc640 1 -- 172.21.15.118:0/3643285972 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0004180 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee00b9800 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ed67fc640 1 -- 172.21.15.118:0/3643285972 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0004330 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.682+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee00baab0 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.683+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee01e23d0 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.684+0000 7f0ed67fc640 1 -- 172.21.15.118:0/3643285972 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f0ed0014620 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.684+0000 7f0ed67fc640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ec406bc70 0x7f0ec406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.684+0000 7f0ed67fc640 1 -- 172.21.15.118:0/3643285972 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ed008ab00 con 0x7f0ee00bb220 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.684+0000 7f0ee5890640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ec406bc70 0x7f0ec406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.684+0000 7f0ee5890640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ec406bc70 0x7f0ec406e130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0edc034000 tx=0x7f0edc007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.688+0000 7f0ed67fc640 1 -- 172.21.15.118:0/3643285972 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ee01e23d0 con 0x7f0ee00bb220 2024-02-18T10:01:18.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.859+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ee01e23d0 con 0x7f0ee00bb220 2024-02-18T10:01:18.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.860+0000 7f0ed67fc640 1 -- 172.21.15.118:0/3643285972 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f0ee01e23d0 con 0x7f0ee00bb220 2024-02-18T10:01:18.863 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:18.863 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ec406bc70 msgr2=0x7f0ec406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ec406bc70 0x7f0ec406e130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0edc034000 tx=0x7f0edc007000 comp rx=0 tx=0).stop 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee00bb220 msgr2=0x7f0ee00bb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee00bb220 0x7f0ee00bb660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000d5b0 tx=0x7f0ed000da70 comp rx=0 tx=0).stop 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 shutdown_connections 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ec406bc70 0x7f0ec406e130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee00b78d0 0x7f0ee00b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ee00bb220 0x7f0ee00bb660 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 --2- 172.21.15.118:0/3643285972 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ecc003970 0x7f0ee01e26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.862+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 >> 172.21.15.118:0/3643285972 conn(0x7f0ee00c1850 msgr2=0x7f0ee00a17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.863+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 shutdown_connections 2024-02-18T10:01:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.863+0000 7f0ee7af4640 1 -- 172.21.15.118:0/3643285972 wait complete. 2024-02-18T10:01:18.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:00:45.854446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:00:47.052199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:18.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:18.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.978+0000 7f9b097bc640 1 Processor -- start 2024-02-18T10:01:18.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.978+0000 7f9b097bc640 1 -- start start 2024-02-18T10:01:18.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b097bc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 0x7f9b0406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b097bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0406d130 con 0x7f9b0406b700 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b097bc640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040bdc30 con 0x7f9b040c0220 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b097bc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040bda50 con 0x7f9b0414c870 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b027fc640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9b0406b700 0x7f9b040bfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33662/0 (socket says 172.21.15.118:33662) 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b027fc640 1 -- 172.21.15.118:0/1947391038 learned_addr learned my addr 172.21.15.118:0/1947391038 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210330112 0 0) 0x7f9b0406d130 con 0x7f9b0406b700 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aec003520 con 0x7f9b0406b700 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 0x7f9b0406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3364258913 0 0) 0x7f9aec003520 con 0x7f9b0406b700 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 msgr2=0x7f9b0406c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 0x7f9b0406c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 >> v1:172.21.15.164:6789/0 conn(0x7f9b040c0220 legacy=0x7f9b04156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040bf310 con 0x7f9b0406b700 2024-02-18T10:01:18.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f9af8001670 con 0x7f9b0406b700 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 0x7f9b0406c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 >> v1:172.21.15.118:6789/0 conn(0x7f9b0406b700 legacy=0x7f9b040bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aec0039a0 0x7f9aec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aec0047c0 0x7f9aec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 0x7f9aec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040bda50 con 0x7f9aec0047c0 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec00bb10 con 0x7f9aec0039a0 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec00bcd0 con 0x7f9b0414c870 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.979+0000 7f9b027fc640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aec0047c0 0x7f9aec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aec0039a0 0x7f9aec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b037fe640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 0x7f9aec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b027fc640 1 -- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 msgr2=0x7f9aec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b027fc640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9b0414c870 0x7f9aec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b027fc640 1 -- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aec0039a0 msgr2=0x7f9aec003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b027fc640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aec0039a0 0x7f9aec003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b027fc640 1 -- 172.21.15.118:0/1947391038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec003520 con 0x7f9aec0047c0 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9aec0039a0 0x7f9aec003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b027fc640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aec0047c0 0x7f9aec004c40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c240 tx=0x7f9aec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f71a684df10e569 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.980+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8005ad0 con 0x7f9aec0047c0 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8005c30 con 0x7f9aec0047c0 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b01ffb640 1 -- 172.21.15.118:0/1947391038 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af802c8b0 con 0x7f9aec0047c0 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b097bc640 1 -- 172.21.15.118:0/1947391038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aec0047c0 msgr2=0x7f9aec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b097bc640 1 --2- 172.21.15.118:0/1947391038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aec0047c0 0x7f9aec004c40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c240 tx=0x7f9aec0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b037fe640 1 -- 172.21.15.118:0/1947391038 reap_dead start 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b097bc640 1 -- 172.21.15.118:0/1947391038 shutdown_connections 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b097bc640 1 -- 172.21.15.118:0/1947391038 >> 172.21.15.118:0/1947391038 conn(0x7f9b040c1650 msgr2=0x7f9b040c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:18.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b097bc640 1 -- 172.21.15.118:0/1947391038 shutdown_connections 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.981+0000 7f9b097bc640 1 -- 172.21.15.118:0/1947391038 wait complete. 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.982+0000 7f9b097bc640 1 Processor -- start 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.982+0000 7f9b097bc640 1 -- start start 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b097bc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aec0047c0 0x7f9b040b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b097bc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b04145fc0 0x7f9b04146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b097bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b041e4680 0x7f9b041e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b097bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c1d80 con 0x7f9b041e4680 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b097bc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040b7fd0 con 0x7f9b04145fc0 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b097bc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040ba010 con 0x7f9aec0047c0 2024-02-18T10:01:18.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b041e4680 0x7f9b041e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b041e4680 0x7f9b041e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48698/0 (socket says 172.21.15.118:48698) 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 -- 172.21.15.118:0/2425015167 learned_addr learned my addr 172.21.15.118:0/2425015167 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aec0047c0 0x7f9b040b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b027fc640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b04145fc0 0x7f9b04146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 -- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aec0047c0 msgr2=0x7f9b040b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aec0047c0 0x7f9b040b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 -- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b04145fc0 msgr2=0x7f9b04146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b04145fc0 0x7f9b04146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 -- 172.21.15.118:0/2425015167 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040b7020 con 0x7f9b041e4680 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aec0047c0 0x7f9b040b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9b037fe640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b041e4680 0x7f9b041e4b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9b040bcf60 tx=0x7f9afc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9aeb7fe640 1 -- 172.21.15.118:0/2425015167 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00eed0 con 0x7f9b041e4680 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9aeb7fe640 1 -- 172.21.15.118:0/2425015167 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc003970 con 0x7f9b041e4680 2024-02-18T10:01:18.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.983+0000 7f9aeb7fe640 1 -- 172.21.15.118:0/2425015167 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc003d20 con 0x7f9b041e4680 2024-02-18T10:01:18.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.984+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040ba220 con 0x7f9b041e4680 2024-02-18T10:01:18.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.984+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b041d7520 con 0x7f9b041e4680 2024-02-18T10:01:18.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.985+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b040ba740 con 0x7f9b041e4680 2024-02-18T10:01:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.985+0000 7f9aeb7fe640 1 -- 172.21.15.118:0/2425015167 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9afc0050d0 con 0x7f9b041e4680 2024-02-18T10:01:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.985+0000 7f9aeb7fe640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9af006bc70 0x7f9af006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.985+0000 7f9aeb7fe640 1 -- 172.21.15.118:0/2425015167 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9afc08a4c0 con 0x7f9b041e4680 2024-02-18T10:01:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.985+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9af006bc70 0x7f9af006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.986+0000 7f9b02ffd640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9af006bc70 0x7f9af006e130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9af4006fd0 tx=0x7f9af4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:18.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:18.989+0000 7f9aeb7fe640 1 -- 172.21.15.118:0/2425015167 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b040ba740 con 0x7f9b041e4680 2024-02-18T10:01:19.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.159+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b040ba740 con 0x7f9b041e4680 2024-02-18T10:01:19.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.160+0000 7f9aeb7fe640 1 -- 172.21.15.118:0/2425015167 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b040ba740 con 0x7f9b041e4680 2024-02-18T10:01:19.163 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.161+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9af006bc70 msgr2=0x7f9af006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9af006bc70 0x7f9af006e130 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9af4006fd0 tx=0x7f9af4008040 comp rx=0 tx=0).stop 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b041e4680 msgr2=0x7f9b041e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b041e4680 0x7f9b041e4b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9b040bcf60 tx=0x7f9afc00eb90 comp rx=0 tx=0).stop 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 shutdown_connections 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9af006bc70 0x7f9af006e130 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b041e4680 0x7f9b041e4b00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b04145fc0 0x7f9b04146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 --2- 172.21.15.118:0/2425015167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9aec0047c0 0x7f9b040b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 >> 172.21.15.118:0/2425015167 conn(0x7f9b040c1650 msgr2=0x7f9b04148210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 shutdown_connections 2024-02-18T10:01:19.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.162+0000 7f9b097bc640 1 -- 172.21.15.118:0/2425015167 wait complete. 2024-02-18T10:01:19.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.275+0000 7f539afbc640 1 Processor -- start 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.275+0000 7f539afbc640 1 -- start start 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f539afbc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f539414c870 0x7f539406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f539afbc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539406d130 con 0x7f53940c0220 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f539afbc640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940bdc30 con 0x7f539406b700 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f539afbc640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940bda50 con 0x7f539414c870 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f5398d58640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f539414c870 0x7f539406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f5399559640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f53940c0220 0x7f5394156490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33670/0 (socket says 172.21.15.118:33670) 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f5398d58640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f539414c870 0x7f539406c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48710/0 (socket says 172.21.15.118:48710) 2024-02-18T10:01:19.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f5399559640 1 -- 172.21.15.118:0/90077114 learned_addr learned my addr 172.21.15.118:0/90077114 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:19.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f5398d58640 1 -- 172.21.15.118:0/90077114 >> v1:172.21.15.164:6789/0 conn(0x7f539406b700 legacy=0x7f53940bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:19.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f5398d58640 1 -- 172.21.15.118:0/90077114 >> v1:172.21.15.118:6789/0 conn(0x7f53940c0220 legacy=0x7f5394156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f53937fe640 1 -- 172.21.15.118:0/90077114 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991505175 0 0) 0x7f539406d130 con 0x7f53940c0220 2024-02-18T10:01:19.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.276+0000 7f5398d58640 1 -- 172.21.15.118:0/90077114 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940bf310 con 0x7f539414c870 2024-02-18T10:01:19.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.277+0000 7f5398d58640 1 --2- 172.21.15.118:0/90077114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539414c870 0x7f539406c9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f53840097a0 tx=0x7f538402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f411889385f83e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.277+0000 7f53937fe640 1 -- 172.21.15.118:0/90077114 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384030610 con 0x7f539414c870 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.277+0000 7f53937fe640 1 -- 172.21.15.118:0/90077114 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384030770 con 0x7f539414c870 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.277+0000 7f53937fe640 1 -- 172.21.15.118:0/90077114 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384030b00 con 0x7f539414c870 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.278+0000 7f539afbc640 1 -- 172.21.15.118:0/90077114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539414c870 msgr2=0x7f539406c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.278+0000 7f539afbc640 1 --2- 172.21.15.118:0/90077114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539414c870 0x7f539406c9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f53840097a0 tx=0x7f538402b960 comp rx=0 tx=0).stop 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.278+0000 7f539afbc640 1 -- 172.21.15.118:0/90077114 shutdown_connections 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.278+0000 7f539afbc640 1 --2- 172.21.15.118:0/90077114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539414c870 0x7f539406c9e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.278+0000 7f539afbc640 1 -- 172.21.15.118:0/90077114 >> 172.21.15.118:0/90077114 conn(0x7f53940c1650 msgr2=0x7f53940c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.278+0000 7f539afbc640 1 -- 172.21.15.118:0/90077114 shutdown_connections 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.278+0000 7f539afbc640 1 -- 172.21.15.118:0/90077114 wait complete. 2024-02-18T10:01:19.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 Processor -- start 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 -- start start 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539406b700 0x7f5394143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53940c0220 0x7f53941452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f539414c870 0x7f5394141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5394142a60 con 0x7f539406b700 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5394144c30 con 0x7f53940c0220 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f539afbc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5394074400 con 0x7f539414c870 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f5398d58640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539406b700 0x7f5394143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.279+0000 7f5398d58640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539406b700 0x7f5394143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48718/0 (socket says 172.21.15.118:48718) 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5398d58640 1 -- 172.21.15.118:0/3070347504 learned_addr learned my addr 172.21.15.118:0/3070347504 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5399559640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f539414c870 0x7f5394141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5393fff640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53940c0220 0x7f53941452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5398d58640 1 -- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f539414c870 msgr2=0x7f5394141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5398d58640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f539414c870 0x7f5394141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5398d58640 1 -- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53940c0220 msgr2=0x7f53941452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5398d58640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53940c0220 0x7f53941452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5398d58640 1 -- 172.21.15.118:0/3070347504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384009400 con 0x7f539406b700 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5399559640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f539414c870 0x7f5394141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f5398d58640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539406b700 0x7f5394143a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f53840098c0 tx=0x7f53840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f53917fa640 1 -- 172.21.15.118:0/3070347504 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384039c90 con 0x7f539406b700 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f53917fa640 1 -- 172.21.15.118:0/3070347504 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538403f040 con 0x7f539406b700 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5394145800 con 0x7f539406b700 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f53917fa640 1 -- 172.21.15.118:0/3070347504 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384006e10 con 0x7f539406b700 2024-02-18T10:01:19.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.280+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53940a70d0 con 0x7f539406b700 2024-02-18T10:01:19.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.281+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5394075150 con 0x7f539406b700 2024-02-18T10:01:19.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.282+0000 7f53917fa640 1 -- 172.21.15.118:0/3070347504 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f5384004030 con 0x7f539406b700 2024-02-18T10:01:19.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.282+0000 7f53917fa640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f538006bc70 0x7f538006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.282+0000 7f5393fff640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f538006bc70 0x7f538006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.282+0000 7f53917fa640 1 -- 172.21.15.118:0/3070347504 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53840ac7d0 con 0x7f539406b700 2024-02-18T10:01:19.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.282+0000 7f5393fff640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f538006bc70 0x7f538006e130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f539414cf30 tx=0x7f5388009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.286+0000 7f53917fa640 1 -- 172.21.15.118:0/3070347504 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53840770f0 con 0x7f539406b700 2024-02-18T10:01:19.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.455+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5394074af0 con 0x7f539406b700 2024-02-18T10:01:19.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.456+0000 7f53917fa640 1 -- 172.21.15.118:0/3070347504 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f538407a7b0 con 0x7f539406b700 2024-02-18T10:01:19.461 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T10:01:19.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f538006bc70 msgr2=0x7f538006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f538006bc70 0x7f538006e130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f539414cf30 tx=0x7f5388009060 comp rx=0 tx=0).stop 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539406b700 msgr2=0x7f5394143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539406b700 0x7f5394143a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f53840098c0 tx=0x7f53840046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 shutdown_connections 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f538006bc70 0x7f538006e130 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f539414c870 0x7f5394141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53940c0220 0x7f53941452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 --2- 172.21.15.118:0/3070347504 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f539406b700 0x7f5394143a10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 >> 172.21.15.118:0/3070347504 conn(0x7f53940c1650 msgr2=0x7f539414aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:19.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 shutdown_connections 2024-02-18T10:01:19.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.458+0000 7f539afbc640 1 -- 172.21.15.118:0/3070347504 wait complete. 2024-02-18T10:01:19.472 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T10:01:19.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.571+0000 7ffae7fd0640 1 Processor -- start 2024-02-18T10:01:19.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae7fd0640 1 -- start start 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae7fd0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffae014c870 0x7ffae006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae7fd0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffae006b700 0x7ffae00bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae7fd0640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae006d130 con 0x7ffae006bb40 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae7fd0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae00bda50 con 0x7ffae014c870 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae7fd0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae006cf20 con 0x7ffae006b700 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae5d6c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffae014c870 0x7ffae006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae5d6c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffae014c870 0x7ffae006c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48724/0 (socket says 172.21.15.118:48724) 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae5d6c640 1 -- 172.21.15.118:0/1671325550 learned_addr learned my addr 172.21.15.118:0/1671325550 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.572+0000 7ffae556b640 1 --2- 172.21.15.118:0/1671325550 >> v2:172.21.15.164:3300/0 conn(0x7ffae006b700 0x7ffae00bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae5d6c640 1 -- 172.21.15.118:0/1671325550 >> v2:172.21.15.164:3300/0 conn(0x7ffae006b700 msgr2=0x7ffae00bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae5d6c640 1 --2- 172.21.15.118:0/1671325550 >> v2:172.21.15.164:3300/0 conn(0x7ffae006b700 0x7ffae00bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae5d6c640 1 -- 172.21.15.118:0/1671325550 >> v1:172.21.15.164:6789/0 conn(0x7ffae006bb40 legacy=0x7ffae014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae5d6c640 1 -- 172.21.15.118:0/1671325550 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae00bdc30 con 0x7ffae014c870 2024-02-18T10:01:19.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae5d6c640 1 --2- 172.21.15.118:0/1671325550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae014c870 0x7ffae006c9e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffae00bd790 tx=0x7ffadc02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2be0c606b47b9ee server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae4d6a640 1 -- 172.21.15.118:0/1671325550 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc02cbb0 con 0x7ffae014c870 2024-02-18T10:01:19.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae4d6a640 1 -- 172.21.15.118:0/1671325550 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc02cd10 con 0x7ffae014c870 2024-02-18T10:01:19.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.573+0000 7ffae4d6a640 1 -- 172.21.15.118:0/1671325550 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc034610 con 0x7ffae014c870 2024-02-18T10:01:19.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1671325550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae014c870 msgr2=0x7ffae006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1671325550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae014c870 0x7ffae006c9e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffae00bd790 tx=0x7ffadc02c010 comp rx=0 tx=0).stop 2024-02-18T10:01:19.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1671325550 shutdown_connections 2024-02-18T10:01:19.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1671325550 >> v2:172.21.15.164:3300/0 conn(0x7ffae006b700 0x7ffae00bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1671325550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae014c870 0x7ffae006c9e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1671325550 >> 172.21.15.118:0/1671325550 conn(0x7ffae00c1650 msgr2=0x7ffae00c1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1671325550 shutdown_connections 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.574+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1671325550 wait complete. 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.575+0000 7ffae7fd0640 1 Processor -- start 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.575+0000 7ffae7fd0640 1 -- start start 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffae006b700 0x7ffae01d5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae006bb40 0x7ffae00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffae014c870 0x7ffae01e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00b4ed0 con 0x7ffae006bb40 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00b6710 con 0x7ffae006b700 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00b5c60 con 0x7ffae014c870 2024-02-18T10:01:19.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae006bb40 0x7ffae00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae006bb40 0x7ffae00b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48730/0 (socket says 172.21.15.118:48730) 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 -- 172.21.15.118:0/1918284603 learned_addr learned my addr 172.21.15.118:0/1918284603 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae5d6c640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffae006b700 0x7ffae01d5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae656d640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffae014c870 0x7ffae01e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 -- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffae014c870 msgr2=0x7ffae01e1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffae014c870 0x7ffae01e1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 -- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffae006b700 msgr2=0x7ffae01d5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffae006b700 0x7ffae01d5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 -- 172.21.15.118:0/1918284603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc009b30 con 0x7ffae006bb40 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae656d640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffae014c870 0x7ffae01e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae556b640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae006bb40 0x7ffae00b61d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffad000d800 tx=0x7ffad000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffad67fc640 1 -- 172.21.15.118:0/1918284603 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad000b6c0 con 0x7ffae006bb40 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffad67fc640 1 -- 172.21.15.118:0/1918284603 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad000b840 con 0x7ffae006bb40 2024-02-18T10:01:19.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae00b4c80 con 0x7ffae006bb40 2024-02-18T10:01:19.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffad67fc640 1 -- 172.21.15.118:0/1918284603 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad000bbf0 con 0x7ffae006bb40 2024-02-18T10:01:19.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.576+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae00b7e20 con 0x7ffae006bb40 2024-02-18T10:01:19.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.577+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae0075150 con 0x7ffae006bb40 2024-02-18T10:01:19.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.578+0000 7ffad67fc640 1 -- 172.21.15.118:0/1918284603 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7ffad000bd50 con 0x7ffae006bb40 2024-02-18T10:01:19.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.578+0000 7ffad67fc640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffac406bc70 0x7ffac406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.578+0000 7ffad67fc640 1 -- 172.21.15.118:0/1918284603 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffad008abf0 con 0x7ffae006bb40 2024-02-18T10:01:19.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.578+0000 7ffae5d6c640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffac406bc70 0x7ffac406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.579+0000 7ffae5d6c640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffac406bc70 0x7ffac406e130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffadc035000 tx=0x7ffadc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.582+0000 7ffad67fc640 1 -- 172.21.15.118:0/1918284603 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffad0055460 con 0x7ffae006bb40 2024-02-18T10:01:19.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.756+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffae00b4aa0 con 0x7ffae006bb40 2024-02-18T10:01:19.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.757+0000 7ffad67fc640 1 -- 172.21.15.118:0/1918284603 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffad0058b20 con 0x7ffae006bb40 2024-02-18T10:01:19.759 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T10:01:19.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffac406bc70 msgr2=0x7ffac406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffac406bc70 0x7ffac406e130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffadc035000 tx=0x7ffadc030000 comp rx=0 tx=0).stop 2024-02-18T10:01:19.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae006bb40 msgr2=0x7ffae00b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae006bb40 0x7ffae00b61d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffad000d800 tx=0x7ffad000dcc0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 shutdown_connections 2024-02-18T10:01:19.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffac406bc70 0x7ffac406e130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffae014c870 0x7ffae01e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffae006bb40 0x7ffae00b61d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 --2- 172.21.15.118:0/1918284603 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffae006b700 0x7ffae01d5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.758+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 >> 172.21.15.118:0/1918284603 conn(0x7ffae00c1650 msgr2=0x7ffae00bfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:19.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.759+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 shutdown_connections 2024-02-18T10:01:19.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.759+0000 7ffae7fd0640 1 -- 172.21.15.118:0/1918284603 wait complete. 2024-02-18T10:01:19.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:19.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.870+0000 7fe8b578c640 1 Processor -- start 2024-02-18T10:01:19.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.870+0000 7fe8b578c640 1 -- start start 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8b578c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe8b00ba520 0x7fe8b006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8b578c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8b0070010 0x7fe8b014f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8b578c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b0146400 con 0x7fe8b006fc30 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8b578c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b00bb2c0 con 0x7fe8b00ba520 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8b578c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b0072b60 con 0x7fe8b0070010 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8ae7fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe8b00ba520 0x7fe8b006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8ae7fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe8b00ba520 0x7fe8b006ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48746/0 (socket says 172.21.15.118:48746) 2024-02-18T10:01:19.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8ae7fc640 1 -- 172.21.15.118:0/2315507139 learned_addr learned my addr 172.21.15.118:0/2315507139 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8af7fe640 1 --2- 172.21.15.118:0/2315507139 >> v2:172.21.15.164:3300/0 conn(0x7fe8b0070010 0x7fe8b014f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8ae7fc640 1 -- 172.21.15.118:0/2315507139 >> v2:172.21.15.164:3300/0 conn(0x7fe8b0070010 msgr2=0x7fe8b014f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8ae7fc640 1 --2- 172.21.15.118:0/2315507139 >> v2:172.21.15.164:3300/0 conn(0x7fe8b0070010 0x7fe8b014f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8ae7fc640 1 -- 172.21.15.118:0/2315507139 >> v1:172.21.15.164:6789/0 conn(0x7fe8b006fc30 legacy=0x7fe8b009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.871+0000 7fe8ae7fc640 1 -- 172.21.15.118:0/2315507139 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00725a0 con 0x7fe8b00ba520 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.872+0000 7fe8ae7fc640 1 --2- 172.21.15.118:0/2315507139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b006ec50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe8b006e6f0 tx=0x7fe8a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd730acca201b69 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.872+0000 7fe8adffb640 1 -- 172.21.15.118:0/2315507139 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40317e0 con 0x7fe8b00ba520 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.872+0000 7fe8adffb640 1 -- 172.21.15.118:0/2315507139 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a4031940 con 0x7fe8b00ba520 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.872+0000 7fe8adffb640 1 -- 172.21.15.118:0/2315507139 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4031cd0 con 0x7fe8b00ba520 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 -- 172.21.15.118:0/2315507139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 msgr2=0x7fe8b006ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.877 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2315507139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b006ec50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe8b006e6f0 tx=0x7fe8a402b880 comp rx=0 tx=0).stop 2024-02-18T10:01:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 -- 172.21.15.118:0/2315507139 shutdown_connections 2024-02-18T10:01:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2315507139 >> v2:172.21.15.164:3300/0 conn(0x7fe8b0070010 0x7fe8b014f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2315507139 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b006ec50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 -- 172.21.15.118:0/2315507139 >> 172.21.15.118:0/2315507139 conn(0x7fe8b00bf4a0 msgr2=0x7fe8b00bf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 -- 172.21.15.118:0/2315507139 shutdown_connections 2024-02-18T10:01:19.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.873+0000 7fe8b578c640 1 -- 172.21.15.118:0/2315507139 wait complete. 2024-02-18T10:01:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.874+0000 7fe8b578c640 1 Processor -- start 2024-02-18T10:01:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.874+0000 7fe8b578c640 1 -- start start 2024-02-18T10:01:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b006fc30 0x7fe8b014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b0070010 0x7fe8b00a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b0144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b014ed80 con 0x7fe8b00ba520 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b009f8b0 con 0x7fe8b0070010 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b009f5d0 con 0x7fe8b006fc30 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b0144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b0144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48752/0 (socket says 172.21.15.118:48752) 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 -- 172.21.15.118:0/2690671104 learned_addr learned my addr 172.21.15.118:0/2690671104 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8ae7fc640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b0070010 0x7fe8b00a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8aeffd640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b006fc30 0x7fe8b014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 -- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b006fc30 msgr2=0x7fe8b014e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b006fc30 0x7fe8b014e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 -- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b0070010 msgr2=0x7fe8b00a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b0070010 0x7fe8b00a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 -- 172.21.15.118:0/2690671104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40094d0 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8aeffd640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b006fc30 0x7fe8b014e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8af7fe640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b0144840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800d800 tx=0x7fe8a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8977fe640 1 -- 172.21.15.118:0/2690671104 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800b6c0 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8977fe640 1 -- 172.21.15.118:0/2690671104 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800b840 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b009fbc0 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8977fe640 1 -- 172.21.15.118:0/2690671104 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800bbf0 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.875+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b00a1340 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.876+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b009fa20 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.877+0000 7fe8977fe640 1 -- 172.21.15.118:0/2690671104 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe8a800bd50 con 0x7fe8b00ba520 2024-02-18T10:01:19.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.877+0000 7fe8977fe640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:19.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.877+0000 7fe8977fe640 1 -- 172.21.15.118:0/2690671104 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8a808ac30 con 0x7fe8b00ba520 2024-02-18T10:01:19.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.877+0000 7fe8aeffd640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:19.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.878+0000 7fe8aeffd640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009fc0 tx=0x7fe8a0009550 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:19.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:19.881+0000 7fe8977fe640 1 -- 172.21.15.118:0/2690671104 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8b009fa20 con 0x7fe8b00ba520 2024-02-18T10:01:20.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.088+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8b009fa20 con 0x7fe8b00ba520 2024-02-18T10:01:20.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.088+0000 7fe8977fe640 1 -- 172.21.15.118:0/2690671104 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7fe8b009fa20 con 0x7fe8b00ba520 2024-02-18T10:01:20.091 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:20.091 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:01:20.091 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:01:20.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 msgr2=0x7fe89c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009fc0 tx=0x7fe8a0009550 comp rx=0 tx=0).stop 2024-02-18T10:01:20.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 msgr2=0x7fe8b0144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b0144840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800d800 tx=0x7fe8a800dcc0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 shutdown_connections 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8b00ba520 0x7fe8b0144840 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8b0070010 0x7fe8b00a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 --2- 172.21.15.118:0/2690671104 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8b006fc30 0x7fe8b014e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 >> 172.21.15.118:0/2690671104 conn(0x7fe8b00bf4a0 msgr2=0x7fe8b00bd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.090+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 shutdown_connections 2024-02-18T10:01:20.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.091+0000 7fe8b578c640 1 -- 172.21.15.118:0/2690671104 wait complete. 2024-02-18T10:01:20.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:20.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.202+0000 7fac9bdf4640 1 Processor -- start 2024-02-18T10:01:20.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.202+0000 7fac9bdf4640 1 -- start start 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.202+0000 7fac9bdf4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fac940bb6c0 0x7fac940bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9bdf4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac940b8b00 con 0x7fac940b98f0 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9bdf4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac940bd050 con 0x7fac94072e30 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9bdf4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac94073210 con 0x7fac940bb6c0 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9a391640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fac940b98f0 0x7fac941565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33674/0 (socket says 172.21.15.118:33674) 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9a391640 1 -- 172.21.15.118:0/297960500 learned_addr learned my addr 172.21.15.118:0/297960500 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9938f640 1 --2- 172.21.15.118:0/297960500 >> v2:172.21.15.164:3300/0 conn(0x7fac940bb6c0 0x7fac940bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac98b8e640 1 -- 172.21.15.118:0/297960500 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350847697 0 0) 0x7fac8c001490 con 0x7fac940b98f0 2024-02-18T10:01:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac98b8e640 1 -- 172.21.15.118:0/297960500 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac80003520 con 0x7fac940b98f0 2024-02-18T10:01:20.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9938f640 1 -- 172.21.15.118:0/297960500 >> v1:172.21.15.164:6789/0 conn(0x7fac94072e30 legacy=0x7fac9414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac98b8e640 1 -- 172.21.15.118:0/297960500 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030635834 0 0) 0x7fac80003520 con 0x7fac940b98f0 2024-02-18T10:01:20.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9938f640 1 -- 172.21.15.118:0/297960500 >> v1:172.21.15.118:6789/0 conn(0x7fac940b98f0 legacy=0x7fac941565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.203+0000 7fac9938f640 1 -- 172.21.15.118:0/297960500 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9409cdd0 con 0x7fac940bb6c0 2024-02-18T10:01:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.204+0000 7fac9938f640 1 --2- 172.21.15.118:0/297960500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac940bb6c0 0x7fac940bc680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac840097a0 tx=0x7fac8402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20079c7f277f3b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.204+0000 7fac98b8e640 1 -- 172.21.15.118:0/297960500 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8402f050 con 0x7fac940bb6c0 2024-02-18T10:01:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.204+0000 7fac98b8e640 1 -- 172.21.15.118:0/297960500 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84031500 con 0x7fac940bb6c0 2024-02-18T10:01:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.204+0000 7fac98b8e640 1 -- 172.21.15.118:0/297960500 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c001b80 con 0x7fac940bb6c0 2024-02-18T10:01:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.204+0000 7fac9bdf4640 1 -- 172.21.15.118:0/297960500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac940bb6c0 msgr2=0x7fac940bc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.204+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/297960500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac940bb6c0 0x7fac940bc680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac840097a0 tx=0x7fac8402b820 comp rx=0 tx=0).stop 2024-02-18T10:01:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.205+0000 7fac9bdf4640 1 -- 172.21.15.118:0/297960500 shutdown_connections 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.205+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/297960500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac940bb6c0 0x7fac940bc680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.205+0000 7fac9bdf4640 1 -- 172.21.15.118:0/297960500 >> 172.21.15.118:0/297960500 conn(0x7fac940ba3c0 msgr2=0x7fac940ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.205+0000 7fac9bdf4640 1 -- 172.21.15.118:0/297960500 shutdown_connections 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.205+0000 7fac9bdf4640 1 -- 172.21.15.118:0/297960500 wait complete. 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 Processor -- start 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 -- start start 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac94072e30 0x7fac9414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac940b98f0 0x7fac941e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac940bb6c0 0x7fac94141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac940b5780 con 0x7fac940b98f0 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9414b240 con 0x7fac94072e30 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9bdf4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac941e1b20 con 0x7fac940bb6c0 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9938f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac940b98f0 0x7fac941e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9938f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac940b98f0 0x7fac941e15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48754/0 (socket says 172.21.15.118:48754) 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9938f640 1 -- 172.21.15.118:0/1821684347 learned_addr learned my addr 172.21.15.118:0/1821684347 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac99b90640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac94072e30 0x7fac9414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.206+0000 7fac9a391640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac940bb6c0 0x7fac94141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9938f640 1 -- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac940bb6c0 msgr2=0x7fac94141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9938f640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac940bb6c0 0x7fac94141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9938f640 1 -- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac94072e30 msgr2=0x7fac9414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9938f640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac94072e30 0x7fac9414ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9938f640 1 -- 172.21.15.118:0/1821684347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009400 con 0x7fac940b98f0 2024-02-18T10:01:20.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9938f640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac940b98f0 0x7fac941e15e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fac84000c00 tx=0x7fac840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac8a7fc640 1 -- 172.21.15.118:0/1821684347 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84033980 con 0x7fac940b98f0 2024-02-18T10:01:20.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac8a7fc640 1 -- 172.21.15.118:0/1821684347 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84033ae0 con 0x7fac940b98f0 2024-02-18T10:01:20.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac940b7540 con 0x7fac940b98f0 2024-02-18T10:01:20.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac8a7fc640 1 -- 172.21.15.118:0/1821684347 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84033e90 con 0x7fac940b98f0 2024-02-18T10:01:20.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.207+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac940b7ac0 con 0x7fac940b98f0 2024-02-18T10:01:20.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.208+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac940b58c0 con 0x7fac940b98f0 2024-02-18T10:01:20.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.208+0000 7fac8a7fc640 1 -- 172.21.15.118:0/1821684347 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fac8403a040 con 0x7fac940b98f0 2024-02-18T10:01:20.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.209+0000 7fac8a7fc640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fac7806bc70 0x7fac7806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.209+0000 7fac8a7fc640 1 -- 172.21.15.118:0/1821684347 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac840abf00 con 0x7fac940b98f0 2024-02-18T10:01:20.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.209+0000 7fac99b90640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fac7806bc70 0x7fac7806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.209+0000 7fac99b90640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fac7806bc70 0x7fac7806e130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fac90000f60 tx=0x7fac90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.213+0000 7fac8a7fc640 1 -- 172.21.15.118:0/1821684347 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac940b58c0 con 0x7fac940b98f0 2024-02-18T10:01:20.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.386+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac940b58c0 con 0x7fac940b98f0 2024-02-18T10:01:20.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.387+0000 7fac8a7fc640 1 -- 172.21.15.118:0/1821684347 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fac940b58c0 con 0x7fac940b98f0 2024-02-18T10:01:20.390 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:20.390 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:20.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fac7806bc70 msgr2=0x7fac7806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fac7806bc70 0x7fac7806e130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fac90000f60 tx=0x7fac90009040 comp rx=0 tx=0).stop 2024-02-18T10:01:20.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac940b98f0 msgr2=0x7fac941e15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac940b98f0 0x7fac941e15e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fac84000c00 tx=0x7fac840046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 shutdown_connections 2024-02-18T10:01:20.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fac7806bc70 0x7fac7806e130 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac940bb6c0 0x7fac94141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fac940b98f0 0x7fac941e15e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 --2- 172.21.15.118:0/1821684347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac94072e30 0x7fac9414ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 >> 172.21.15.118:0/1821684347 conn(0x7fac940ba3c0 msgr2=0x7fac941d80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:20.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 shutdown_connections 2024-02-18T10:01:20.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.389+0000 7fac9bdf4640 1 -- 172.21.15.118:0/1821684347 wait complete. 2024-02-18T10:01:20.403 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-18T10:01:20.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:20.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.500+0000 7f9cf0965640 1 Processor -- start 2024-02-18T10:01:20.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.500+0000 7f9cf0965640 1 -- start start 2024-02-18T10:01:20.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cf0965640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9cec142d60 0x7f9cec0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cf0965640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cec14c660 0x7f9cec153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cf0965640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0b4510 con 0x7f9cec0b5280 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cf0965640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec14cf00 con 0x7f9cec14c660 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cf0965640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0b3440 con 0x7f9cec142d60 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cead9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cec14c660 0x7f9cec153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cead9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9cec14c660 0x7f9cec153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48758/0 (socket says 172.21.15.118:48758) 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cead9d640 1 -- 172.21.15.118:0/1181110206 learned_addr learned my addr 172.21.15.118:0/1181110206 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cea59c640 1 --2- 172.21.15.118:0/1181110206 >> v2:172.21.15.164:3300/0 conn(0x7f9cec142d60 0x7f9cec0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cead9d640 1 -- 172.21.15.118:0/1181110206 >> v2:172.21.15.164:3300/0 conn(0x7f9cec142d60 msgr2=0x7f9cec0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cead9d640 1 --2- 172.21.15.118:0/1181110206 >> v2:172.21.15.164:3300/0 conn(0x7f9cec142d60 0x7f9cec0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cead9d640 1 -- 172.21.15.118:0/1181110206 >> v1:172.21.15.164:6789/0 conn(0x7f9cec0b5280 legacy=0x7f9cec14bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cead9d640 1 -- 172.21.15.118:0/1181110206 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0b3f00 con 0x7f9cec14c660 2024-02-18T10:01:20.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.501+0000 7f9cea59c640 1 --2- 172.21.15.118:0/1181110206 >> v2:172.21.15.164:3300/0 conn(0x7f9cec142d60 0x7f9cec0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cead9d640 1 --2- 172.21.15.118:0/1181110206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14c660 0x7f9cec153280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9cec06ccc0 tx=0x7f9ce402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b536089b081fa94 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9ce9d9b640 1 -- 172.21.15.118:0/1181110206 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce402c9f0 con 0x7f9cec14c660 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9ce9d9b640 1 -- 172.21.15.118:0/1181110206 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce402cb50 con 0x7f9cec14c660 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9ce9d9b640 1 -- 172.21.15.118:0/1181110206 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40343f0 con 0x7f9cec14c660 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 -- 172.21.15.118:0/1181110206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14c660 msgr2=0x7f9cec153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 --2- 172.21.15.118:0/1181110206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14c660 0x7f9cec153280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9cec06ccc0 tx=0x7f9ce402be50 comp rx=0 tx=0).stop 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 -- 172.21.15.118:0/1181110206 shutdown_connections 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 --2- 172.21.15.118:0/1181110206 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec14c660 0x7f9cec153280 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 --2- 172.21.15.118:0/1181110206 >> v2:172.21.15.164:3300/0 conn(0x7f9cec142d60 0x7f9cec0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 -- 172.21.15.118:0/1181110206 >> 172.21.15.118:0/1181110206 conn(0x7f9cec06bcf0 msgr2=0x7f9cec06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 -- 172.21.15.118:0/1181110206 shutdown_connections 2024-02-18T10:01:20.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.502+0000 7f9cf0965640 1 -- 172.21.15.118:0/1181110206 wait complete. 2024-02-18T10:01:20.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 Processor -- start 2024-02-18T10:01:20.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 -- start start 2024-02-18T10:01:20.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cec0b5280 0x7f9cec0bd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec142d60 0x7f9cec1e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cec14c660 0x7f9cec13e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec1e0b50 con 0x7f9cec142d60 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec1e0800 con 0x7f9cec14c660 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cf0965640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec1dd300 con 0x7f9cec0b5280 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9ce3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec142d60 0x7f9cec1e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9ce3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec142d60 0x7f9cec1e0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48774/0 (socket says 172.21.15.118:48774) 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9ce3fff640 1 -- 172.21.15.118:0/898490482 learned_addr learned my addr 172.21.15.118:0/898490482 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cea59c640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cec0b5280 0x7f9cec0bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.504+0000 7f9cead9d640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cec14c660 0x7f9cec13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce3fff640 1 -- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cec0b5280 msgr2=0x7f9cec0bd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce3fff640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cec0b5280 0x7f9cec0bd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce3fff640 1 -- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cec14c660 msgr2=0x7f9cec13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce3fff640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cec14c660 0x7f9cec13e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce3fff640 1 -- 172.21.15.118:0/898490482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009b30 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9cea59c640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cec0b5280 0x7f9cec0bd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9cead9d640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cec14c660 0x7f9cec13e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce3fff640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec142d60 0x7f9cec1e0f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c430 tx=0x7f9cd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce2ffd640 1 -- 172.21.15.118:0/898490482 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4011790 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce2ffd640 1 -- 172.21.15.118:0/898490482 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd40118f0 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec0a3350 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9ce2ffd640 1 -- 172.21.15.118:0/898490482 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4011ca0 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.505+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec1d41d0 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.506+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec1e0c90 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.506+0000 7f9ce2ffd640 1 -- 172.21.15.118:0/898490482 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9cd401c460 con 0x7f9cec142d60 2024-02-18T10:01:20.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.507+0000 7f9ce2ffd640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ccc06bc70 0x7f9ccc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.507+0000 7f9cea59c640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ccc06bc70 0x7f9ccc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.507+0000 7f9ce2ffd640 1 -- 172.21.15.118:0/898490482 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cd408a680 con 0x7f9cec142d60 2024-02-18T10:01:20.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.507+0000 7f9cea59c640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ccc06bc70 0x7f9ccc06e130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00aa30 tx=0x7f9cdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.511+0000 7f9ce2ffd640 1 -- 172.21.15.118:0/898490482 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9cec1e0c90 con 0x7f9cec142d60 2024-02-18T10:01:20.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.714+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cec1e0c90 con 0x7f9cec142d60 2024-02-18T10:01:20.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.715+0000 7f9ce2ffd640 1 -- 172.21.15.118:0/898490482 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7f9cec1e0c90 con 0x7f9cec142d60 2024-02-18T10:01:20.717 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:20.718 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:01:20.718 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:01:20.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ccc06bc70 msgr2=0x7f9ccc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ccc06bc70 0x7f9ccc06e130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00aa30 tx=0x7f9cdc008040 comp rx=0 tx=0).stop 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec142d60 msgr2=0x7f9cec1e0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec142d60 0x7f9cec1e0f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c430 tx=0x7f9cd400c8f0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 shutdown_connections 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9ccc06bc70 0x7f9ccc06e130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9cec14c660 0x7f9cec13e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9cec142d60 0x7f9cec1e0f70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 --2- 172.21.15.118:0/898490482 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9cec0b5280 0x7f9cec0bd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 >> 172.21.15.118:0/898490482 conn(0x7f9cec06bcf0 msgr2=0x7f9cec0b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 shutdown_connections 2024-02-18T10:01:20.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.717+0000 7f9cf0965640 1 -- 172.21.15.118:0/898490482 wait complete. 2024-02-18T10:01:20.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:20.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.828+0000 7fc970cf1640 1 Processor -- start 2024-02-18T10:01:20.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.828+0000 7fc970cf1640 1 -- start start 2024-02-18T10:01:20.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.828+0000 7fc970cf1640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc96c142d20 0x7fc96c148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc970cf1640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc96c072060 0x7fc96c1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc970cf1640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c149450 con 0x7fc96c072bd0 2024-02-18T10:01:20.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc970cf1640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c143100 con 0x7fc96c142d20 2024-02-18T10:01:20.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc970cf1640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c070510 con 0x7fc96c072060 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96a59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc96c142d20 0x7fc96c148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96a59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc96c142d20 0x7fc96c148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48790/0 (socket says 172.21.15.118:48790) 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96a59c640 1 -- 172.21.15.118:0/334967379 learned_addr learned my addr 172.21.15.118:0/334967379 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96ad9d640 1 --2- 172.21.15.118:0/334967379 >> v2:172.21.15.164:3300/0 conn(0x7fc96c072060 0x7fc96c1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96a59c640 1 -- 172.21.15.118:0/334967379 >> v2:172.21.15.164:3300/0 conn(0x7fc96c072060 msgr2=0x7fc96c1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96a59c640 1 --2- 172.21.15.118:0/334967379 >> v2:172.21.15.164:3300/0 conn(0x7fc96c072060 0x7fc96c1531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96a59c640 1 -- 172.21.15.118:0/334967379 >> v1:172.21.15.164:6789/0 conn(0x7fc96c072bd0 legacy=0x7fc96c071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96a59c640 1 -- 172.21.15.118:0/334967379 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c06ff90 con 0x7fc96c142d20 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.829+0000 7fc96ad9d640 1 --2- 172.21.15.118:0/334967379 >> v2:172.21.15.164:3300/0 conn(0x7fc96c072060 0x7fc96c1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc96a59c640 1 --2- 172.21.15.118:0/334967379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c148900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc96c06c580 tx=0x7fc95c02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a030b06139c70d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc96959a640 1 -- 172.21.15.118:0/334967379 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c036440 con 0x7fc96c142d20 2024-02-18T10:01:20.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc96959a640 1 -- 172.21.15.118:0/334967379 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0365a0 con 0x7fc96c142d20 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc96959a640 1 -- 172.21.15.118:0/334967379 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c036930 con 0x7fc96c142d20 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc970cf1640 1 -- 172.21.15.118:0/334967379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 msgr2=0x7fc96c148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc970cf1640 1 --2- 172.21.15.118:0/334967379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c148900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc96c06c580 tx=0x7fc95c02e170 comp rx=0 tx=0).stop 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc970cf1640 1 -- 172.21.15.118:0/334967379 shutdown_connections 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc970cf1640 1 --2- 172.21.15.118:0/334967379 >> v2:172.21.15.164:3300/0 conn(0x7fc96c072060 0x7fc96c1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc970cf1640 1 --2- 172.21.15.118:0/334967379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c148900 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.830+0000 7fc970cf1640 1 -- 172.21.15.118:0/334967379 >> 172.21.15.118:0/334967379 conn(0x7fc96c0b9ca0 msgr2=0x7fc96c0ba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.831+0000 7fc970cf1640 1 -- 172.21.15.118:0/334967379 shutdown_connections 2024-02-18T10:01:20.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.831+0000 7fc970cf1640 1 -- 172.21.15.118:0/334967379 wait complete. 2024-02-18T10:01:20.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 Processor -- start 2024-02-18T10:01:20.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 -- start start 2024-02-18T10:01:20.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc96c072060 0x7fc96c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc96c072bd0 0x7fc96c14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c0b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0b54d0 con 0x7fc96c142d20 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c13af70 con 0x7fc96c072060 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc970cf1640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0b41c0 con 0x7fc96c072bd0 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc96ad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c0b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.832+0000 7fc96ad9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c0b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48798/0 (socket says 172.21.15.118:48798) 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96ad9d640 1 -- 172.21.15.118:0/3770221714 learned_addr learned my addr 172.21.15.118:0/3770221714 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96a59c640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc96c072060 0x7fc96c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96ad9d640 1 -- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc96c072bd0 msgr2=0x7fc96c14bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc969d9b640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc96c072bd0 0x7fc96c14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96ad9d640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc96c072bd0 0x7fc96c14bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96ad9d640 1 -- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc96c072060 msgr2=0x7fc96c0b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96ad9d640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc96c072060 0x7fc96c0b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96ad9d640 1 -- 172.21.15.118:0/3770221714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c00b770 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96a59c640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc96c072060 0x7fc96c0b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc969d9b640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc96c072bd0 0x7fc96c14bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc96ad9d640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c0b5e70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc964007e70 tx=0x7fc96400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc95affd640 1 -- 172.21.15.118:0/3770221714 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964015600 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc95affd640 1 -- 172.21.15.118:0/3770221714 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400f040 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c1e2430 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc95affd640 1 -- 172.21.15.118:0/3770221714 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640159a0 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.833+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c1e1fa0 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.834+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c0b8050 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.834+0000 7fc95affd640 1 -- 172.21.15.118:0/3770221714 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fc9640143a0 con 0x7fc96c142d20 2024-02-18T10:01:20.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.835+0000 7fc95affd640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc94c06bca0 0x7fc94c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:20.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.835+0000 7fc96a59c640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc94c06bca0 0x7fc94c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:20.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.835+0000 7fc95affd640 1 -- 172.21.15.118:0/3770221714 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc96408aae0 con 0x7fc96c142d20 2024-02-18T10:01:20.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.835+0000 7fc96a59c640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc94c06bca0 0x7fc94c06e160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc95c038000 tx=0x7fc95c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:20.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:20.839+0000 7fc95affd640 1 -- 172.21.15.118:0/3770221714 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc96c0b8050 con 0x7fc96c142d20 2024-02-18T10:01:21.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.045+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc96c0b8050 con 0x7fc96c142d20 2024-02-18T10:01:21.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.046+0000 7fc95affd640 1 -- 172.21.15.118:0/3770221714 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4151 (secure 0 0 0) 0x7fc96c0b8050 con 0x7fc96c142d20 2024-02-18T10:01:21.049 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:21.049 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3482343245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":3482343245},{"type":"v1","addr":"172.21.15.118:6837","nonce":3482343245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/2458886296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":2458886296},{"type":"v1","addr":"172.21.15.118:6836","nonce":2458886296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:00:48.080556+0000","modified":"2024-02-18T10:00:50.087917+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6833/2459180675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":2459180675},{"type":"v1","addr":"172.21.15.164:6833","nonce":2459180675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-18T10:01:21.049 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 6 2024-02-18T10:01:21.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.047+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc94c06bca0 msgr2=0x7fc94c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.047+0000 7fc970cf1640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc94c06bca0 0x7fc94c06e160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc95c038000 tx=0x7fc95c008040 comp rx=0 tx=0).stop 2024-02-18T10:01:21.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.047+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 msgr2=0x7fc96c0b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.047+0000 7fc970cf1640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c0b5e70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc964007e70 tx=0x7fc96400d4a0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 shutdown_connections 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc94c06bca0 0x7fc94c06e160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc96c142d20 0x7fc96c0b5e70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc96c072bd0 0x7fc96c14bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 --2- 172.21.15.118:0/3770221714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc96c072060 0x7fc96c0b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 >> 172.21.15.118:0/3770221714 conn(0x7fc96c0b9ca0 msgr2=0x7fc96c06c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 shutdown_connections 2024-02-18T10:01:21.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.048+0000 7fc970cf1640 1 -- 172.21.15.118:0/3770221714 wait complete. 2024-02-18T10:01:21.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:21.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.157+0000 7f70d058a640 1 Processor -- start 2024-02-18T10:01:21.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.157+0000 7f70d058a640 1 -- start start 2024-02-18T10:01:21.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70d058a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70c8145f80 0x7f70c806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70d058a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c814f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70d058a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c814f240 con 0x7f70c80baf80 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70d058a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c806f080 con 0x7f70c8145f80 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70d058a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c806f260 con 0x7f70c80bab60 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70ce326640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70c8145f80 0x7f70c806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70ce326640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70c8145f80 0x7f70c806eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48810/0 (socket says 172.21.15.118:48810) 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70ce326640 1 -- 172.21.15.118:0/3026930009 learned_addr learned my addr 172.21.15.118:0/3026930009 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70cdb25640 1 --2- 172.21.15.118:0/3026930009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c814f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70ce326640 1 -- 172.21.15.118:0/3026930009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 msgr2=0x7f70c814f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70ce326640 1 --2- 172.21.15.118:0/3026930009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c814f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70ce326640 1 -- 172.21.15.118:0/3026930009 >> v1:172.21.15.164:6789/0 conn(0x7f70c80baf80 legacy=0x7f70c8072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70ce326640 1 -- 172.21.15.118:0/3026930009 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c806f540 con 0x7f70c8145f80 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.158+0000 7f70cdb25640 1 --2- 172.21.15.118:0/3026930009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c814f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:21.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.159+0000 7f70ce326640 1 --2- 172.21.15.118:0/3026930009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c806eb40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009e50 tx=0x7f70c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7672bd1173ec5d4d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.159+0000 7f70cd324640 1 -- 172.21.15.118:0/3026930009 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c002ca70 con 0x7f70c8145f80 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.159+0000 7f70cd324640 1 -- 172.21.15.118:0/3026930009 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c002cbd0 con 0x7f70c8145f80 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.159+0000 7f70cd324640 1 -- 172.21.15.118:0/3026930009 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00343f0 con 0x7f70c8145f80 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 -- 172.21.15.118:0/3026930009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 msgr2=0x7f70c806eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 --2- 172.21.15.118:0/3026930009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c806eb40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009e50 tx=0x7f70c002bed0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 -- 172.21.15.118:0/3026930009 shutdown_connections 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 --2- 172.21.15.118:0/3026930009 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c814f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 --2- 172.21.15.118:0/3026930009 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c806eb40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 -- 172.21.15.118:0/3026930009 >> 172.21.15.118:0/3026930009 conn(0x7f70c80a11c0 msgr2=0x7f70c80a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 -- 172.21.15.118:0/3026930009 shutdown_connections 2024-02-18T10:01:21.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.160+0000 7f70d058a640 1 -- 172.21.15.118:0/3026930009 wait complete. 2024-02-18T10:01:21.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.161+0000 7f70d058a640 1 Processor -- start 2024-02-18T10:01:21.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.161+0000 7f70d058a640 1 -- start start 2024-02-18T10:01:21.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c81470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c80baf80 0x7f70c814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c81e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c8146920 con 0x7f70c8145f80 2024-02-18T10:01:21.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c814a070 con 0x7f70c80baf80 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c814ac40 con 0x7f70c80bab60 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c81e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c81e17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48826/0 (socket says 172.21.15.118:48826) 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 -- 172.21.15.118:0/1336968939 learned_addr learned my addr 172.21.15.118:0/1336968939 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70cdb25640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c80baf80 0x7f70c814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ce326640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c81470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 -- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 msgr2=0x7f70c81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c81470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 -- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c80baf80 msgr2=0x7f70c814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c80baf80 0x7f70c814c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 -- 172.21.15.118:0/1336968939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0009b30 con 0x7f70c8145f80 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70ceb27640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c81e17a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c470 tx=0x7f70c400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70beffd640 1 -- 172.21.15.118:0/1336968939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4011790 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70beffd640 1 -- 172.21.15.118:0/1336968939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40118f0 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c81478e0 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70beffd640 1 -- 172.21.15.118:0/1336968939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4011ca0 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.162+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c814ae90 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.163+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c81e14c0 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.164+0000 7f70beffd640 1 -- 172.21.15.118:0/1336968939 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f70c401c460 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.164+0000 7f70beffd640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70ac06bc70 0x7f70ac06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.164+0000 7f70ce326640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70ac06bc70 0x7f70ac06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.164+0000 7f70beffd640 1 -- 172.21.15.118:0/1336968939 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c408a3d0 con 0x7f70c8145f80 2024-02-18T10:01:21.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.164+0000 7f70ce326640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70ac06bc70 0x7f70ac06e130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70c0035000 tx=0x7f70c0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.168+0000 7f70beffd640 1 -- 172.21.15.118:0/1336968939 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f70c81e14c0 con 0x7f70c8145f80 2024-02-18T10:01:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.341+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70c81e14c0 con 0x7f70c8145f80 2024-02-18T10:01:21.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.342+0000 7f70beffd640 1 -- 172.21.15.118:0/1336968939 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f70c81e14c0 con 0x7f70c8145f80 2024-02-18T10:01:21.345 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:21.345 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":21,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:00:49.733381+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:00:45.854446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-18T10:00:47.052199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70ac06bc70 msgr2=0x7f70ac06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70ac06bc70 0x7f70ac06e130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70c0035000 tx=0x7f70c0030000 comp rx=0 tx=0).stop 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 msgr2=0x7f70c81e17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c81e17a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c470 tx=0x7f70c400c930 comp rx=0 tx=0).stop 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 shutdown_connections 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f70ac06bc70 0x7f70ac06e130 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c8145f80 0x7f70c81e17a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70c80baf80 0x7f70c814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 --2- 172.21.15.118:0/1336968939 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70c80bab60 0x7f70c81470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 >> 172.21.15.118:0/1336968939 conn(0x7f70c80a11c0 msgr2=0x7f70c8144900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:21.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 shutdown_connections 2024-02-18T10:01:21.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.344+0000 7f70d058a640 1 -- 172.21.15.118:0/1336968939 wait complete. 2024-02-18T10:01:21.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-18T10:01:21.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8c1cdf640 1 Processor -- start 2024-02-18T10:01:21.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8c1cdf640 1 -- start start 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8c1cdf640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe8bc142c20 0x7fe8bc0a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8c1cdf640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8bc151230 0x7fe8bc153620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8c1cdf640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0a31f0 con 0x7fe8bc1495b0 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8c1cdf640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0a0350 con 0x7fe8bc142c20 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8c1cdf640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0a0630 con 0x7fe8bc151230 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8bb7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe8bc142c20 0x7fe8bc0a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8bb7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe8bc142c20 0x7fe8bc0a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48836/0 (socket says 172.21.15.118:48836) 2024-02-18T10:01:21.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.458+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1736921061 learned_addr learned my addr 172.21.15.118:0/1736921061 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.459+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1736921061 >> v2:172.21.15.164:3300/0 conn(0x7fe8bc151230 msgr2=0x7fe8bc153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.459+0000 7fe8bb7fe640 1 --2- 172.21.15.118:0/1736921061 >> v2:172.21.15.164:3300/0 conn(0x7fe8bc151230 0x7fe8bc153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.459+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1736921061 >> v1:172.21.15.164:6789/0 conn(0x7fe8bc1495b0 legacy=0x7fe8bc148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.459+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1736921061 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0a1a20 con 0x7fe8bc142c20 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.459+0000 7fe8bb7fe640 1 --2- 172.21.15.118:0/1736921061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0a1e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0be100 tx=0x7fe8ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd21d674fcc4adc server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.459+0000 7fe8baffd640 1 -- 172.21.15.118:0/1736921061 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac031870 con 0x7fe8bc142c20 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8baffd640 1 -- 172.21.15.118:0/1736921061 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac0319d0 con 0x7fe8bc142c20 2024-02-18T10:01:21.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8baffd640 1 -- 172.21.15.118:0/1736921061 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac031d60 con 0x7fe8bc142c20 2024-02-18T10:01:21.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1736921061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 msgr2=0x7fe8bc0a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1736921061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0a1e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0be100 tx=0x7fe8ac02b910 comp rx=0 tx=0).stop 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1736921061 shutdown_connections 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1736921061 >> v2:172.21.15.164:3300/0 conn(0x7fe8bc151230 0x7fe8bc153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1736921061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0a1e40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1736921061 >> 172.21.15.118:0/1736921061 conn(0x7fe8bc0b9c30 msgr2=0x7fe8bc0ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1736921061 shutdown_connections 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.460+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1736921061 wait complete. 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.461+0000 7fe8c1cdf640 1 Processor -- start 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.461+0000 7fe8c1cdf640 1 -- start start 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8c1cdf640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8c1cdf640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8bc1495b0 0x7fe8bc150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8c1cdf640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8bc151230 0x7fe8bc145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8c1cdf640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1421a0 con 0x7fe8bc142c20 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8c1cdf640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc145b90 con 0x7fe8bc151230 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8c1cdf640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc145d80 con 0x7fe8bc1495b0 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48842/0 (socket says 172.21.15.118:48842) 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1315517181 learned_addr learned my addr 172.21.15.118:0/1315517181 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1315517181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8bc1495b0 msgr2=0x7fe8bc150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8bc1495b0 0x7fe8bc150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1315517181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8bc151230 msgr2=0x7fe8bc145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8bc151230 0x7fe8bc145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 -- 172.21.15.118:0/1315517181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0094d0 con 0x7fe8bc142c20 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8bb7fe640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0b2300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac000c00 tx=0x7fe8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.462+0000 7fe8b8ff9640 1 -- 172.21.15.118:0/1315517181 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac031840 con 0x7fe8bc142c20 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.463+0000 7fe8b8ff9640 1 -- 172.21.15.118:0/1315517181 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac0443f0 con 0x7fe8bc142c20 2024-02-18T10:01:21.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.463+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc1503e0 con 0x7fe8bc142c20 2024-02-18T10:01:21.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.463+0000 7fe8b8ff9640 1 -- 172.21.15.118:0/1315517181 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0447a0 con 0x7fe8bc142c20 2024-02-18T10:01:21.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.463+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc14e4b0 con 0x7fe8bc142c20 2024-02-18T10:01:21.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.464+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc074af0 con 0x7fe8bc142c20 2024-02-18T10:01:21.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.464+0000 7fe8b8ff9640 1 -- 172.21.15.118:0/1315517181 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe8ac044900 con 0x7fe8bc142c20 2024-02-18T10:01:21.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.465+0000 7fe8b8ff9640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.465+0000 7fe8b2ffd640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.465+0000 7fe8b8ff9640 1 -- 172.21.15.118:0/1315517181 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8ac02d040 con 0x7fe8bc142c20 2024-02-18T10:01:21.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.465+0000 7fe8b2ffd640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc145ff0 tx=0x7fe8a4007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.469+0000 7fe8b8ff9640 1 -- 172.21.15.118:0/1315517181 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8ac077790 con 0x7fe8bc142c20 2024-02-18T10:01:21.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.677+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe8bc14e6a0 con 0x7fe8bc142c20 2024-02-18T10:01:21.680 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-02-18T10:01:21.678+0000 7f48a027e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-18T10:01:21.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.679+0000 7fe8b8ff9640 1 -- 172.21.15.118:0/1315517181 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe8ac07ae50 con 0x7fe8bc142c20 2024-02-18T10:01:21.681 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-18T10:01:21.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 msgr2=0x7fe89c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc145ff0 tx=0x7fe8a4007990 comp rx=0 tx=0).stop 2024-02-18T10:01:21.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 msgr2=0x7fe8bc0b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0b2300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac000c00 tx=0x7fe8ac0046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 shutdown_connections 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe89c06bc70 0x7fe89c06e130 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8bc151230 0x7fe8bc145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8bc1495b0 0x7fe8bc150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 --2- 172.21.15.118:0/1315517181 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8bc142c20 0x7fe8bc0b2300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.681+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 >> 172.21.15.118:0/1315517181 conn(0x7fe8bc0b9c30 msgr2=0x7fe8bc0bba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.682+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 shutdown_connections 2024-02-18T10:01:21.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.682+0000 7fe8c1cdf640 1 -- 172.21.15.118:0/1315517181 wait complete. 2024-02-18T10:01:21.688 INFO:tasks.ceph.mds.b.smithi164.stderr: -4973> 2024-02-18T10:00:51.730+0000 7fda58776640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-18T10:01:21.695 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-18T10:01:21.718 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-02-18T10:01:21.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.794+0000 7f9ed7e88640 1 Processor -- start 2024-02-18T10:01:21.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed7e88640 1 -- start start 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed7e88640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9ed014c730 0x7f9ed00bc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed7e88640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9ed014f0b0 0x7f9ed00be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed7e88640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed014cb10 con 0x7f9ed006b6d0 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed7e88640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00b4ac0 con 0x7f9ed014f0b0 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed7e88640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00bd7c0 con 0x7f9ed014c730 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed5423640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9ed014f0b0 0x7f9ed00be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed5423640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9ed014f0b0 0x7f9ed00be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48854/0 (socket says 172.21.15.118:48854) 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed6425640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9ed006b6d0 0x7f9ed006bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33682/0 (socket says 172.21.15.118:33682) 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.795+0000 7f9ed5423640 1 -- 172.21.15.118:0/722978931 learned_addr learned my addr 172.21.15.118:0/722978931 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed5c24640 1 --2- 172.21.15.118:0/722978931 >> v2:172.21.15.164:3300/0 conn(0x7f9ed014c730 0x7f9ed00bc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed5423640 1 -- 172.21.15.118:0/722978931 >> v2:172.21.15.164:3300/0 conn(0x7f9ed014c730 msgr2=0x7f9ed00bc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed5423640 1 --2- 172.21.15.118:0/722978931 >> v2:172.21.15.164:3300/0 conn(0x7f9ed014c730 0x7f9ed00bc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed5423640 1 -- 172.21.15.118:0/722978931 >> v1:172.21.15.118:6789/0 conn(0x7f9ed006b6d0 legacy=0x7f9ed006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed5423640 1 -- 172.21.15.118:0/722978931 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00b4d10 con 0x7f9ed014f0b0 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed5c24640 1 --2- 172.21.15.118:0/722978931 >> v2:172.21.15.164:3300/0 conn(0x7f9ed014c730 0x7f9ed00bc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed5423640 1 --2- 172.21.15.118:0/722978931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014f0b0 0x7f9ed00be350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00bee40 tx=0x7f9ecc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84e1875dd1a906a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed4c22640 1 -- 172.21.15.118:0/722978931 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc02f850 con 0x7f9ed014f0b0 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.796+0000 7f9ed4c22640 1 -- 172.21.15.118:0/722978931 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc02f9b0 con 0x7f9ed014f0b0 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed4c22640 1 -- 172.21.15.118:0/722978931 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc02fd40 con 0x7f9ed014f0b0 2024-02-18T10:01:21.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 -- 172.21.15.118:0/722978931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014f0b0 msgr2=0x7f9ed00be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/722978931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014f0b0 0x7f9ed00be350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00bee40 tx=0x7f9ecc02ba30 comp rx=0 tx=0).stop 2024-02-18T10:01:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 -- 172.21.15.118:0/722978931 shutdown_connections 2024-02-18T10:01:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/722978931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014f0b0 0x7f9ed00be350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/722978931 >> v2:172.21.15.164:3300/0 conn(0x7f9ed014c730 0x7f9ed00bc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 -- 172.21.15.118:0/722978931 >> 172.21.15.118:0/722978931 conn(0x7f9ed00a33a0 msgr2=0x7f9ed00a37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 -- 172.21.15.118:0/722978931 shutdown_connections 2024-02-18T10:01:21.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.797+0000 7f9ed7e88640 1 -- 172.21.15.118:0/722978931 wait complete. 2024-02-18T10:01:21.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.798+0000 7f9ed7e88640 1 Processor -- start 2024-02-18T10:01:21.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.798+0000 7f9ed7e88640 1 -- start start 2024-02-18T10:01:21.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ed006b6d0 0x7f9ed01e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014c730 0x7f9ed014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ed014f0b0 0x7f9ed00a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed014ed80 con 0x7f9ed014c730 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00b46a0 con 0x7f9ed006b6d0 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01e2dd0 con 0x7f9ed014f0b0 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014c730 0x7f9ed014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014c730 0x7f9ed014e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48868/0 (socket says 172.21.15.118:48868) 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 -- 172.21.15.118:0/3360476397 learned_addr learned my addr 172.21.15.118:0/3360476397 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5c24640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ed006b6d0 0x7f9ed01e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed6425640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ed014f0b0 0x7f9ed00a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 -- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ed014f0b0 msgr2=0x7f9ed00a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ed014f0b0 0x7f9ed00a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 -- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ed006b6d0 msgr2=0x7f9ed01e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:21.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ed006b6d0 0x7f9ed01e1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 -- 172.21.15.118:0/3360476397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0094d0 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed6425640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ed014f0b0 0x7f9ed00a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed5423640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014c730 0x7f9ed014e840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc02ba70 tx=0x7f9ecc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ec67fc640 1 -- 172.21.15.118:0/3360476397 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc02f820 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ec67fc640 1 -- 172.21.15.118:0/3360476397 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc041400 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed01d7f20 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ec67fc640 1 -- 172.21.15.118:0/3360476397 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0417b0 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.799+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed01e2780 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.800+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed0075150 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.801+0000 7f9ec67fc640 1 -- 172.21.15.118:0/3360476397 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9ecc041910 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.801+0000 7f9ec67fc640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9eb406bca0 0x7f9eb406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.801+0000 7f9ec67fc640 1 -- 172.21.15.118:0/3360476397 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9ecc03c070 con 0x7f9ed014c730 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.801+0000 7f9ed5c24640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9eb406bca0 0x7f9eb406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:21.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.802+0000 7f9ed5c24640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9eb406bca0 0x7f9eb406e160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000ab60 tx=0x7f9ec0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:21.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:21.806+0000 7f9ec67fc640 1 -- 172.21.15.118:0/3360476397 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ecc077f10 con 0x7f9ed014c730 2024-02-18T10:01:22.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.015+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9ed0074af0 con 0x7f9ed014c730 2024-02-18T10:01:22.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.681+0000 7f9ec67fc640 1 -- 172.21.15.118:0/3360476397 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ecc07b5d0 con 0x7f9ed014c730 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9eb406bca0 msgr2=0x7f9eb406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9eb406bca0 0x7f9eb406e160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000ab60 tx=0x7f9ec0008040 comp rx=0 tx=0).stop 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014c730 msgr2=0x7f9ed014e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014c730 0x7f9ed014e840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc02ba70 tx=0x7f9ecc004730 comp rx=0 tx=0).stop 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 shutdown_connections 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9eb406bca0 0x7f9eb406e160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ed014f0b0 0x7f9ed00a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ed014c730 0x7f9ed014e840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 --2- 172.21.15.118:0/3360476397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ed006b6d0 0x7f9ed01e1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 >> 172.21.15.118:0/3360476397 conn(0x7f9ed00a33a0 msgr2=0x7f9ed006bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:22.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 shutdown_connections 2024-02-18T10:01:22.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.683+0000 7f9ed7e88640 1 -- 172.21.15.118:0/3360476397 wait complete. 2024-02-18T10:01:22.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-18T10:01:22.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.800+0000 7fe3fc93a640 1 Processor -- start 2024-02-18T10:01:22.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.800+0000 7fe3fc93a640 1 -- start start 2024-02-18T10:01:22.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.801+0000 7fe3fc93a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 0x7fe3f8149560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.801+0000 7fe3fc93a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f814bee0 con 0x7fe3f80b5150 2024-02-18T10:01:22.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.801+0000 7fe3fc93a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f80bbbd0 con 0x7fe3f814cb40 2024-02-18T10:01:22.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.801+0000 7fe3fc93a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80ba640 con 0x7fe3f8149110 2024-02-18T10:01:22.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.801+0000 7fe3f5d9b640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe3f80b5150 0x7fe3f80bb4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33688/0 (socket says 172.21.15.118:33688) 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.801+0000 7fe3f5d9b640 1 -- 172.21.15.118:0/3332558897 learned_addr learned my addr 172.21.15.118:0/3332558897 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.801+0000 7fe3f6d9d640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 0x7fe3f8149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778769044 0 0) 0x7fe3f814bee0 con 0x7fe3f80b5150 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003520 con 0x7fe3f80b5150 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514114576 0 0) 0x7fe3f80bbbd0 con 0x7fe3f814cb40 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f814bee0 con 0x7fe3f814cb40 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 252118424 0 0) 0x7fe3e0003520 con 0x7fe3f80b5150 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 msgr2=0x7fe3f8149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 0x7fe3f8149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 >> v1:172.21.15.164:6789/0 conn(0x7fe3f814cb40 legacy=0x7fe3f80b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80b9460 con 0x7fe3f80b5150 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fe3ec001670 con 0x7fe3f80b5150 2024-02-18T10:01:22.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 >> v1:172.21.15.118:6789/0 conn(0x7fe3f80b5150 legacy=0x7fe3f80bb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3e0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3e00047c0 0x7fe3e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 0x7fe3e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80ba640 con 0x7fe3e0003b30 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e000dc40 con 0x7fe3e00047c0 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e000de00 con 0x7fe3f8149110 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f659c640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3e0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f5d9b640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3e00047c0 0x7fe3e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f6d9d640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 0x7fe3e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f659c640 1 -- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 msgr2=0x7fe3e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f659c640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 0x7fe3e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f659c640 1 -- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3e00047c0 msgr2=0x7fe3e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f659c640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3e00047c0 0x7fe3e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f659c640 1 -- 172.21.15.118:0/3332558897 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0003520 con 0x7fe3e0003b30 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.802+0000 7fe3f6d9d640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f8149110 0x7fe3e0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.803+0000 7fe3f659c640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3e0003f30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8001fd0 tx=0x7fe3e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cfe2be7b225fe9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.803+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8003b70 con 0x7fe3e0003b30 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.803+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8003cd0 con 0x7fe3e0003b30 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.803+0000 7fe3f559a640 1 -- 172.21.15.118:0/3332558897 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80052f0 con 0x7fe3e0003b30 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.804+0000 7fe3fc93a640 1 -- 172.21.15.118:0/3332558897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 msgr2=0x7fe3e0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.804+0000 7fe3fc93a640 1 --2- 172.21.15.118:0/3332558897 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3e0003f30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8001fd0 tx=0x7fe3e00057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.804+0000 7fe3f6d9d640 1 -- 172.21.15.118:0/3332558897 reap_dead start 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.804+0000 7fe3fc93a640 1 -- 172.21.15.118:0/3332558897 shutdown_connections 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.804+0000 7fe3fc93a640 1 -- 172.21.15.118:0/3332558897 >> 172.21.15.118:0/3332558897 conn(0x7fe3f80bea10 msgr2=0x7fe3f80badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.804+0000 7fe3fc93a640 1 -- 172.21.15.118:0/3332558897 shutdown_connections 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.804+0000 7fe3fc93a640 1 -- 172.21.15.118:0/3332558897 wait complete. 2024-02-18T10:01:22.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.805+0000 7fe3fc93a640 1 Processor -- start 2024-02-18T10:01:22.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.805+0000 7fe3fc93a640 1 -- start start 2024-02-18T10:01:22.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.805+0000 7fe3fc93a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3f81de280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.805+0000 7fe3fc93a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f813e600 0x7fe3f8149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.805+0000 7fe3fc93a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3f813d4c0 0x7fe3f81e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.805+0000 7fe3fc93a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f814a010 con 0x7fe3e0003b30 2024-02-18T10:01:22.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3fc93a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f813d970 con 0x7fe3f813d4c0 2024-02-18T10:01:22.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3fc93a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f813ea40 con 0x7fe3f813e600 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3f81de280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3f81de280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48872/0 (socket says 172.21.15.118:48872) 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 -- 172.21.15.118:0/2317539155 learned_addr learned my addr 172.21.15.118:0/2317539155 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f5d9b640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f813e600 0x7fe3f8149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 -- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f813e600 msgr2=0x7fe3f8149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f6d9d640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3f813d4c0 0x7fe3f81e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f813e600 0x7fe3f8149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 -- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3f813d4c0 msgr2=0x7fe3f81e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3f813d4c0 0x7fe3f81e0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 -- 172.21.15.118:0/2317539155 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f814a1f0 con 0x7fe3e0003b30 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3f659c640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3f81de280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8001fd0 tx=0x7fe3e8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3e6ffd640 1 -- 172.21.15.118:0/2317539155 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8005700 con 0x7fe3e0003b30 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3e6ffd640 1 -- 172.21.15.118:0/2317539155 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8005860 con 0x7fe3e0003b30 2024-02-18T10:01:22.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f81dd7c0 con 0x7fe3e0003b30 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3e6ffd640 1 -- 172.21.15.118:0/2317539155 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e802c770 con 0x7fe3e0003b30 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.806+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f81ddd80 con 0x7fe3e0003b30 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.807+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f81ddf10 con 0x7fe3e0003b30 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.807+0000 7fe3e6ffd640 1 -- 172.21.15.118:0/2317539155 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe3e802c8d0 con 0x7fe3e0003b30 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.808+0000 7fe3e6ffd640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe3d806bc70 0x7fe3d806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.808+0000 7fe3f5d9b640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe3d806bc70 0x7fe3d806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.808+0000 7fe3e6ffd640 1 -- 172.21.15.118:0/2317539155 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe3e80ab9b0 con 0x7fe3e0003b30 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.808+0000 7fe3f5d9b640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe3d806bc70 0x7fe3d806e130 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3f81d4ce0 tx=0x7fe3ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:22.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.812+0000 7fe3e6ffd640 1 -- 172.21.15.118:0/2317539155 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe3e8076150 con 0x7fe3e0003b30 2024-02-18T10:01:22.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:22.982+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3f81ddf10 con 0x7fe3e0003b30 2024-02-18T10:01:23.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.858+0000 7fe3e6ffd640 1 -- 172.21.15.118:0/2317539155 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe3e8044020 con 0x7fe3e0003b30 2024-02-18T10:01:23.861 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-02-18T10:01:23.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe3d806bc70 msgr2=0x7fe3d806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe3d806bc70 0x7fe3d806e130 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3f81d4ce0 tx=0x7fe3ec009040 comp rx=0 tx=0).stop 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 msgr2=0x7fe3f81de280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3f81de280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8001fd0 tx=0x7fe3e8001650 comp rx=0 tx=0).stop 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 shutdown_connections 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe3d806bc70 0x7fe3d806e130 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3f813d4c0 0x7fe3f81e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3f813e600 0x7fe3f8149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 --2- 172.21.15.118:0/2317539155 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3e0003b30 0x7fe3f81de280 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 >> 172.21.15.118:0/2317539155 conn(0x7fe3f80bea10 msgr2=0x7fe3f8140820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 shutdown_connections 2024-02-18T10:01:23.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.862+0000 7fe3fc93a640 1 -- 172.21.15.118:0/2317539155 wait complete. 2024-02-18T10:01:23.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-18T10:01:23.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.990+0000 7fb7f1302640 1 Processor -- start 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.990+0000 7fb7f1302640 1 -- start start 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7f1302640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb7ec0bc390 0x7fb7ec06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7f1302640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bd080 0x7fb7ec14c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7f1302640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec14ce80 con 0x7fb7ec0bbfb0 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7f1302640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec14bf30 con 0x7fb7ec0bc390 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7f1302640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec14c4b0 con 0x7fb7ec0bd080 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7ea7fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb7ec0bc390 0x7fb7ec06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7ea7fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb7ec0bc390 0x7fb7ec06c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48874/0 (socket says 172.21.15.118:48874) 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/940203559 learned_addr learned my addr 172.21.15.118:0/940203559 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7eb7fe640 1 --2- 172.21.15.118:0/940203559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bd080 0x7fb7ec14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:23.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/940203559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bd080 msgr2=0x7fb7ec14c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:23.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7ea7fc640 1 --2- 172.21.15.118:0/940203559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bd080 0x7fb7ec14c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/940203559 >> v1:172.21.15.164:6789/0 conn(0x7fb7ec0bbfb0 legacy=0x7fb7ec06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:23.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.991+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/940203559 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0c0e10 con 0x7fb7ec0bc390 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7ea7fc640 1 --2- 172.21.15.118:0/940203559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec06c8e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009870 tx=0x7fb7e002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e3ced144b26c06 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7e9ffb640 1 -- 172.21.15.118:0/940203559 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0031740 con 0x7fb7ec0bc390 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7e9ffb640 1 -- 172.21.15.118:0/940203559 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e00318a0 con 0x7fb7ec0bc390 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7e9ffb640 1 -- 172.21.15.118:0/940203559 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0031c30 con 0x7fb7ec0bc390 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7f1302640 1 -- 172.21.15.118:0/940203559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 msgr2=0x7fb7ec06c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7f1302640 1 --2- 172.21.15.118:0/940203559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec06c8e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009870 tx=0x7fb7e002b7e0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7f1302640 1 -- 172.21.15.118:0/940203559 shutdown_connections 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7f1302640 1 --2- 172.21.15.118:0/940203559 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bd080 0x7fb7ec14c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7f1302640 1 --2- 172.21.15.118:0/940203559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec06c8e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.992+0000 7fb7f1302640 1 -- 172.21.15.118:0/940203559 >> 172.21.15.118:0/940203559 conn(0x7fb7ec0be0b0 msgr2=0x7fb7ec0be4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.993+0000 7fb7f1302640 1 -- 172.21.15.118:0/940203559 shutdown_connections 2024-02-18T10:01:23.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.993+0000 7fb7f1302640 1 -- 172.21.15.118:0/940203559 wait complete. 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 Processor -- start 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 -- start start 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bbfb0 0x7fb7ec149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7ec0bd080 0x7fb7ec146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1497c0 con 0x7fb7ec0bc390 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec14fd90 con 0x7fb7ec0bd080 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7f1302640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec150030 con 0x7fb7ec0bbfb0 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7ea7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7ea7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec14e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48886/0 (socket says 172.21.15.118:48886) 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.994+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/1178189901 learned_addr learned my addr 172.21.15.118:0/1178189901 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7eb7fe640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7ec0bd080 0x7fb7ec146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:23.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7eaffd640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bbfb0 0x7fb7ec149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bbfb0 msgr2=0x7fb7ec149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7ea7fc640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bbfb0 0x7fb7ec149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7ec0bd080 msgr2=0x7fb7ec146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7ea7fc640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7ec0bd080 0x7fb7ec146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7ea7fc640 1 -- 172.21.15.118:0/1178189901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00094d0 con 0x7fb7ec0bc390 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7eaffd640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bbfb0 0x7fb7ec149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7eb7fe640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7ec0bd080 0x7fb7ec146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7ea7fc640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec14e810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009870 tx=0x7fb7e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7d37fe640 1 -- 172.21.15.118:0/1178189901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0033d60 con 0x7fb7ec0bc390 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7d37fe640 1 -- 172.21.15.118:0/1178189901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e003c400 con 0x7fb7ec0bc390 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ec1d77e0 con 0x7fb7ec0bc390 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7d37fe640 1 -- 172.21.15.118:0/1178189901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e003c7b0 con 0x7fb7ec0bc390 2024-02-18T10:01:24.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.995+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec149e10 con 0x7fb7ec0bc390 2024-02-18T10:01:24.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.996+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec1d7d00 con 0x7fb7ec0bc390 2024-02-18T10:01:24.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.997+0000 7fb7d37fe640 1 -- 172.21.15.118:0/1178189901 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fb7e003a040 con 0x7fb7ec0bc390 2024-02-18T10:01:24.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.997+0000 7fb7d37fe640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb7d806bc70 0x7fb7d806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:24.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.997+0000 7fb7d37fe640 1 -- 172.21.15.118:0/1178189901 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb7e00ac0a0 con 0x7fb7ec0bc390 2024-02-18T10:01:24.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.997+0000 7fb7eaffd640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb7d806bc70 0x7fb7d806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:24.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:23.997+0000 7fb7eaffd640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb7d806bc70 0x7fb7d806e130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc003eb0 tx=0x7fb7dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:24.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.001+0000 7fb7d37fe640 1 -- 172.21.15.118:0/1178189901 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7ec1d7d00 con 0x7fb7ec0bc390 2024-02-18T10:01:24.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.173+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7ec1d7d00 con 0x7fb7ec0bc390 2024-02-18T10:01:24.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.859+0000 7fb7d37fe640 1 -- 172.21.15.118:0/1178189901 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb7ec1d7d00 con 0x7fb7ec0bc390 2024-02-18T10:01:24.862 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb7d806bc70 msgr2=0x7fb7d806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb7d806bc70 0x7fb7d806e130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc003eb0 tx=0x7fb7dc009040 comp rx=0 tx=0).stop 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 msgr2=0x7fb7ec14e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec14e810 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009870 tx=0x7fb7e00046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 shutdown_connections 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb7d806bc70 0x7fb7d806e130 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7ec0bd080 0x7fb7ec146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7ec0bc390 0x7fb7ec14e810 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 --2- 172.21.15.118:0/1178189901 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7ec0bbfb0 0x7fb7ec149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 >> 172.21.15.118:0/1178189901 conn(0x7fb7ec0be0b0 msgr2=0x7fb7ec0b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:24.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 shutdown_connections 2024-02-18T10:01:24.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:24.863+0000 7fb7f1302640 1 -- 172.21.15.118:0/1178189901 wait complete. 2024-02-18T10:01:24.880 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-18T10:01:24.881 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-18T10:01:24.881 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-18T10:01:24.881 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T10:01:24.881 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-18T10:01:24.881 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-18T10:01:24.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-18T10:01:24.881 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T10:01:24.882 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-18T10:01:24.882 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-18T10:01:24.882 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-18T10:01:24.882 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T10:01:24.892 INFO:tasks.ceph.mds.a:Stopped 2024-02-18T10:01:24.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-18T10:01:24.893 INFO:tasks.ceph.mds.c:Stopped 2024-02-18T10:01:24.893 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-18T10:01:24.894 INFO:tasks.ceph.mds.b:Stopped 2024-02-18T10:01:24.894 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-18T10:01:24.935 INFO:tasks.ceph.mds.a:Started 2024-02-18T10:01:24.935 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:24.936 INFO:tasks.ceph.mds.c:Started 2024-02-18T10:01:24.936 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:24.937 INFO:tasks.ceph.mds.b:Started 2024-02-18T10:01:24.937 DEBUG:teuthology.parallel:result is None 2024-02-18T10:01:24.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-18T10:01:25.015 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-02-18T10:01:25.015 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-02-18T10:01:25.016 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-02-18T10:01:25.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.043+0000 7f6262a2e640 1 Processor -- start 2024-02-18T10:01:25.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.043+0000 7f6262a2e640 1 -- start start 2024-02-18T10:01:25.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f6262a2e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f625c0a0ce0 0x7f625c0ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f6262a2e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 0x7f625c14d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f6262a2e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0b4f90 con 0x7f625c143e10 2024-02-18T10:01:25.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f6262a2e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c072fe0 con 0x7f625c0a0ce0 2024-02-18T10:01:25.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f6262a2e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c1441f0 con 0x7f625c14cfd0 2024-02-18T10:01:25.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f625bfff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f625c143e10 0x7f625c070fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33700/0 (socket says 172.21.15.118:33700) 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f625bfff640 1 -- 172.21.15.118:0/2137960020 learned_addr learned my addr 172.21.15.118:0/2137960020 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f625b7fe640 1 --2- 172.21.15.118:0/2137960020 >> v2:172.21.15.164:3300/0 conn(0x7f625c0a0ce0 0x7f625c0ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f6260fcb640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 0x7f625c14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.044+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439856104 0 0) 0x7f625c0b4f90 con 0x7f625c143e10 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6244003520 con 0x7f625c143e10 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141694618 0 0) 0x7f6244003520 con 0x7f625c143e10 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 msgr2=0x7f625c14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 0x7f625c14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 >> v2:172.21.15.164:3300/0 conn(0x7f625c0a0ce0 msgr2=0x7f625c0ba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 --2- 172.21.15.118:0/2137960020 >> v2:172.21.15.164:3300/0 conn(0x7f625c0a0ce0 0x7f625c0ba180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0716f0 con 0x7f625c143e10 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f624c001670 con 0x7f625c143e10 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 >> v1:172.21.15.118:6789/0 conn(0x7f625c143e10 legacy=0x7f625c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:25.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6244003970 0x7f6244003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62440047c0 0x7f6244004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 0x7f6244005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c072fe0 con 0x7f62440047c0 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c1441f0 con 0x7f6244003970 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624400b9b0 con 0x7f625c14cfd0 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625b7fe640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62440047c0 0x7f6244004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625bfff640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6244003970 0x7f6244003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f6260fcb640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 0x7f6244005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625b7fe640 1 -- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 msgr2=0x7f6244005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625b7fe640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f625c14cfd0 0x7f6244005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625b7fe640 1 -- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6244003970 msgr2=0x7f6244003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625b7fe640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6244003970 0x7f6244003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.045+0000 7f625b7fe640 1 -- 172.21.15.118:0/2137960020 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244003520 con 0x7f62440047c0 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.046+0000 7f625b7fe640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62440047c0 0x7f6244004c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6250009a90 tx=0x7f62440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0527c1d0d62486 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.046+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625002c6b0 con 0x7f62440047c0 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.046+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625002c810 con 0x7f62440047c0 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.046+0000 7f625affd640 1 -- 172.21.15.118:0/2137960020 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625002cbc0 con 0x7f62440047c0 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.046+0000 7f6262a2e640 1 -- 172.21.15.118:0/2137960020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62440047c0 msgr2=0x7f6244004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.046+0000 7f6262a2e640 1 --2- 172.21.15.118:0/2137960020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f62440047c0 0x7f6244004c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6250009a90 tx=0x7f62440057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.047+0000 7f6260fcb640 1 -- 172.21.15.118:0/2137960020 reap_dead start 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.047+0000 7f6262a2e640 1 -- 172.21.15.118:0/2137960020 shutdown_connections 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.047+0000 7f6262a2e640 1 -- 172.21.15.118:0/2137960020 >> 172.21.15.118:0/2137960020 conn(0x7f625c06bcf0 msgr2=0x7f625c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.047+0000 7f6262a2e640 1 -- 172.21.15.118:0/2137960020 shutdown_connections 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.047+0000 7f6262a2e640 1 -- 172.21.15.118:0/2137960020 wait complete. 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 Processor -- start 2024-02-18T10:01:25.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 -- start start 2024-02-18T10:01:25.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62440047c0 0x7f625c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f625c140fc0 0x7f625c141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625c0b9580 0x7f625c1e0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c13f720 con 0x7f625c140fc0 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c06f150 con 0x7f625c0b9580 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f6262a2e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c14c240 con 0x7f62440047c0 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f625b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f625c140fc0 0x7f625c141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f625b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f625c140fc0 0x7f625c141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48950/0 (socket says 172.21.15.118:48950) 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.048+0000 7f625b7fe640 1 -- 172.21.15.118:0/373071974 learned_addr learned my addr 172.21.15.118:0/373071974 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f6260fcb640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625c0b9580 0x7f625c1e0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f625bfff640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62440047c0 0x7f625c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f625b7fe640 1 -- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62440047c0 msgr2=0x7f625c14bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f625b7fe640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62440047c0 0x7f625c14bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f625b7fe640 1 -- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625c0b9580 msgr2=0x7f625c1e0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f625b7fe640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625c0b9580 0x7f625c1e0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f625b7fe640 1 -- 172.21.15.118:0/373071974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c141aa0 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f625b7fe640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f625c140fc0 0x7f625c141ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6250009bb0 tx=0x7f6250004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f6258ff9640 1 -- 172.21.15.118:0/373071974 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250034b40 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f6258ff9640 1 -- 172.21.15.118:0/373071974 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250034cc0 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c13ee30 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f6258ff9640 1 -- 172.21.15.118:0/373071974 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625003e680 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.049+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c13f0d0 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.050+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c074af0 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.051+0000 7f6258ff9640 1 -- 172.21.15.118:0/373071974 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f625003e7e0 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.051+0000 7f6258ff9640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f624806bbb0 0x7f624806e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.051+0000 7f6258ff9640 1 -- 172.21.15.118:0/373071974 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f62500ac280 con 0x7f625c140fc0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.051+0000 7f625bfff640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f624806bbb0 0x7f624806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.051+0000 7f625bfff640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f624806bbb0 0x7f624806e070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f624c000fb0 tx=0x7f624c0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:25.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.055+0000 7f6258ff9640 1 -- 172.21.15.118:0/373071974 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6250076ea0 con 0x7f625c140fc0 2024-02-18T10:01:25.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.239+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f625c141c30 con 0x7f625c140fc0 2024-02-18T10:01:25.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.876+0000 7f6258ff9640 1 -- 172.21.15.118:0/373071974 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f625007a560 con 0x7f625c140fc0 2024-02-18T10:01:25.879 INFO:teuthology.orchestra.run.smithi118.stderr: removed all blocklist entries 2024-02-18T10:01:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f624806bbb0 msgr2=0x7f624806e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f624806bbb0 0x7f624806e070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f624c000fb0 tx=0x7f624c0078f0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f625c140fc0 msgr2=0x7f625c141ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f625c140fc0 0x7f625c141ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6250009bb0 tx=0x7f6250004730 comp rx=0 tx=0).stop 2024-02-18T10:01:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 shutdown_connections 2024-02-18T10:01:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f624806bbb0 0x7f624806e070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f625c0b9580 0x7f625c1e0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f625c140fc0 0x7f625c141ed0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 --2- 172.21.15.118:0/373071974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f62440047c0 0x7f625c14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 >> 172.21.15.118:0/373071974 conn(0x7f625c06bcf0 msgr2=0x7f625c13ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 shutdown_connections 2024-02-18T10:01:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.879+0000 7f6262a2e640 1 -- 172.21.15.118:0/373071974 wait complete. 2024-02-18T10:01:25.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-18T10:01:25.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.991+0000 7f0ec4d4b640 1 Processor -- start 2024-02-18T10:01:25.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.991+0000 7f0ec4d4b640 1 -- start start 2024-02-18T10:01:25.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.991+0000 7f0ec4d4b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec00bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ec4d4b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ec0152330 0x7f0ec0154720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:25.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ec4d4b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec014a1d0 con 0x7f0ec0072ed0 2024-02-18T10:01:25.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ec4d4b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00732b0 con 0x7f0ec0152330 2024-02-18T10:01:25.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ec4d4b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00b8830 con 0x7f0ec00bb6c0 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0eb7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec00bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ec0152330 0x7f0ec0154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0eb7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec00bcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:49330/0 (socket says 172.21.15.118:49330) 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebed9d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ec0152330 0x7f0ec0154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:39484/0 (socket says 172.21.15.118:39484) 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebe59c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0ec0072ed0 0x7f0ec0149ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:33892/0 (socket says 172.21.15.118:33892) 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0eb7fff640 1 -- 172.21.15.118:0/1358006951 learned_addr learned my addr 172.21.15.118:0/1358006951 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebed9d640 1 -- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 msgr2=0x7f0ec00bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebed9d640 1 --2- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec00bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebed9d640 1 -- 172.21.15.118:0/1358006951 >> v1:172.21.15.164:6789/0 conn(0x7f0ec0072ed0 legacy=0x7f0ec0149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebdd9b640 1 -- 172.21.15.118:0/1358006951 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565622686 0 0) 0x7f0ec014a1d0 con 0x7f0ec0072ed0 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0ebed9d640 1 -- 172.21.15.118:0/1358006951 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00b9bb0 con 0x7f0ec0152330 2024-02-18T10:01:25.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.992+0000 7f0eb7fff640 1 --2- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec00bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:01:25.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.993+0000 7f0ebed9d640 1 --2- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0152330 0x7f0ec0154720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009d90 tx=0x7f0eb802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efad4df57700f173 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:25.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.993+0000 7f0ebdd9b640 1 -- 172.21.15.118:0/1358006951 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb802cce0 con 0x7f0ec0152330 2024-02-18T10:01:25.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.993+0000 7f0ebdd9b640 1 -- 172.21.15.118:0/1358006951 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb802ce40 con 0x7f0ec0152330 2024-02-18T10:01:25.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.993+0000 7f0ebdd9b640 1 -- 172.21.15.118:0/1358006951 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8034660 con 0x7f0ec0152330 2024-02-18T10:01:25.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0152330 msgr2=0x7f0ec0154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0152330 0x7f0ec0154720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009d90 tx=0x7f0eb802bf30 comp rx=0 tx=0).stop 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/1358006951 shutdown_connections 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0152330 0x7f0ec0154720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/1358006951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec00bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/1358006951 >> 172.21.15.118:0/1358006951 conn(0x7f0ec00ba3c0 msgr2=0x7f0ec00ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/1358006951 shutdown_connections 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.994+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/1358006951 wait complete. 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.995+0000 7f0ec4d4b640 1 Processor -- start 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.995+0000 7f0ec4d4b640 1 -- start start 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0072ed0 0x7f0ec009c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec01e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ec0152330 0x7f0ec01e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec009c730 con 0x7f0ec0152330 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec01e2b10 con 0x7f0ec0072ed0 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec014d360 con 0x7f0ec00bb6c0 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ec0152330 0x7f0ec01e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ec0152330 0x7f0ec01e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48962/0 (socket says 172.21.15.118:48962) 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebe59c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0072ed0 0x7f0ec009c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 -- 172.21.15.118:0/3192521640 learned_addr learned my addr 172.21.15.118:0/3192521640 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0eb7fff640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec01e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 -- 172.21.15.118:0/3192521640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 msgr2=0x7f0ec01e2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec01e2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 -- 172.21.15.118:0/3192521640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0072ed0 msgr2=0x7f0ec009c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0072ed0 0x7f0ec009c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 -- 172.21.15.118:0/3192521640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80094d0 con 0x7f0ec0152330 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ebed9d640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ec0152330 0x7f0ec01e34a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009d90 tx=0x7f0eb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0eb6ffd640 1 -- 172.21.15.118:0/3192521640 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803d600 con 0x7f0ec0152330 2024-02-18T10:01:26.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0eb6ffd640 1 -- 172.21.15.118:0/3192521640 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb803d780 con 0x7f0ec0152330 2024-02-18T10:01:26.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb8009a70 con 0x7f0ec0152330 2024-02-18T10:01:26.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0eb6ffd640 1 -- 172.21.15.118:0/3192521640 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb803db30 con 0x7f0ec0152330 2024-02-18T10:01:26.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.996+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec014d7a0 con 0x7f0ec0152330 2024-02-18T10:01:26.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.997+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec01e2c80 con 0x7f0ec0152330 2024-02-18T10:01:26.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.998+0000 7f0eb6ffd640 1 -- 172.21.15.118:0/3192521640 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f0eb803b040 con 0x7f0ec0152330 2024-02-18T10:01:26.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.998+0000 7f0eb6ffd640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ea006bc70 0x7f0ea006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.998+0000 7f0ebe59c640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ea006bc70 0x7f0ea006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.998+0000 7f0eb6ffd640 1 -- 172.21.15.118:0/3192521640 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0eb80aca80 con 0x7f0ec0152330 2024-02-18T10:01:26.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:25.999+0000 7f0ebe59c640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ea006bc70 0x7f0ea006e130 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000f60 tx=0x7f0eb0007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.003+0000 7f0eb6ffd640 1 -- 172.21.15.118:0/3192521640 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0eb8077700 con 0x7f0ec0152330 2024-02-18T10:01:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.236+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0ec0074af0 con 0x7f0ec0152330 2024-02-18T10:01:26.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.237+0000 7f0eb6ffd640 1 -- 172.21.15.118:0/3192521640 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f0eb8039020 con 0x7f0ec0152330 2024-02-18T10:01:26.239 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "auth_dump": [ 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.a", 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAf1dFlK8i4OBAAXyAQlEOhLk2JxG26TDjvMA==", 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.240 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.b", 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAg1dFlaZ2rCRAAjoLyp5IMWyzQITIFoWfxNQ==", 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mds.c", 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAg1dFln5KEBBAAPXVdsnZgh1+L7xmod1cy3w==", 2024-02-18T10:01:26.241 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.0", 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAh1dFlUcU9KRAA2TQ9NJ/i+zoKpvdaM5UQ/g==", 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.242 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.1", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAk1dFlIoSrJxAAgq4PFCxo4S4JcDOAdKBG5A==", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.2", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAn1dFlYqp5JRAAgLKJMl6dVqVrmdPiP/61iw==", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.243 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.3", 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAq1dFlx7aIIxAAhIetQzGpdgRooeZMK/ntnQ==", 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.4", 2024-02-18T10:01:26.244 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAw1dFl+iUQKxAAMd711I16qWMRcc0MC8jr3Q==", 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.5", 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAz1dFliSItKhAAYAKyR5+7k/6hOQhhJx/t9A==", 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.245 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.6", 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA21dFllJeWKRAAvn/73gtTX5CEB2la4Mulhg==", 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "osd.7", 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA51dFlXuD+KBAA/BgFoqTKXewad426bvBp4g==", 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow profile osd", 2024-02-18T10:01:26.246 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile osd", 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.0", 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAg1dFl2zJ1FBAAQcxOcwyOcAlkdfSHOaIsTw==", 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow", 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow r", 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow rw", 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow rwx" 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.247 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.admin", 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAf1dFlF/iuDBAAjtOPYBhtZeQTg1evA2AL/Q==", 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "mgr": "allow *", 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow *", 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-mds", 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA/1dFlxok0CRAA7qOS3PMS02Tzc33vQuI5DQ==", 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.248 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-mds" 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-mgr", 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA/1dFlapI0CRAAyrvRVME5c+CMJJSlKZMxUg==", 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-mgr" 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-osd", 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA/1dFlLZk0CRAAC2kV91nzjNBaTDTHQQA8wQ==", 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.249 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-osd" 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-rbd", 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA/1dFlmJ80CRAAEoQE+rQ6iJ5Cn3fuW9yOsA==", 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-rbd" 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA/1dFlUqY0CRAATQJCEER0lqodBn5+PKE6vQ==", 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.250 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "client.bootstrap-rgw", 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQA/1dFloq80CRAAXgqrkxhm9wNqwvJXjPFF8g==", 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile bootstrap-rgw" 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.x", 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAf1dFlrTFTNRAArepKos3n7/2awmgj1vjjbg==", 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.251 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: "entity": "mgr.y", 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: "key": "AQAf1dFl2jlJMRAADo3B6pLKJsxjgJy5Wjk6Kw==", 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: "caps": { 2024-02-18T10:01:26.252 INFO:teuthology.orchestra.run.smithi118.stdout: "mds": "allow *", 2024-02-18T10:01:26.254 INFO:teuthology.orchestra.run.smithi118.stdout: "mon": "allow profile mgr", 2024-02-18T10:01:26.254 INFO:teuthology.orchestra.run.smithi118.stdout: "osd": "allow *" 2024-02-18T10:01:26.254 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.254 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:26.255 INFO:teuthology.orchestra.run.smithi118.stdout: ] 2024-02-18T10:01:26.255 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T10:01:26.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ea006bc70 msgr2=0x7f0ea006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ea006bc70 0x7f0ea006e130 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000f60 tx=0x7f0eb0007d50 comp rx=0 tx=0).stop 2024-02-18T10:01:26.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ec0152330 msgr2=0x7f0ec01e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ec0152330 0x7f0ec01e34a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009d90 tx=0x7f0eb8004a40 comp rx=0 tx=0).stop 2024-02-18T10:01:26.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 shutdown_connections 2024-02-18T10:01:26.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0ea006bc70 0x7f0ea006e130 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ec0152330 0x7f0ec01e34a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ec00bb6c0 0x7f0ec01e2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 --2- 172.21.15.118:0/3192521640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ec0072ed0 0x7f0ec009c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 >> 172.21.15.118:0/3192521640 conn(0x7f0ec00ba3c0 msgr2=0x7f0ec009ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:26.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 shutdown_connections 2024-02-18T10:01:26.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.239+0000 7f0ec4d4b640 1 -- 172.21.15.118:0/3192521640 wait complete. 2024-02-18T10:01:26.258 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-02-18T10:01:26.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.357+0000 7f13687d0640 1 Processor -- start 2024-02-18T10:01:26.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.357+0000 7f13687d0640 1 -- start start 2024-02-18T10:01:26.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.357+0000 7f13687d0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f136006bcf0 0x7f136014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.357+0000 7f13687d0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f136006c0d0 0x7f136014f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.357+0000 7f13687d0640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136006d600 con 0x7f136006d9b0 2024-02-18T10:01:26.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.357+0000 7f13687d0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1360070080 con 0x7f136006bcf0 2024-02-18T10:01:26.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.357+0000 7f13687d0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136006ec70 con 0x7f136006c0d0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136656c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f136006bcf0 0x7f136014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136656c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f136006bcf0 0x7f136014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48976/0 (socket says 172.21.15.118:48976) 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f1366d6d640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f136006d9b0 0x7f136014bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33710/0 (socket says 172.21.15.118:33710) 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136656c640 1 -- 172.21.15.118:0/361318211 learned_addr learned my addr 172.21.15.118:0/361318211 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f1365d6b640 1 --2- 172.21.15.118:0/361318211 >> v2:172.21.15.164:3300/0 conn(0x7f136006c0d0 0x7f136014f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136656c640 1 -- 172.21.15.118:0/361318211 >> v2:172.21.15.164:3300/0 conn(0x7f136006c0d0 msgr2=0x7f136014f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136656c640 1 --2- 172.21.15.118:0/361318211 >> v2:172.21.15.164:3300/0 conn(0x7f136006c0d0 0x7f136014f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136656c640 1 -- 172.21.15.118:0/361318211 >> v1:172.21.15.118:6789/0 conn(0x7f136006d9b0 legacy=0x7f136014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136556a640 1 -- 172.21.15.118:0/361318211 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964510621 0 0) 0x7f136006d600 con 0x7f136006d9b0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.358+0000 7f136656c640 1 -- 172.21.15.118:0/361318211 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136006ef50 con 0x7f136006bcf0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f136656c640 1 --2- 172.21.15.118:0/361318211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006bcf0 0x7f136014f2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1360073230 tx=0x7f135c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630e6bfd036f5bfc server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f136556a640 1 -- 172.21.15.118:0/361318211 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c030860 con 0x7f136006bcf0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f136556a640 1 -- 172.21.15.118:0/361318211 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c0309c0 con 0x7f136006bcf0 2024-02-18T10:01:26.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f136556a640 1 -- 172.21.15.118:0/361318211 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c030d50 con 0x7f136006bcf0 2024-02-18T10:01:26.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 -- 172.21.15.118:0/361318211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006bcf0 msgr2=0x7f136014f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 --2- 172.21.15.118:0/361318211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006bcf0 0x7f136014f2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1360073230 tx=0x7f135c02b9a0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 -- 172.21.15.118:0/361318211 shutdown_connections 2024-02-18T10:01:26.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 --2- 172.21.15.118:0/361318211 >> v2:172.21.15.164:3300/0 conn(0x7f136006c0d0 0x7f136014f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 --2- 172.21.15.118:0/361318211 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006bcf0 0x7f136014f2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 -- 172.21.15.118:0/361318211 >> 172.21.15.118:0/361318211 conn(0x7f13600bbea0 msgr2=0x7f13600bc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 -- 172.21.15.118:0/361318211 shutdown_connections 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.359+0000 7f13687d0640 1 -- 172.21.15.118:0/361318211 wait complete. 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.360+0000 7f13687d0640 1 Processor -- start 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.360+0000 7f13687d0640 1 -- start start 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f13687d0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f136006bcf0 0x7f13600a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f13687d0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136006c0d0 0x7f136013f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f13687d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006d9b0 0x7f13601e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f13687d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13600a44c0 con 0x7f136006d9b0 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f13687d0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1360149a40 con 0x7f136006c0d0 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f13687d0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13600b8f00 con 0x7f136006bcf0 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006d9b0 0x7f13601e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006d9b0 0x7f13601e11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48992/0 (socket says 172.21.15.118:48992) 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 -- 172.21.15.118:0/3611068450 learned_addr learned my addr 172.21.15.118:0/3611068450 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 -- 172.21.15.118:0/3611068450 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f136006bcf0 msgr2=0x7f13600a3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f136006bcf0 0x7f13600a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 -- 172.21.15.118:0/3611068450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136006c0d0 msgr2=0x7f136013f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136006c0d0 0x7f136013f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 -- 172.21.15.118:0/3611068450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c0094d0 con 0x7f136006d9b0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.361+0000 7f1366d6d640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006d9b0 0x7f13601e11b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f135800c7d0 tx=0x7f135800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.362+0000 7f1356ffd640 1 -- 172.21.15.118:0/3611068450 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135800a640 con 0x7f136006d9b0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.362+0000 7f1356ffd640 1 -- 172.21.15.118:0/3611068450 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135800a7a0 con 0x7f136006d9b0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.362+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13601463b0 con 0x7f136006d9b0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.362+0000 7f1356ffd640 1 -- 172.21.15.118:0/3611068450 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135800ab50 con 0x7f136006d9b0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.362+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136014aca0 con 0x7f136006d9b0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.363+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13600676c0 con 0x7f136006d9b0 2024-02-18T10:01:26.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.363+0000 7f1356ffd640 1 -- 172.21.15.118:0/3611068450 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f135800acb0 con 0x7f136006d9b0 2024-02-18T10:01:26.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.363+0000 7f1356ffd640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f134406bc70 0x7f134406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.363+0000 7f1356ffd640 1 -- 172.21.15.118:0/3611068450 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1358089cd0 con 0x7f136006d9b0 2024-02-18T10:01:26.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.363+0000 7f136656c640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f134406bc70 0x7f134406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.364+0000 7f136656c640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f134406bc70 0x7f134406e130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f135c036000 tx=0x7f135c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.368+0000 7f1356ffd640 1 -- 172.21.15.118:0/3611068450 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1358054800 con 0x7f136006d9b0 2024-02-18T10:01:26.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.602+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f1360074af0 con 0x7f136006d9b0 2024-02-18T10:01:26.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.604+0000 7f1356ffd640 1 -- 172.21.15.118:0/3611068450 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1358018020 con 0x7f136006d9b0 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f134406bc70 msgr2=0x7f134406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f134406bc70 0x7f134406e130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f135c036000 tx=0x7f135c030000 comp rx=0 tx=0).stop 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006d9b0 msgr2=0x7f13601e11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006d9b0 0x7f13601e11b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f135800c7d0 tx=0x7f135800cc90 comp rx=0 tx=0).stop 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 shutdown_connections 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f134406bc70 0x7f134406e130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f136006d9b0 0x7f13601e11b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f136006c0d0 0x7f136013f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 --2- 172.21.15.118:0/3611068450 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f136006bcf0 0x7f13600a3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 >> 172.21.15.118:0/3611068450 conn(0x7f13600bbea0 msgr2=0x7f13600ba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:26.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 shutdown_connections 2024-02-18T10:01:26.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.606+0000 7f13687d0640 1 -- 172.21.15.118:0/3611068450 wait complete. 2024-02-18T10:01:26.620 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-02-18T10:01:26.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.717+0000 7f2459fe9640 1 Processor -- start 2024-02-18T10:01:26.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.717+0000 7f2459fe9640 1 -- start start 2024-02-18T10:01:26.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2459fe9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2454143e10 0x7f24540ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2459fe9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24540a0ce0 0x7f2454070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2459fe9640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f245414cfd0 0x7f245414d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2459fe9640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2454072fe0 con 0x7f2454143e10 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2459fe9640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540b4f90 con 0x7f245414cfd0 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2459fe9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24541441f0 con 0x7f24540a0ce0 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2454143e10 0x7f24540ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2454143e10 0x7f24540ba180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48996/0 (socket says 172.21.15.118:48996) 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 -- 172.21.15.118:0/629746259 learned_addr learned my addr 172.21.15.118:0/629746259 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2453fff640 1 --2- 172.21.15.118:0/629746259 >> v2:172.21.15.164:3300/0 conn(0x7f245414cfd0 0x7f245414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2452ffd640 1 --2- 172.21.15.118:0/629746259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24540a0ce0 0x7f2454070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 -- 172.21.15.118:0/629746259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24540a0ce0 msgr2=0x7f2454070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 --2- 172.21.15.118:0/629746259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24540a0ce0 0x7f2454070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 -- 172.21.15.118:0/629746259 >> v2:172.21.15.164:3300/0 conn(0x7f245414cfd0 msgr2=0x7f245414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 --2- 172.21.15.118:0/629746259 >> v2:172.21.15.164:3300/0 conn(0x7f245414cfd0 0x7f245414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f24537fe640 1 -- 172.21.15.118:0/629746259 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540b4660 con 0x7f2454143e10 2024-02-18T10:01:26.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2453fff640 1 --2- 172.21.15.118:0/629746259 >> v2:172.21.15.164:3300/0 conn(0x7f245414cfd0 0x7f245414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.718+0000 7f2452ffd640 1 --2- 172.21.15.118:0/629746259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24540a0ce0 0x7f2454070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.719+0000 7f24537fe640 1 --2- 172.21.15.118:0/629746259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2454143e10 0x7f24540ba180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2444009870 tx=0x7f244402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc5341590a8bee9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.719+0000 7f24527fc640 1 -- 172.21.15.118:0/629746259 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444030840 con 0x7f2454143e10 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.719+0000 7f24527fc640 1 -- 172.21.15.118:0/629746259 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24440309a0 con 0x7f2454143e10 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.719+0000 7f24527fc640 1 -- 172.21.15.118:0/629746259 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444030d30 con 0x7f2454143e10 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 -- 172.21.15.118:0/629746259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2454143e10 msgr2=0x7f24540ba180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 --2- 172.21.15.118:0/629746259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2454143e10 0x7f24540ba180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2444009870 tx=0x7f244402b980 comp rx=0 tx=0).stop 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 -- 172.21.15.118:0/629746259 shutdown_connections 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 --2- 172.21.15.118:0/629746259 >> v2:172.21.15.164:3300/0 conn(0x7f245414cfd0 0x7f245414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 --2- 172.21.15.118:0/629746259 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24540a0ce0 0x7f2454070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 --2- 172.21.15.118:0/629746259 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2454143e10 0x7f24540ba180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 -- 172.21.15.118:0/629746259 >> 172.21.15.118:0/629746259 conn(0x7f245406bcf0 msgr2=0x7f245406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 -- 172.21.15.118:0/629746259 shutdown_connections 2024-02-18T10:01:26.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.720+0000 7f2459fe9640 1 -- 172.21.15.118:0/629746259 wait complete. 2024-02-18T10:01:26.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.721+0000 7f2459fe9640 1 Processor -- start 2024-02-18T10:01:26.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.721+0000 7f2459fe9640 1 -- start start 2024-02-18T10:01:26.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24540a0ce0 0x7f245414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2454143e10 0x7f24541e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f245414cfd0 0x7f24540bd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24541385e0 con 0x7f245414cfd0 2024-02-18T10:01:26.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245414b9b0 con 0x7f24540a0ce0 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245414b6d0 con 0x7f2454143e10 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f245414cfd0 0x7f24540bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f245414cfd0 0x7f24540bd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49004/0 (socket says 172.21.15.118:49004) 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 -- 172.21.15.118:0/3052865338 learned_addr learned my addr 172.21.15.118:0/3052865338 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2452ffd640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2454143e10 0x7f24541e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f24537fe640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24540a0ce0 0x7f245414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 -- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2454143e10 msgr2=0x7f24541e2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2454143e10 0x7f24541e2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 -- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24540a0ce0 msgr2=0x7f245414b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24540a0ce0 0x7f245414b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 -- 172.21.15.118:0/3052865338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440094d0 con 0x7f245414cfd0 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2453fff640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f245414cfd0 0x7f24540bd560 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f244c00cd50 tx=0x7f244c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f243bfff640 1 -- 172.21.15.118:0/3052865338 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00f680 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f243bfff640 1 -- 172.21.15.118:0/3052865338 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00f800 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24541e25d0 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f243bfff640 1 -- 172.21.15.118:0/3052865338 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00fbb0 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.722+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24541e3310 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.723+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24541e2af0 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.724+0000 7f243bfff640 1 -- 172.21.15.118:0/3052865338 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f244c00b040 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.724+0000 7f243bfff640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f244006bc70 0x7f244006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.724+0000 7f24537fe640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f244006bc70 0x7f244006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.724+0000 7f243bfff640 1 -- 172.21.15.118:0/3052865338 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f244c08ad00 con 0x7f245414cfd0 2024-02-18T10:01:26.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.725+0000 7f24537fe640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f244006bc70 0x7f244006e130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2444036000 tx=0x7f2444008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:26.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.728+0000 7f243bfff640 1 -- 172.21.15.118:0/3052865338 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f24541e2af0 con 0x7f245414cfd0 2024-02-18T10:01:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.968+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f24541e2af0 con 0x7f245414cfd0 2024-02-18T10:01:26.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.970+0000 7f243bfff640 1 -- 172.21.15.118:0/3052865338 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f24541e2af0 con 0x7f245414cfd0 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f244006bc70 msgr2=0x7f244006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f244006bc70 0x7f244006e130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2444036000 tx=0x7f2444008030 comp rx=0 tx=0).stop 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f245414cfd0 msgr2=0x7f24540bd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f245414cfd0 0x7f24540bd560 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f244c00cd50 tx=0x7f244c00a650 comp rx=0 tx=0).stop 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 shutdown_connections 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f244006bc70 0x7f244006e130 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f245414cfd0 0x7f24540bd560 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2454143e10 0x7f24541e2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 --2- 172.21.15.118:0/3052865338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24540a0ce0 0x7f245414b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 >> 172.21.15.118:0/3052865338 conn(0x7f245406bcf0 msgr2=0x7f24540b9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 shutdown_connections 2024-02-18T10:01:26.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:26.972+0000 7f2459fe9640 1 -- 172.21.15.118:0/3052865338 wait complete. 2024-02-18T10:01:26.986 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-02-18T10:01:27.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fdaa2e640 1 Processor -- start 2024-02-18T10:01:27.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fdaa2e640 1 -- start start 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fdaa2e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414bcd0 0x7f3fd40bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fdaa2e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fd406ce30 0x7f3fd406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fdaa2e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd406dd50 con 0x7f3fd414c900 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fdaa2e640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd40ba440 con 0x7f3fd406ce30 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fdaa2e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd406d800 con 0x7f3fd414bcd0 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fd8fcb640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fd406ce30 0x7f3fd406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fd3fff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3fd414c900 0x7f3fd406f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33716/0 (socket says 172.21.15.118:33716) 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.084+0000 7f3fd3fff640 1 -- 172.21.15.118:0/2246479818 learned_addr learned my addr 172.21.15.118:0/2246479818 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:27.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd37fe640 1 --2- 172.21.15.118:0/2246479818 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414bcd0 0x7f3fd40bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd8fcb640 1 -- 172.21.15.118:0/2246479818 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414bcd0 msgr2=0x7f3fd40bbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd2ffd640 1 -- 172.21.15.118:0/2246479818 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451497366 0 0) 0x7f3fd406dd50 con 0x7f3fd414c900 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd8fcb640 1 --2- 172.21.15.118:0/2246479818 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414bcd0 0x7f3fd40bbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd8fcb640 1 -- 172.21.15.118:0/2246479818 >> v1:172.21.15.118:6789/0 conn(0x7f3fd414c900 legacy=0x7f3fd406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd8fcb640 1 -- 172.21.15.118:0/2246479818 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd406da90 con 0x7f3fd406ce30 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd8fcb640 1 --2- 172.21.15.118:0/2246479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd406d2c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009d90 tx=0x7f3fcc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bea3f23f0240b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.085+0000 7f3fd2ffd640 1 -- 172.21.15.118:0/2246479818 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc02cc50 con 0x7f3fd406ce30 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fd2ffd640 1 -- 172.21.15.118:0/2246479818 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc02cdb0 con 0x7f3fd406ce30 2024-02-18T10:01:27.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fd2ffd640 1 -- 172.21.15.118:0/2246479818 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc034660 con 0x7f3fd406ce30 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2246479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 msgr2=0x7f3fd406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2246479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd406d2c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009d90 tx=0x7f3fcc02bea0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2246479818 shutdown_connections 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2246479818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd406d2c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2246479818 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414bcd0 0x7f3fd40bbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2246479818 >> 172.21.15.118:0/2246479818 conn(0x7f3fd40bf330 msgr2=0x7f3fd40bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2246479818 shutdown_connections 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.086+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2246479818 wait complete. 2024-02-18T10:01:27.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.087+0000 7f3fdaa2e640 1 Processor -- start 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.087+0000 7f3fdaa2e640 1 -- start start 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fdaa2e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd41450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fdaa2e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fd414bcd0 0x7f3fd40b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fdaa2e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414c900 0x7f3fd41d52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fdaa2e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd41d8ec0 con 0x7f3fd406ce30 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fdaa2e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd414b7a0 con 0x7f3fd414bcd0 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fdaa2e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40b96b0 con 0x7f3fd414c900 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd41450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd41450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49036/0 (socket says 172.21.15.118:49036) 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 -- 172.21.15.118:0/2900068804 learned_addr learned my addr 172.21.15.118:0/2900068804 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 -- 172.21.15.118:0/2900068804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414c900 msgr2=0x7f3fd41d52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414c900 0x7f3fd41d52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 -- 172.21.15.118:0/2900068804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fd414bcd0 msgr2=0x7f3fd40b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fd414bcd0 0x7f3fd40b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 -- 172.21.15.118:0/2900068804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc009a70 con 0x7f3fd406ce30 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd3fff640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd41450f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400c430 tx=0x7f3fc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.088+0000 7f3fd0ff9640 1 -- 172.21.15.118:0/2900068804 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40074e0 con 0x7f3fd406ce30 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.089+0000 7f3fd0ff9640 1 -- 172.21.15.118:0/2900068804 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4007660 con 0x7f3fd406ce30 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.089+0000 7f3fd0ff9640 1 -- 172.21.15.118:0/2900068804 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4004a20 con 0x7f3fd406ce30 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.089+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd41e1490 con 0x7f3fd406ce30 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.089+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd41e1a50 con 0x7f3fd406ce30 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.089+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd4074af0 con 0x7f3fd406ce30 2024-02-18T10:01:27.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.090+0000 7f3fd0ff9640 1 -- 172.21.15.118:0/2900068804 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f3fc4004b80 con 0x7f3fd406ce30 2024-02-18T10:01:27.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.090+0000 7f3fd0ff9640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fc006bca0 0x7f3fc006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.090+0000 7f3fd0ff9640 1 -- 172.21.15.118:0/2900068804 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fc408a2e0 con 0x7f3fd406ce30 2024-02-18T10:01:27.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.090+0000 7f3fd37fe640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fc006bca0 0x7f3fc006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.091+0000 7f3fd37fe640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fc006bca0 0x7f3fc006e160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40a1ff0 tx=0x7f3fc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.095+0000 7f3fd0ff9640 1 -- 172.21.15.118:0/2900068804 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3fc4054e00 con 0x7f3fd406ce30 2024-02-18T10:01:27.211 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:01:27.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:01:27.217 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:01:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.341+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3fd406faa0 con 0x7f3fd406ce30 2024-02-18T10:01:27.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.343+0000 7f3fd0ff9640 1 -- 172.21.15.118:0/2900068804 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3fc40584c0 con 0x7f3fd406ce30 2024-02-18T10:01:27.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fc006bca0 msgr2=0x7f3fc006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fc006bca0 0x7f3fc006e160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40a1ff0 tx=0x7f3fc8008040 comp rx=0 tx=0).stop 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 msgr2=0x7f3fd41450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd41450f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400c430 tx=0x7f3fc400c8f0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 shutdown_connections 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fc006bca0 0x7f3fc006e160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fd414c900 0x7f3fd41d52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fd414bcd0 0x7f3fd40b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 --2- 172.21.15.118:0/2900068804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fd406ce30 0x7f3fd41450f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 >> 172.21.15.118:0/2900068804 conn(0x7f3fd40bf330 msgr2=0x7f3fd40ba7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 shutdown_connections 2024-02-18T10:01:27.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.345+0000 7f3fdaa2e640 1 -- 172.21.15.118:0/2900068804 wait complete. 2024-02-18T10:01:27.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-02-18T10:01:27.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.458+0000 7febfe8db640 1 Processor -- start 2024-02-18T10:01:27.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.458+0000 7febfe8db640 1 -- start start 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febfe8db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf80b4a60 0x7febf8148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febfe8db640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7febf8149450 0x7febf8071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febfe8db640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf8148a80 con 0x7febf80b5270 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febfe8db640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf81498e0 con 0x7febf8149450 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febfe8db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80bac90 con 0x7febf80b4a60 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febf7fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf80b4a60 0x7febf8148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febfce78640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7febf8149450 0x7febf8071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febf77fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7febf80b5270 0x7febf8071000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:33900/0 (socket says 172.21.15.118:33900) 2024-02-18T10:01:27.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.459+0000 7febf77fe640 1 -- 172.21.15.118:0/794573847 learned_addr learned my addr 172.21.15.118:0/794573847 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:27.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.460+0000 7febfce78640 1 -- 172.21.15.118:0/794573847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf80b4a60 msgr2=0x7febf8148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:27.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.460+0000 7febfce78640 1 --2- 172.21.15.118:0/794573847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf80b4a60 0x7febf8148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.460+0000 7febfce78640 1 -- 172.21.15.118:0/794573847 >> v1:172.21.15.164:6789/0 conn(0x7febf80b5270 legacy=0x7febf8071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.460+0000 7febfce78640 1 -- 172.21.15.118:0/794573847 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80b4e40 con 0x7febf8149450 2024-02-18T10:01:27.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.460+0000 7febfce78640 1 --2- 172.21.15.118:0/794573847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf8149450 0x7febf8071710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febf000bfa0 tx=0x7febf002e0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=807c79eed66299c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.460+0000 7febf6ffd640 1 -- 172.21.15.118:0/794573847 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf002ea40 con 0x7febf8149450 2024-02-18T10:01:27.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febf6ffd640 1 -- 172.21.15.118:0/794573847 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf002eba0 con 0x7febf8149450 2024-02-18T10:01:27.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febf6ffd640 1 -- 172.21.15.118:0/794573847 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0009540 con 0x7febf8149450 2024-02-18T10:01:27.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 -- 172.21.15.118:0/794573847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf8149450 msgr2=0x7febf8071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 --2- 172.21.15.118:0/794573847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf8149450 0x7febf8071710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7febf000bfa0 tx=0x7febf002e0a0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 -- 172.21.15.118:0/794573847 shutdown_connections 2024-02-18T10:01:27.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 --2- 172.21.15.118:0/794573847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf8149450 0x7febf8071710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 --2- 172.21.15.118:0/794573847 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf80b4a60 0x7febf8148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 -- 172.21.15.118:0/794573847 >> 172.21.15.118:0/794573847 conn(0x7febf80bebc0 msgr2=0x7febf806bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:27.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 -- 172.21.15.118:0/794573847 shutdown_connections 2024-02-18T10:01:27.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.461+0000 7febfe8db640 1 -- 172.21.15.118:0/794573847 wait complete. 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.462+0000 7febfe8db640 1 Processor -- start 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.462+0000 7febfe8db640 1 -- start start 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febfe8db640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febf80b4a60 0x7febf8141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febfe8db640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf80b5270 0x7febf80bda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febfe8db640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf8149450 0x7febf80a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febfe8db640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80a2940 con 0x7febf80b4a60 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febfe8db640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf81419b0 con 0x7febf80b5270 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febfe8db640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80bdfc0 con 0x7febf8149450 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febf80b4a60 0x7febf8141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febf80b4a60 0x7febf8141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49046/0 (socket says 172.21.15.118:49046) 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 -- 172.21.15.118:0/2344424064 learned_addr learned my addr 172.21.15.118:0/2344424064 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf77fe640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf80b5270 0x7febf80bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febfce78640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf8149450 0x7febf80a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 -- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf8149450 msgr2=0x7febf80a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf8149450 0x7febf80a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 -- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf80b5270 msgr2=0x7febf80bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf80b5270 0x7febf80bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.463+0000 7febf7fff640 1 -- 172.21.15.118:0/2344424064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf000bc80 con 0x7febf80b4a60 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.464+0000 7febf7fff640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febf80b4a60 0x7febf8141470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9b0 tx=0x7febec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.464+0000 7febf4ff9640 1 -- 172.21.15.118:0/2344424064 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec009670 con 0x7febf80b4a60 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.464+0000 7febf4ff9640 1 -- 172.21.15.118:0/2344424064 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00c9a0 con 0x7febf80b4a60 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.464+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf813d820 con 0x7febf80b4a60 2024-02-18T10:01:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.464+0000 7febf4ff9640 1 -- 172.21.15.118:0/2344424064 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00cd50 con 0x7febf80b4a60 2024-02-18T10:01:27.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.464+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf80bd260 con 0x7febf80b4a60 2024-02-18T10:01:27.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.465+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf80a2bb0 con 0x7febf80b4a60 2024-02-18T10:01:27.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.465+0000 7febf4ff9640 1 -- 172.21.15.118:0/2344424064 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7febec013470 con 0x7febf80b4a60 2024-02-18T10:01:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.466+0000 7febf4ff9640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febe406bc70 0x7febe406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.466+0000 7febf4ff9640 1 -- 172.21.15.118:0/2344424064 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7febec08a530 con 0x7febf80b4a60 2024-02-18T10:01:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.466+0000 7febf77fe640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febe406bc70 0x7febe406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.466+0000 7febf77fe640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febe406bc70 0x7febe406e130 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febf813ffd0 tx=0x7febe8007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.470+0000 7febf4ff9640 1 -- 172.21.15.118:0/2344424064 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febec0551a0 con 0x7febf80b4a60 2024-02-18T10:01:27.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.718+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7febf80a4730 con 0x7febf80b4a60 2024-02-18T10:01:27.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.720+0000 7febf4ff9640 1 -- 172.21.15.118:0/2344424064 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7febec058860 con 0x7febf80b4a60 2024-02-18T10:01:27.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febe406bc70 msgr2=0x7febe406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febe406bc70 0x7febe406e130 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febf813ffd0 tx=0x7febe8007e80 comp rx=0 tx=0).stop 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febf80b4a60 msgr2=0x7febf8141470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febf80b4a60 0x7febf8141470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9b0 tx=0x7febec00ee70 comp rx=0 tx=0).stop 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 shutdown_connections 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febe406bc70 0x7febe406e130 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febf8149450 0x7febf80a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febf80b5270 0x7febf80bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 --2- 172.21.15.118:0/2344424064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febf80b4a60 0x7febf8141470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 >> 172.21.15.118:0/2344424064 conn(0x7febf80bebc0 msgr2=0x7febf806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 shutdown_connections 2024-02-18T10:01:27.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.722+0000 7febfe8db640 1 -- 172.21.15.118:0/2344424064 wait complete. 2024-02-18T10:01:27.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-02-18T10:01:27.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.877+0000 7f10ec7d0640 1 Processor -- start 2024-02-18T10:01:27.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.877+0000 7f10ec7d0640 1 -- start start 2024-02-18T10:01:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ec7d0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10e4142c20 0x7f10e40a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ec7d0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10e41495b0 0x7f10e4148920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ec7d0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ec7d0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e40a31f0 con 0x7f10e41495b0 2024-02-18T10:01:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ec7d0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e40a0350 con 0x7f10e4142c20 2024-02-18T10:01:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ec7d0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40a0630 con 0x7f10e4148e60 2024-02-18T10:01:27.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10e41495b0 0x7f10e4148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10e41495b0 0x7f10e4148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49052/0 (socket says 172.21.15.118:49052) 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 -- 172.21.15.118:0/4089404768 learned_addr learned my addr 172.21.15.118:0/4089404768 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ead6d640 1 --2- 172.21.15.118:0/4089404768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10ea56c640 1 --2- 172.21.15.118:0/4089404768 >> v2:172.21.15.164:3300/0 conn(0x7f10e4142c20 0x7f10e40a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 -- 172.21.15.118:0/4089404768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 msgr2=0x7f10e414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 --2- 172.21.15.118:0/4089404768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 -- 172.21.15.118:0/4089404768 >> v2:172.21.15.164:3300/0 conn(0x7f10e4142c20 msgr2=0x7f10e40a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 --2- 172.21.15.118:0/4089404768 >> v2:172.21.15.164:3300/0 conn(0x7f10e4142c20 0x7f10e40a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.878+0000 7f10e9d6b640 1 -- 172.21.15.118:0/4089404768 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40a1a20 con 0x7f10e41495b0 2024-02-18T10:01:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.879+0000 7f10e9d6b640 1 --2- 172.21.15.118:0/4089404768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e4148920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10e40673d0 tx=0x7f10d402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0479cd619f799de server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.881+0000 7f10e956a640 1 -- 172.21.15.118:0/4089404768 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d402ee90 con 0x7f10e41495b0 2024-02-18T10:01:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.881+0000 7f10e956a640 1 -- 172.21.15.118:0/4089404768 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d4036440 con 0x7f10e41495b0 2024-02-18T10:01:27.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.881+0000 7f10e956a640 1 -- 172.21.15.118:0/4089404768 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40367d0 con 0x7f10e41495b0 2024-02-18T10:01:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 -- 172.21.15.118:0/4089404768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 msgr2=0x7f10e4148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/4089404768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e4148920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10e40673d0 tx=0x7f10d402e0e0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 -- 172.21.15.118:0/4089404768 shutdown_connections 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/4089404768 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/4089404768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e4148920 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/4089404768 >> v2:172.21.15.164:3300/0 conn(0x7f10e4142c20 0x7f10e40a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 -- 172.21.15.118:0/4089404768 >> 172.21.15.118:0/4089404768 conn(0x7f10e40b9c30 msgr2=0x7f10e40ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 -- 172.21.15.118:0/4089404768 shutdown_connections 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.882+0000 7f10ec7d0640 1 -- 172.21.15.118:0/4089404768 wait complete. 2024-02-18T10:01:27.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.883+0000 7f10ec7d0640 1 Processor -- start 2024-02-18T10:01:27.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.883+0000 7f10ec7d0640 1 -- start start 2024-02-18T10:01:27.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ec7d0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e4142c20 0x7f10e40b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ec7d0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e41e10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ec7d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e41dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ec7d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40b6d10 con 0x7f10e41495b0 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ec7d0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4071920 con 0x7f10e4142c20 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ec7d0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4071bc0 con 0x7f10e4148e60 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e41dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e41dafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49058/0 (socket says 172.21.15.118:49058) 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ea56c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e4142c20 0x7f10e40b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 -- 172.21.15.118:0/3815891982 learned_addr learned my addr 172.21.15.118:0/3815891982 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10e9d6b640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e41e10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 -- 172.21.15.118:0/3815891982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 msgr2=0x7f10e41e10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e41e10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 -- 172.21.15.118:0/3815891982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e4142c20 msgr2=0x7f10e40b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e4142c20 0x7f10e40b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 -- 172.21.15.118:0/3815891982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d400b770 con 0x7f10e41495b0 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10ead6d640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e41dafb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f10dc007e40 tx=0x7f10dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.884+0000 7f10daffd640 1 -- 172.21.15.118:0/3815891982 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc014620 con 0x7f10e41495b0 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.885+0000 7f10daffd640 1 -- 172.21.15.118:0/3815891982 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc00ee90 con 0x7f10e41495b0 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.885+0000 7f10daffd640 1 -- 172.21.15.118:0/3815891982 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0149e0 con 0x7f10e41495b0 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.885+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e4071ea0 con 0x7f10e41495b0 2024-02-18T10:01:27.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.885+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e4070fe0 con 0x7f10e41495b0 2024-02-18T10:01:27.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.886+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4071780 con 0x7f10e41495b0 2024-02-18T10:01:27.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.886+0000 7f10daffd640 1 -- 172.21.15.118:0/3815891982 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f10dc014b40 con 0x7f10e41495b0 2024-02-18T10:01:27.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.886+0000 7f10daffd640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10c806bc70 0x7f10c806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:27.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.887+0000 7f10daffd640 1 -- 172.21.15.118:0/3815891982 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10dc08ac10 con 0x7f10e41495b0 2024-02-18T10:01:27.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.887+0000 7f10ea56c640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10c806bc70 0x7f10c806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:27.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.887+0000 7f10ea56c640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10c806bc70 0x7f10c806e130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f10e0006fd0 tx=0x7f10e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:27.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:27.891+0000 7f10daffd640 1 -- 172.21.15.118:0/3815891982 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10e4071780 con 0x7f10e41495b0 2024-02-18T10:01:28.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.136+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f10e4071780 con 0x7f10e41495b0 2024-02-18T10:01:28.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.138+0000 7f10daffd640 1 -- 172.21.15.118:0/3815891982 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f10e4071780 con 0x7f10e41495b0 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10c806bc70 msgr2=0x7f10c806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10c806bc70 0x7f10c806e130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f10e0006fd0 tx=0x7f10e0008040 comp rx=0 tx=0).stop 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 msgr2=0x7f10e41dafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e41dafb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f10dc007e40 tx=0x7f10dc00e4b0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 shutdown_connections 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10c806bc70 0x7f10c806e130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10e41495b0 0x7f10e41dafb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e4148e60 0x7f10e41e10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 --2- 172.21.15.118:0/3815891982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e4142c20 0x7f10e40b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 >> 172.21.15.118:0/3815891982 conn(0x7f10e40b9c30 msgr2=0x7f10e41414a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:28.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 shutdown_connections 2024-02-18T10:01:28.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.140+0000 7f10ec7d0640 1 -- 172.21.15.118:0/3815891982 wait complete. 2024-02-18T10:01:28.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.253+0000 7fc90d41c640 1 Processor -- start 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.253+0000 7fc90d41c640 1 -- start start 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc90d41c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc90806c0d0 0x7fc908157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc90d41c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90806d600 con 0x7fc90806bcf0 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc90d41c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90806ec70 con 0x7fc90814fa00 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc90d41c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc908070080 con 0x7fc90806c0d0 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc9077fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc90806c0d0 0x7fc908157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc9077fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc90806c0d0 0x7fc908157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49072/0 (socket says 172.21.15.118:49072) 2024-02-18T10:01:28.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc9077fe640 1 -- 172.21.15.118:0/3221014432 learned_addr learned my addr 172.21.15.118:0/3221014432 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:28.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc9077fe640 1 -- 172.21.15.118:0/3221014432 >> v1:172.21.15.164:6789/0 conn(0x7fc90814fa00 legacy=0x7fc9081544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:28.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc9067fc640 1 -- 172.21.15.118:0/3221014432 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771447069 0 0) 0x7fc90806d600 con 0x7fc90806bcf0 2024-02-18T10:01:28.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc9077fe640 1 -- 172.21.15.118:0/3221014432 >> v1:172.21.15.118:6789/0 conn(0x7fc90806bcf0 legacy=0x7fc90814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.254+0000 7fc9077fe640 1 -- 172.21.15.118:0/3221014432 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90806ef50 con 0x7fc90806c0d0 2024-02-18T10:01:28.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.255+0000 7fc9077fe640 1 --2- 172.21.15.118:0/3221014432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806c0d0 0x7fc908157bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e50 tx=0x7fc90002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855e01f6282fc774 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.255+0000 7fc9067fc640 1 -- 172.21.15.118:0/3221014432 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90002cbb0 con 0x7fc90806c0d0 2024-02-18T10:01:28.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.255+0000 7fc9067fc640 1 -- 172.21.15.118:0/3221014432 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90002cd10 con 0x7fc90806c0d0 2024-02-18T10:01:28.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.255+0000 7fc9067fc640 1 -- 172.21.15.118:0/3221014432 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900034610 con 0x7fc90806c0d0 2024-02-18T10:01:28.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.256+0000 7fc90d41c640 1 -- 172.21.15.118:0/3221014432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806c0d0 msgr2=0x7fc908157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.256+0000 7fc90d41c640 1 --2- 172.21.15.118:0/3221014432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806c0d0 0x7fc908157bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e50 tx=0x7fc90002c010 comp rx=0 tx=0).stop 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.256+0000 7fc90d41c640 1 -- 172.21.15.118:0/3221014432 shutdown_connections 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.256+0000 7fc90d41c640 1 --2- 172.21.15.118:0/3221014432 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806c0d0 0x7fc908157bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.256+0000 7fc90d41c640 1 -- 172.21.15.118:0/3221014432 >> 172.21.15.118:0/3221014432 conn(0x7fc9080bbea0 msgr2=0x7fc9080bc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.256+0000 7fc90d41c640 1 -- 172.21.15.118:0/3221014432 shutdown_connections 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.256+0000 7fc90d41c640 1 -- 172.21.15.118:0/3221014432 wait complete. 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 Processor -- start 2024-02-18T10:01:28.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 -- start start 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806bcf0 0x7fc90814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc90806c0d0 0x7fc908141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc90814fa00 0x7fc9081e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90814e740 con 0x7fc90806bcf0 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081e0dc0 con 0x7fc90806c0d0 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc90d41c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081e1620 con 0x7fc90814fa00 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc906ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806bcf0 0x7fc90814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc906ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806bcf0 0x7fc90814e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49086/0 (socket says 172.21.15.118:49086) 2024-02-18T10:01:28.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.257+0000 7fc906ffd640 1 -- 172.21.15.118:0/2378848034 learned_addr learned my addr 172.21.15.118:0/2378848034 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc8fffff640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc90806c0d0 0x7fc908141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc9077fe640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc90814fa00 0x7fc9081e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc906ffd640 1 -- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc90814fa00 msgr2=0x7fc9081e42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc906ffd640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc90814fa00 0x7fc9081e42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc906ffd640 1 -- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc90806c0d0 msgr2=0x7fc908141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc906ffd640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc90806c0d0 0x7fc908141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc906ffd640 1 -- 172.21.15.118:0/2378848034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009b30 con 0x7fc90806bcf0 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc8fffff640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc90806c0d0 0x7fc908141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc9077fe640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc90814fa00 0x7fc9081e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc906ffd640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806bcf0 0x7fc90814e200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c3c0 tx=0x7fc8f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc8ff7fe640 1 -- 172.21.15.118:0/2378848034 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80035f0 con 0x7fc90806bcf0 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc8ff7fe640 1 -- 172.21.15.118:0/2378848034 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f8003770 con 0x7fc90806bcf0 2024-02-18T10:01:28.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9081463b0 con 0x7fc90806bcf0 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc8ff7fe640 1 -- 172.21.15.118:0/2378848034 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8003b20 con 0x7fc90806bcf0 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.258+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90814eca0 con 0x7fc90806bcf0 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.259+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc908068130 con 0x7fc90806bcf0 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.259+0000 7fc8ff7fe640 1 -- 172.21.15.118:0/2378848034 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fc8f8003c80 con 0x7fc90806bcf0 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.260+0000 7fc8ff7fe640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc8e806bc70 0x7fc8e806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.260+0000 7fc8ff7fe640 1 -- 172.21.15.118:0/2378848034 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8f80899a0 con 0x7fc90806bcf0 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.260+0000 7fc8fffff640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc8e806bc70 0x7fc8e806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.260+0000 7fc8fffff640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc8e806bc70 0x7fc8e806e130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9081d8040 tx=0x7fc8f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.264+0000 7fc8ff7fe640 1 -- 172.21.15.118:0/2378848034 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8f80544d0 con 0x7fc90806bcf0 2024-02-18T10:01:28.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.508+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc9080676c0 con 0x7fc90806bcf0 2024-02-18T10:01:28.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.510+0000 7fc8ff7fe640 1 -- 172.21.15.118:0/2378848034 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc8f80170a0 con 0x7fc90806bcf0 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc8e806bc70 msgr2=0x7fc8e806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc8e806bc70 0x7fc8e806e130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc9081d8040 tx=0x7fc8f0009040 comp rx=0 tx=0).stop 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806bcf0 msgr2=0x7fc90814e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806bcf0 0x7fc90814e200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c3c0 tx=0x7fc8f800c880 comp rx=0 tx=0).stop 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 shutdown_connections 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc8e806bc70 0x7fc8e806e130 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc90814fa00 0x7fc9081e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc90806c0d0 0x7fc908141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 --2- 172.21.15.118:0/2378848034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc90806bcf0 0x7fc90814e200 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 >> 172.21.15.118:0/2378848034 conn(0x7fc9080bbea0 msgr2=0x7fc90813e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 shutdown_connections 2024-02-18T10:01:28.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.512+0000 7fc90d41c640 1 -- 172.21.15.118:0/2378848034 wait complete. 2024-02-18T10:01:28.525 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:28.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.622+0000 7fe8a5763640 1 Processor -- start 2024-02-18T10:01:28.625 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.623+0000 7fe8a5763640 1 -- start start 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.623+0000 7fe8a5763640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a014bf20 0x7fe8a014c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.623+0000 7fe8a5763640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8a01546d0 0x7fe8a0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.623+0000 7fe8a5763640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00b4aa0 con 0x7fe8a00a6e60 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.623+0000 7fe8a5763640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a006bcd0 con 0x7fe8a01546d0 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.623+0000 7fe8a5763640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00b4cf0 con 0x7fe8a014bf20 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a014bf20 0x7fe8a014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89f7fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe8a01546d0 0x7fe8a0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a014bf20 0x7fe8a014c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:44682/0 (socket says 172.21.15.118:44682) 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89e7fc640 1 -- 172.21.15.118:0/3629638280 learned_addr learned my addr 172.21.15.118:0/3629638280 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89e7fc640 1 -- 172.21.15.118:0/3629638280 >> v2:172.21.15.164:3300/0 conn(0x7fe8a01546d0 msgr2=0x7fe8a0156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89e7fc640 1 --2- 172.21.15.118:0/3629638280 >> v2:172.21.15.164:3300/0 conn(0x7fe8a01546d0 0x7fe8a0156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89e7fc640 1 -- 172.21.15.118:0/3629638280 >> v1:172.21.15.164:6789/0 conn(0x7fe8a00a6e60 legacy=0x7fe8a006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.624+0000 7fe89e7fc640 1 -- 172.21.15.118:0/3629638280 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a014c8a0 con 0x7fe8a014bf20 2024-02-18T10:01:28.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe89e7fc640 1 --2- 172.21.15.118:0/3629638280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a014bf20 0x7fe8a014c360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb4707977ba7388 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe89dffb640 1 -- 172.21.15.118:0/3629638280 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940317c0 con 0x7fe8a014bf20 2024-02-18T10:01:28.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe89dffb640 1 -- 172.21.15.118:0/3629638280 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894031920 con 0x7fe8a014bf20 2024-02-18T10:01:28.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe89dffb640 1 -- 172.21.15.118:0/3629638280 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894031cb0 con 0x7fe8a014bf20 2024-02-18T10:01:28.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 -- 172.21.15.118:0/3629638280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a014bf20 msgr2=0x7fe8a014c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 --2- 172.21.15.118:0/3629638280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a014bf20 0x7fe8a014c360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402b860 comp rx=0 tx=0).stop 2024-02-18T10:01:28.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 -- 172.21.15.118:0/3629638280 shutdown_connections 2024-02-18T10:01:28.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 --2- 172.21.15.118:0/3629638280 >> v2:172.21.15.164:3300/0 conn(0x7fe8a01546d0 0x7fe8a0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 --2- 172.21.15.118:0/3629638280 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a014bf20 0x7fe8a014c360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 -- 172.21.15.118:0/3629638280 >> 172.21.15.118:0/3629638280 conn(0x7fe8a00c15b0 msgr2=0x7fe8a00c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:28.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 -- 172.21.15.118:0/3629638280 shutdown_connections 2024-02-18T10:01:28.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.625+0000 7fe8a5763640 1 -- 172.21.15.118:0/3629638280 wait complete. 2024-02-18T10:01:28.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 Processor -- start 2024-02-18T10:01:28.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 -- start start 2024-02-18T10:01:28.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8a00a6e60 0x7fe8a00b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a014bf20 0x7fe8a014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a01546d0 0x7fe8a00ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00ba800 con 0x7fe8a00a6e60 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a014f0c0 con 0x7fe8a014bf20 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe8a5763640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a014f360 con 0x7fe8a01546d0 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe89effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8a00a6e60 0x7fe8a00b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe89effd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8a00a6e60 0x7fe8a00b86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54960/0 (socket says 172.21.15.118:54960) 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe89e7fc640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a014bf20 0x7fe8a014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe89effd640 1 -- 172.21.15.118:0/4125619046 learned_addr learned my addr 172.21.15.118:0/4125619046 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.627+0000 7fe89f7fe640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a01546d0 0x7fe8a00ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe89effd640 1 -- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a01546d0 msgr2=0x7fe8a00ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe89effd640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a01546d0 0x7fe8a00ba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe89effd640 1 -- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a014bf20 msgr2=0x7fe8a014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe89effd640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a014bf20 0x7fe8a014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe89effd640 1 -- 172.21.15.118:0/4125619046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940094d0 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe89effd640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8a00a6e60 0x7fe8a00b86d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe89000c3c0 tx=0x7fe89000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe8877fe640 1 -- 172.21.15.118:0/4125619046 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900052d0 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe8877fe640 1 -- 172.21.15.118:0/4125619046 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe890005450 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a014f640 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe8877fe640 1 -- 172.21.15.118:0/4125619046 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890007260 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.628+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a00b2f70 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.629+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a014cf50 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.629+0000 7fe8877fe640 1 -- 172.21.15.118:0/4125619046 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe8900073c0 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.630+0000 7fe8877fe640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe88c06bc70 0x7fe88c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.630+0000 7fe89e7fc640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe88c06bc70 0x7fe88c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.630+0000 7fe8877fe640 1 -- 172.21.15.118:0/4125619046 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe890089750 con 0x7fe8a00a6e60 2024-02-18T10:01:28.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.630+0000 7fe89e7fc640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe88c06bc70 0x7fe88c06e130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe894036000 tx=0x7fe89403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.634+0000 7fe8877fe640 1 -- 172.21.15.118:0/4125619046 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8a014cf50 con 0x7fe8a00a6e60 2024-02-18T10:01:28.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.807+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8a014cf50 con 0x7fe8a00a6e60 2024-02-18T10:01:28.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.808+0000 7fe8877fe640 1 -- 172.21.15.118:0/4125619046 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12915 (secure 0 0 0) 0x7fe8a014cf50 con 0x7fe8a00a6e60 2024-02-18T10:01:28.811 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:28.811 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:25.880087+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:28.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe88c06bc70 msgr2=0x7fe88c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe88c06bc70 0x7fe88c06e130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe894036000 tx=0x7fe89403d040 comp rx=0 tx=0).stop 2024-02-18T10:01:28.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8a00a6e60 msgr2=0x7fe8a00b86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8a00a6e60 0x7fe8a00b86d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe89000c3c0 tx=0x7fe89000c880 comp rx=0 tx=0).stop 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 shutdown_connections 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe88c06bc70 0x7fe88c06e130 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8a01546d0 0x7fe8a00ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8a014bf20 0x7fe8a014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 --2- 172.21.15.118:0/4125619046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8a00a6e60 0x7fe8a00b86d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 >> 172.21.15.118:0/4125619046 conn(0x7fe8a00c15b0 msgr2=0x7fe8a00a2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 shutdown_connections 2024-02-18T10:01:28.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.810+0000 7fe8a5763640 1 -- 172.21.15.118:0/4125619046 wait complete. 2024-02-18T10:01:28.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T10:01:28.824 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T10:01:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff9a76640 1 Processor -- start 2024-02-18T10:01:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff9a76640 1 -- start start 2024-02-18T10:01:28.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff9a76640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcff40b5fc0 0x7fcff406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff9a76640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcff40a51e0 0x7fcff414a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff9a76640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff4149ff0 con 0x7fcff406fea0 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff9a76640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff4070280 con 0x7fcff40a51e0 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff9a76640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff40b4a60 con 0x7fcff40b5fc0 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff3fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcff40a51e0 0x7fcff414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff3fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcff40a51e0 0x7fcff414a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54966/0 (socket says 172.21.15.118:54966) 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.924+0000 7fcff3fff640 1 -- 172.21.15.118:0/4023360862 learned_addr learned my addr 172.21.15.118:0/4023360862 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcfeaffd640 1 --2- 172.21.15.118:0/4023360862 >> v2:172.21.15.164:3300/0 conn(0x7fcff40b5fc0 0x7fcff406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff3fff640 1 -- 172.21.15.118:0/4023360862 >> v2:172.21.15.164:3300/0 conn(0x7fcff40b5fc0 msgr2=0x7fcff406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff3fff640 1 --2- 172.21.15.118:0/4023360862 >> v2:172.21.15.164:3300/0 conn(0x7fcff40b5fc0 0x7fcff406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff3fff640 1 -- 172.21.15.118:0/4023360862 >> v1:172.21.15.164:6789/0 conn(0x7fcff406fea0 legacy=0x7fcff40b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:28.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff3fff640 1 -- 172.21.15.118:0/4023360862 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40b6510 con 0x7fcff40a51e0 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff3fff640 1 --2- 172.21.15.118:0/4023360862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff414a480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcff40bb850 tx=0x7fcfec02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e45226000ae0b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff2ffd640 1 -- 172.21.15.118:0/4023360862 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec02c9f0 con 0x7fcff40a51e0 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff2ffd640 1 -- 172.21.15.118:0/4023360862 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec02cb50 con 0x7fcff40a51e0 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.925+0000 7fcff2ffd640 1 -- 172.21.15.118:0/4023360862 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0343f0 con 0x7fcff40a51e0 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 -- 172.21.15.118:0/4023360862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 msgr2=0x7fcff414a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 --2- 172.21.15.118:0/4023360862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff414a480 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcff40bb850 tx=0x7fcfec02be50 comp rx=0 tx=0).stop 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 -- 172.21.15.118:0/4023360862 shutdown_connections 2024-02-18T10:01:28.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 --2- 172.21.15.118:0/4023360862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff414a480 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 --2- 172.21.15.118:0/4023360862 >> v2:172.21.15.164:3300/0 conn(0x7fcff40b5fc0 0x7fcff406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 -- 172.21.15.118:0/4023360862 >> 172.21.15.118:0/4023360862 conn(0x7fcff40bbe30 msgr2=0x7fcff40bc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 -- 172.21.15.118:0/4023360862 shutdown_connections 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.926+0000 7fcff9a76640 1 -- 172.21.15.118:0/4023360862 wait complete. 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.927+0000 7fcff9a76640 1 Processor -- start 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.927+0000 7fcff9a76640 1 -- start start 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff9a76640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcff406fea0 0x7fcff4140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff9a76640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff4141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff9a76640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcff40b5fc0 0x7fcff4145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff9a76640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff41422d0 con 0x7fcff40a51e0 2024-02-18T10:01:28.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff9a76640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff40be8b0 con 0x7fcff406fea0 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff9a76640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff4146480 con 0x7fcff40b5fc0 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff4141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff4141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54970/0 (socket says 172.21.15.118:54970) 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 -- 172.21.15.118:0/224018602 learned_addr learned my addr 172.21.15.118:0/224018602 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff37fe640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcff406fea0 0x7fcff4140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff3fff640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcff40b5fc0 0x7fcff4145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 -- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcff40b5fc0 msgr2=0x7fcff4145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcff40b5fc0 0x7fcff4145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 -- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcff406fea0 msgr2=0x7fcff4140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:28.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcff406fea0 0x7fcff4140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 -- 172.21.15.118:0/224018602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec009b30 con 0x7fcff40a51e0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff3fff640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcff40b5fc0 0x7fcff4145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcfeaffd640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff4141d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00d5f0 tx=0x7fcfdc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.928+0000 7fcff0ff9640 1 -- 172.21.15.118:0/224018602 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0125f0 con 0x7fcff40a51e0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.929+0000 7fcff0ff9640 1 -- 172.21.15.118:0/224018602 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc012750 con 0x7fcff40a51e0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.929+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff4146760 con 0x7fcff40a51e0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.929+0000 7fcff0ff9640 1 -- 172.21.15.118:0/224018602 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc012b00 con 0x7fcff40a51e0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.929+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff4146d20 con 0x7fcff40a51e0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.930+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff4146950 con 0x7fcff40a51e0 2024-02-18T10:01:28.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.930+0000 7fcff0ff9640 1 -- 172.21.15.118:0/224018602 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fcfdc012c60 con 0x7fcff40a51e0 2024-02-18T10:01:28.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.930+0000 7fcff0ff9640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcfd806bc70 0x7fcfd806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:28.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.930+0000 7fcff0ff9640 1 -- 172.21.15.118:0/224018602 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcfdc08a830 con 0x7fcff40a51e0 2024-02-18T10:01:28.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.930+0000 7fcff37fe640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcfd806bc70 0x7fcfd806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:28.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.931+0000 7fcff37fe640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcfd806bc70 0x7fcfd806e130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006fd0 tx=0x7fcfe4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:28.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:28.934+0000 7fcff0ff9640 1 -- 172.21.15.118:0/224018602 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfdc055360 con 0x7fcff40a51e0 2024-02-18T10:01:29.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.107+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcff4075150 con 0x7fcff40a51e0 2024-02-18T10:01:29.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.108+0000 7fcff0ff9640 1 -- 172.21.15.118:0/224018602 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfdc058a20 con 0x7fcff40a51e0 2024-02-18T10:01:29.111 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcfd806bc70 msgr2=0x7fcfd806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcfd806bc70 0x7fcfd806e130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006fd0 tx=0x7fcfe4009060 comp rx=0 tx=0).stop 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 msgr2=0x7fcff4141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff4141d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00d5f0 tx=0x7fcfdc00dab0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 shutdown_connections 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fcfd806bc70 0x7fcfd806e130 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcff40b5fc0 0x7fcff4145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcff40a51e0 0x7fcff4141d90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 --2- 172.21.15.118:0/224018602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcff406fea0 0x7fcff4140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 >> 172.21.15.118:0/224018602 conn(0x7fcff40bbe30 msgr2=0x7fcff40a4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 shutdown_connections 2024-02-18T10:01:29.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.110+0000 7fcff9a76640 1 -- 172.21.15.118:0/224018602 wait complete. 2024-02-18T10:01:29.123 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-18T10:01:29.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.220+0000 7f1241a84640 1 Processor -- start 2024-02-18T10:01:29.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.220+0000 7f1241a84640 1 -- start start 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f1241a84640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f123c153340 0x7f123c155730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f1241a84640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c14a1d0 con 0x7f123c072ed0 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f1241a84640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0b9bb0 con 0x7f123c0bb6c0 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f1241a84640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0732b0 con 0x7f123c153340 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f123bfff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f123c153340 0x7f123c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f123b7fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f123c072ed0 0x7f123c149ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48464/0 (socket says 172.21.15.118:48464) 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f123b7fe640 1 -- 172.21.15.118:0/2950167425 learned_addr learned my addr 172.21.15.118:0/2950167425 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f123bfff640 1 -- 172.21.15.118:0/2950167425 >> v1:172.21.15.164:6789/0 conn(0x7f123c0bb6c0 legacy=0x7f123c0bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f123bfff640 1 -- 172.21.15.118:0/2950167425 >> v1:172.21.15.118:6789/0 conn(0x7f123c072ed0 legacy=0x7f123c149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f123bfff640 1 -- 172.21.15.118:0/2950167425 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0b98a0 con 0x7f123c153340 2024-02-18T10:01:29.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.221+0000 7f123a7fc640 1 -- 172.21.15.118:0/2950167425 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321210483 0 0) 0x7f123c14a1d0 con 0x7f123c072ed0 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.222+0000 7f123bfff640 1 --2- 172.21.15.118:0/2950167425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c155730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1234009dc0 tx=0x7f123402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c21edb9fe795eb server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.222+0000 7f123a7fc640 1 -- 172.21.15.118:0/2950167425 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123402ccd0 con 0x7f123c153340 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.222+0000 7f123a7fc640 1 -- 172.21.15.118:0/2950167425 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123402ce30 con 0x7f123c153340 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.222+0000 7f123a7fc640 1 -- 172.21.15.118:0/2950167425 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234034660 con 0x7f123c153340 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.223+0000 7f1241a84640 1 -- 172.21.15.118:0/2950167425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 msgr2=0x7f123c155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.223+0000 7f1241a84640 1 --2- 172.21.15.118:0/2950167425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c155730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1234009dc0 tx=0x7f123402bf20 comp rx=0 tx=0).stop 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.223+0000 7f1241a84640 1 -- 172.21.15.118:0/2950167425 shutdown_connections 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.223+0000 7f1241a84640 1 --2- 172.21.15.118:0/2950167425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c155730 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.223+0000 7f1241a84640 1 -- 172.21.15.118:0/2950167425 >> 172.21.15.118:0/2950167425 conn(0x7f123c0ba3c0 msgr2=0x7f123c0ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.223+0000 7f1241a84640 1 -- 172.21.15.118:0/2950167425 shutdown_connections 2024-02-18T10:01:29.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.223+0000 7f1241a84640 1 -- 172.21.15.118:0/2950167425 wait complete. 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.224+0000 7f1241a84640 1 Processor -- start 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.224+0000 7f1241a84640 1 -- start start 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.224+0000 7f1241a84640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f123c072ed0 0x7f123c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.224+0000 7f1241a84640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f123c0bb6c0 0x7f123c1dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1241a84640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c1e3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1241a84640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b8830 con 0x7f123c153340 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1241a84640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b6700 con 0x7f123c072ed0 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1241a84640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c09c280 con 0x7f123c0bb6c0 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c1e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c1e3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:54990/0 (socket says 172.21.15.118:54990) 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 -- 172.21.15.118:0/778112131 learned_addr learned my addr 172.21.15.118:0/778112131 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123b7fe640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f123c072ed0 0x7f123c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123affd640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f123c0bb6c0 0x7f123c1dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 -- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f123c0bb6c0 msgr2=0x7f123c1dfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f123c0bb6c0 0x7f123c1dfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 -- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f123c072ed0 msgr2=0x7f123c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f123c072ed0 0x7f123c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 -- 172.21.15.118:0/778112131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234009a70 con 0x7f123c153340 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f123bfff640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c1e3260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f123402bf60 tx=0x7f1234004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1223fff640 1 -- 172.21.15.118:0/778112131 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123403e670 con 0x7f123c153340 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1223fff640 1 -- 172.21.15.118:0/778112131 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123403e7d0 con 0x7f123c153340 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1223fff640 1 -- 172.21.15.118:0/778112131 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123403eb60 con 0x7f123c153340 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c0b57b0 con 0x7f123c153340 2024-02-18T10:01:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.225+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c09b5c0 con 0x7f123c153340 2024-02-18T10:01:29.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.226+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c09c6e0 con 0x7f123c153340 2024-02-18T10:01:29.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.227+0000 7f1223fff640 1 -- 172.21.15.118:0/778112131 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f123403b040 con 0x7f123c153340 2024-02-18T10:01:29.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.227+0000 7f1223fff640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f122806bc70 0x7f122806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.227+0000 7f123b7fe640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f122806bc70 0x7f122806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.227+0000 7f1223fff640 1 -- 172.21.15.118:0/778112131 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f12340ac800 con 0x7f123c153340 2024-02-18T10:01:29.232 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.227+0000 7f123b7fe640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f122806bc70 0x7f122806e130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f122c000f60 tx=0x7f122c007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:29.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.231+0000 7f1223fff640 1 -- 172.21.15.118:0/778112131 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f123c09c6e0 con 0x7f123c153340 2024-02-18T10:01:29.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.404+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f123c09c6e0 con 0x7f123c153340 2024-02-18T10:01:29.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.404+0000 7f1223fff640 1 -- 172.21.15.118:0/778112131 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1234039060 con 0x7f123c153340 2024-02-18T10:01:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:29.407 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-02-18T10:01:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-02-18T10:01:29.407 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-02-18T10:01:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-02-18T10:01:29.408 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-02-18T10:01:29.408 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-02-18T10:01:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f122806bc70 msgr2=0x7f122806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f122806bc70 0x7f122806e130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f122c000f60 tx=0x7f122c007d50 comp rx=0 tx=0).stop 2024-02-18T10:01:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 msgr2=0x7f123c1e3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c1e3260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f123402bf60 tx=0x7f1234004a40 comp rx=0 tx=0).stop 2024-02-18T10:01:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 shutdown_connections 2024-02-18T10:01:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f122806bc70 0x7f122806e130 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f123c153340 0x7f123c1e3260 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f123c0bb6c0 0x7f123c1dfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 --2- 172.21.15.118:0/778112131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f123c072ed0 0x7f123c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 >> 172.21.15.118:0/778112131 conn(0x7f123c0ba3c0 msgr2=0x7f123c0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:29.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 shutdown_connections 2024-02-18T10:01:29.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.406+0000 7f1241a84640 1 -- 172.21.15.118:0/778112131 wait complete. 2024-02-18T10:01:29.419 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-18T10:01:29.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-18T10:01:29.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.520+0000 7f55c8a15640 1 Processor -- start 2024-02-18T10:01:29.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.520+0000 7f55c8a15640 1 -- start start 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c8a15640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f55c414f0d0 0x7f55c4157470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c8a15640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c4146010 con 0x7f55c4145c30 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c8a15640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c4072940 con 0x7f55c40bbb10 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c8a15640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c40bd940 con 0x7f55c414f0d0 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c259c640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f55c4145c30 0x7f55c40b9f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48476/0 (socket says 172.21.15.118:48476) 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c259c640 1 -- 172.21.15.118:0/45758046 learned_addr learned my addr 172.21.15.118:0/45758046 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890604784 0 0) 0x7f55c4146010 con 0x7f55c4145c30 2024-02-18T10:01:29.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55ac003520 con 0x7f55c4145c30 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.521+0000 7f55c2d9d640 1 --2- 172.21.15.118:0/45758046 >> v2:172.21.15.164:3300/0 conn(0x7f55c414f0d0 0x7f55c4157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532334505 0 0) 0x7f55ac003520 con 0x7f55c4145c30 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 >> v2:172.21.15.164:3300/0 conn(0x7f55c414f0d0 msgr2=0x7f55c4157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 --2- 172.21.15.118:0/45758046 >> v2:172.21.15.164:3300/0 conn(0x7f55c414f0d0 0x7f55c4157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 >> v1:172.21.15.164:6789/0 conn(0x7f55c40bbb10 legacy=0x7f55c4072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c40bdc20 con 0x7f55c4145c30 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f55b40019f0 con 0x7f55c4145c30 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 >> v1:172.21.15.118:6789/0 conn(0x7f55c4145c30 legacy=0x7f55c40b9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55ac003970 0x7f55ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac0047c0 0x7f55ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55ac005180 0x7f55ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40bd940 con 0x7f55ac003970 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac00c020 con 0x7f55ac005180 2024-02-18T10:01:29.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac00c1e0 con 0x7f55ac0047c0 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c259c640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55ac003970 0x7f55ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c2d9d640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55ac005180 0x7f55ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c1d9b640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac0047c0 0x7f55ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c259c640 1 -- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac0047c0 msgr2=0x7f55ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c259c640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac0047c0 0x7f55ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c259c640 1 -- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55ac005180 msgr2=0x7f55ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c259c640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55ac005180 0x7f55ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c259c640 1 -- 172.21.15.118:0/45758046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac003520 con 0x7f55ac003970 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c2d9d640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55ac005180 0x7f55ac00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.522+0000 7f55c2d9d640 1 -- 172.21.15.118:0/45758046 reap_dead start 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c259c640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55ac003970 0x7f55ac003d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f55b400a830 tx=0x7f55ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc19120e73c305 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40072d0 con 0x7f55ac003970 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b402f070 con 0x7f55ac003970 2024-02-18T10:01:29.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c159a640 1 -- 172.21.15.118:0/45758046 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40076f0 con 0x7f55ac003970 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c8a15640 1 -- 172.21.15.118:0/45758046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55ac003970 msgr2=0x7f55ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c8a15640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55ac003970 0x7f55ac003d90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f55b400a830 tx=0x7f55ac0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c8a15640 1 -- 172.21.15.118:0/45758046 shutdown_connections 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.523+0000 7f55c8a15640 1 --2- 172.21.15.118:0/45758046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55ac003970 0x7f55ac003d90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.524+0000 7f55c8a15640 1 -- 172.21.15.118:0/45758046 >> 172.21.15.118:0/45758046 conn(0x7f55c40a12c0 msgr2=0x7f55c40a16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.524+0000 7f55c8a15640 1 -- 172.21.15.118:0/45758046 shutdown_connections 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.524+0000 7f55c8a15640 1 -- 172.21.15.118:0/45758046 wait complete. 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 Processor -- start 2024-02-18T10:01:29.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 -- start start 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac003970 0x7f55c409e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c41e48b0 0x7f55c41427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c41e4d10 0x7f55c4142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c409ebc0 con 0x7f55c41e4d10 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40a3360 con 0x7f55c41e48b0 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c8a15640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c414d140 con 0x7f55ac003970 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c2d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c41e4d10 0x7f55c4142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c2d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c41e4d10 0x7f55c4142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55018/0 (socket says 172.21.15.118:55018) 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.525+0000 7f55c2d9d640 1 -- 172.21.15.118:0/4213134915 learned_addr learned my addr 172.21.15.118:0/4213134915 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c1d9b640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c41e48b0 0x7f55c41427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c259c640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac003970 0x7f55c409e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c2d9d640 1 -- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac003970 msgr2=0x7f55c409e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c2d9d640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac003970 0x7f55c409e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c2d9d640 1 -- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c41e48b0 msgr2=0x7f55c41427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c2d9d640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c41e48b0 0x7f55c41427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c2d9d640 1 -- 172.21.15.118:0/4213134915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c414edb0 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c1d9b640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c41e48b0 0x7f55c41427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c259c640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac003970 0x7f55c409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c2d9d640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c41e4d10 0x7f55c4142d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55c4070de0 tx=0x7f55bc011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55b2ffd640 1 -- 172.21.15.118:0/4213134915 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc004440 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55b2ffd640 1 -- 172.21.15.118:0/4213134915 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc003610 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c40a38b0 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55b2ffd640 1 -- 172.21.15.118:0/4213134915 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0039c0 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.526+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c40a26c0 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.527+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c4074af0 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.527+0000 7f55b2ffd640 1 -- 172.21.15.118:0/4213134915 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f55bc003b20 con 0x7f55c41e4d10 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.528+0000 7f55b2ffd640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f55a406bc70 0x7f55a406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:29.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.528+0000 7f55c259c640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f55a406bc70 0x7f55a406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:29.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.528+0000 7f55b2ffd640 1 -- 172.21.15.118:0/4213134915 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55bc08a540 con 0x7f55c41e4d10 2024-02-18T10:01:29.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.528+0000 7f55c259c640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f55a406bc70 0x7f55a406e130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55b4034000 tx=0x7f55b4007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:29.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.532+0000 7f55b2ffd640 1 -- 172.21.15.118:0/4213134915 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f55bc055070 con 0x7f55c41e4d10 2024-02-18T10:01:29.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.704+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f55c40bd720 con 0x7f55c41e4d10 2024-02-18T10:01:29.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.980+0000 7f55b2ffd640 1 -- 172.21.15.118:0/4213134915 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f55bc058730 con 0x7f55c41e4d10 2024-02-18T10:01:29.982 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-02-18T10:01:29.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f55a406bc70 msgr2=0x7f55a406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f55a406bc70 0x7f55a406e130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55b4034000 tx=0x7f55b4007000 comp rx=0 tx=0).stop 2024-02-18T10:01:29.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c41e4d10 msgr2=0x7f55c4142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:29.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c41e4d10 0x7f55c4142d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55c4070de0 tx=0x7f55bc011920 comp rx=0 tx=0).stop 2024-02-18T10:01:29.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 shutdown_connections 2024-02-18T10:01:29.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f55a406bc70 0x7f55a406e130 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c41e4d10 0x7f55c4142d30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c41e48b0 0x7f55c41427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 --2- 172.21.15.118:0/4213134915 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f55ac003970 0x7f55c409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 >> 172.21.15.118:0/4213134915 conn(0x7f55c40a12c0 msgr2=0x7f55c4144c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 shutdown_connections 2024-02-18T10:01:29.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:29.982+0000 7f55c8a15640 1 -- 172.21.15.118:0/4213134915 wait complete. 2024-02-18T10:01:29.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-18T10:01:30.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4da572640 1 Processor -- start 2024-02-18T10:01:30.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4da572640 1 -- start start 2024-02-18T10:01:30.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4da572640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc4d40b8e10 0x7fc4d4142870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4da572640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d4149730 con 0x7fc4d40723c0 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4da572640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d4071320 con 0x7fc4d4142db0 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4da572640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d4148e00 con 0x7fc4d40b8e10 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4d8b0f640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc4d40723c0 0x7fc4d4153120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48488/0 (socket says 172.21.15.118:48488) 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.104+0000 7fc4d8b0f640 1 -- 172.21.15.118:0/492231873 learned_addr learned my addr 172.21.15.118:0/492231873 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582408494 0 0) 0x7fc4d4149730 con 0x7fc4d40723c0 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4bc003520 con 0x7fc4d40723c0 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136590931 0 0) 0x7fc4bc003520 con 0x7fc4d40723c0 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 >> v2:172.21.15.164:3300/0 conn(0x7fc4d40b8e10 msgr2=0x7fc4d4142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 --2- 172.21.15.118:0/492231873 >> v2:172.21.15.164:3300/0 conn(0x7fc4d40b8e10 0x7fc4d4142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 >> v1:172.21.15.164:6789/0 conn(0x7fc4d4142db0 legacy=0x7fc4d4071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d41490e0 con 0x7fc4d40723c0 2024-02-18T10:01:30.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fc4cc0019f0 con 0x7fc4d40723c0 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 >> v1:172.21.15.118:6789/0 conn(0x7fc4d40723c0 legacy=0x7fc4d4153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc003970 0x7fc4bc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4bc0047c0 0x7fc4bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc005380 0x7fc4bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4148e00 con 0x7fc4bc005380 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc00c220 con 0x7fc4bc003970 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc00c3e0 con 0x7fc4bc0047c0 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d8b0f640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc005380 0x7fc4bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d3fff640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc003970 0x7fc4bc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d37fe640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4bc0047c0 0x7fc4bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d8b0f640 1 -- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4bc0047c0 msgr2=0x7fc4bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d8b0f640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4bc0047c0 0x7fc4bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d8b0f640 1 -- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc003970 msgr2=0x7fc4bc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:30.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d8b0f640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc003970 0x7fc4bc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.105+0000 7fc4d8b0f640 1 -- 172.21.15.118:0/492231873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc003520 con 0x7fc4bc005380 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.106+0000 7fc4d8b0f640 1 -- 172.21.15.118:0/492231873 reap_dead start 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.106+0000 7fc4d8b0f640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc005380 0x7fc4bc00b980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00a840 tx=0x7fc4bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da424bff0412f25 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.106+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc02cea0 con 0x7fc4bc005380 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.106+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc02f070 con 0x7fc4bc005380 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.106+0000 7fc4d2ffd640 1 -- 172.21.15.118:0/492231873 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0348b0 con 0x7fc4bc005380 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.107+0000 7fc4da572640 1 -- 172.21.15.118:0/492231873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc005380 msgr2=0x7fc4bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.107+0000 7fc4da572640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc005380 0x7fc4bc00b980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00a840 tx=0x7fc4bc0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.107+0000 7fc4da572640 1 -- 172.21.15.118:0/492231873 shutdown_connections 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.107+0000 7fc4da572640 1 --2- 172.21.15.118:0/492231873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4bc005380 0x7fc4bc00b980 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.107+0000 7fc4da572640 1 -- 172.21.15.118:0/492231873 >> 172.21.15.118:0/492231873 conn(0x7fc4d40ba410 msgr2=0x7fc4d406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.107+0000 7fc4da572640 1 -- 172.21.15.118:0/492231873 shutdown_connections 2024-02-18T10:01:30.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.107+0000 7fc4da572640 1 -- 172.21.15.118:0/492231873 wait complete. 2024-02-18T10:01:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 Processor -- start 2024-02-18T10:01:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 -- start start 2024-02-18T10:01:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc005380 0x7fc4d4147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4d4144e50 0x7fc4d41452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4d4132350 0x7fc4d41327b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4147ed0 con 0x7fc4d4144e50 2024-02-18T10:01:30.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d41423a0 con 0x7fc4bc005380 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.108+0000 7fc4da572640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4141990 con 0x7fc4d4132350 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4d4144e50 0x7fc4d41452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4d4144e50 0x7fc4d41452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55038/0 (socket says 172.21.15.118:55038) 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 -- 172.21.15.118:0/3461014552 learned_addr learned my addr 172.21.15.118:0/3461014552 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d3fff640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc005380 0x7fc4d4147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d8b0f640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4d4132350 0x7fc4d41327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 -- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4d4132350 msgr2=0x7fc4d41327b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4d4132350 0x7fc4d41327b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 -- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc005380 msgr2=0x7fc4d4147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc005380 0x7fc4d4147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 -- 172.21.15.118:0/3461014552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d4148140 con 0x7fc4d4144e50 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d8b0f640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4d4132350 0x7fc4d41327b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d37fe640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4d4144e50 0x7fc4d41452b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800e4c0 tx=0x7fc4c800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:30.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d0ff9640 1 -- 172.21.15.118:0/3461014552 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80052e0 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d0ff9640 1 -- 172.21.15.118:0/3461014552 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8005440 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4d0ff9640 1 -- 172.21.15.118:0/3461014552 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8003830 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d4141c30 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.109+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d41406c0 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.110+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d41417f0 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.110+0000 7fc4d0ff9640 1 -- 172.21.15.118:0/3461014552 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fc4c8003990 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.111+0000 7fc4d0ff9640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc4c006bca0 0x7fc4c006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.111+0000 7fc4d0ff9640 1 -- 172.21.15.118:0/3461014552 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc4c808a0f0 con 0x7fc4d4144e50 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.111+0000 7fc4d3fff640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc4c006bca0 0x7fc4c006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:30.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.111+0000 7fc4d3fff640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc4c006bca0 0x7fc4c006e160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4006fd0 tx=0x7fc4c4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:30.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.115+0000 7fc4d0ff9640 1 -- 172.21.15.118:0/3461014552 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc4d41417f0 con 0x7fc4d4144e50 2024-02-18T10:01:30.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.287+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc4d41417f0 con 0x7fc4d4144e50 2024-02-18T10:01:30.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.982+0000 7fc4d0ff9640 1 -- 172.21.15.118:0/3461014552 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc4d41417f0 con 0x7fc4d4144e50 2024-02-18T10:01:30.984 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-02-18T10:01:30.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc4c006bca0 msgr2=0x7fc4c006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:30.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc4c006bca0 0x7fc4c006e160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4006fd0 tx=0x7fc4c4009060 comp rx=0 tx=0).stop 2024-02-18T10:01:30.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4d4144e50 msgr2=0x7fc4d41452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4d4144e50 0x7fc4d41452b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800e4c0 tx=0x7fc4c800e980 comp rx=0 tx=0).stop 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 shutdown_connections 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc4c006bca0 0x7fc4c006e160 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc4d4132350 0x7fc4d41327b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4d4144e50 0x7fc4d41452b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.984+0000 7fc4da572640 1 --2- 172.21.15.118:0/3461014552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc4bc005380 0x7fc4d4147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.985+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 >> 172.21.15.118:0/3461014552 conn(0x7fc4d40ba410 msgr2=0x7fc4d413d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.985+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 shutdown_connections 2024-02-18T10:01:30.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:30.985+0000 7fc4da572640 1 -- 172.21.15.118:0/3461014552 wait complete. 2024-02-18T10:01:31.011 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-18T10:01:31.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.113+0000 7f0cb64d4640 1 Processor -- start 2024-02-18T10:01:31.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.113+0000 7f0cb64d4640 1 -- start start 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb64d4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0cb014cf80 0x7f0cb0155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb64d4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb00bfd10 con 0x7f0cb0143e10 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb64d4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb014d460 con 0x7f0cb006f930 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb64d4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb014d740 con 0x7f0cb014cf80 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb4a71640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0cb014cf80 0x7f0cb0155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb4a71640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0cb014cf80 0x7f0cb0155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55044/0 (socket says 172.21.15.118:55044) 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb4a71640 1 -- 172.21.15.118:0/291982038 learned_addr learned my addr 172.21.15.118:0/291982038 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0caffff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0cb0143e10 0x7f0cb00bf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48498/0 (socket says 172.21.15.118:48498) 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb4a71640 1 -- 172.21.15.118:0/291982038 >> v1:172.21.15.164:6789/0 conn(0x7f0cb006f930 legacy=0x7f0cb0149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb4a71640 1 -- 172.21.15.118:0/291982038 >> v1:172.21.15.118:6789/0 conn(0x7f0cb0143e10 legacy=0x7f0cb00bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:31.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0cb4a71640 1 -- 172.21.15.118:0/291982038 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb014da20 con 0x7f0cb014cf80 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.114+0000 7f0caeffd640 1 -- 172.21.15.118:0/291982038 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631832299 0 0) 0x7f0cb00bfd10 con 0x7f0cb0143e10 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.115+0000 7f0cb4a71640 1 --2- 172.21.15.118:0/291982038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb014cf80 0x7f0cb0155320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009e50 tx=0x7f0ca802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61156d3c871934d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.115+0000 7f0caeffd640 1 -- 172.21.15.118:0/291982038 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca802cbb0 con 0x7f0cb014cf80 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.115+0000 7f0caeffd640 1 -- 172.21.15.118:0/291982038 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca802cd10 con 0x7f0cb014cf80 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.115+0000 7f0caeffd640 1 -- 172.21.15.118:0/291982038 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8034610 con 0x7f0cb014cf80 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.116+0000 7f0cb64d4640 1 -- 172.21.15.118:0/291982038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb014cf80 msgr2=0x7f0cb0155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.116+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/291982038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb014cf80 0x7f0cb0155320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009e50 tx=0x7f0ca802c010 comp rx=0 tx=0).stop 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.116+0000 7f0cb64d4640 1 -- 172.21.15.118:0/291982038 shutdown_connections 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.116+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/291982038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb014cf80 0x7f0cb0155320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.116+0000 7f0cb64d4640 1 -- 172.21.15.118:0/291982038 >> 172.21.15.118:0/291982038 conn(0x7f0cb006adc0 msgr2=0x7f0cb006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.116+0000 7f0cb64d4640 1 -- 172.21.15.118:0/291982038 shutdown_connections 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.116+0000 7f0cb64d4640 1 -- 172.21.15.118:0/291982038 wait complete. 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.117+0000 7f0cb64d4640 1 Processor -- start 2024-02-18T10:01:31.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.117+0000 7f0cb64d4640 1 -- start start 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb0143e10 0x7f0cb00b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cb014cf80 0x7f0cb00b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cb00b5450 0x7f0cb0144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00b8dd0 con 0x7f0cb0143e10 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00b87f0 con 0x7f0cb014cf80 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00b58c0 con 0x7f0cb00b5450 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb0143e10 0x7f0cb00b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb0143e10 0x7f0cb00b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55046/0 (socket says 172.21.15.118:55046) 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 -- 172.21.15.118:0/2453601256 learned_addr learned my addr 172.21.15.118:0/2453601256 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caf7fe640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cb014cf80 0x7f0cb00b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb4a71640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cb00b5450 0x7f0cb0144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 -- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cb00b5450 msgr2=0x7f0cb0144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cb00b5450 0x7f0cb0144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 -- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cb014cf80 msgr2=0x7f0cb00b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:31.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cb014cf80 0x7f0cb00b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 -- 172.21.15.118:0/2453601256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009b30 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0caffff640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb0143e10 0x7f0cb00b9260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c500 tx=0x7f0ca000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cacff9640 1 -- 172.21.15.118:0/2453601256 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0007560 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cacff9640 1 -- 172.21.15.118:0/2453601256 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca00047e0 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb014a610 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cacff9640 1 -- 172.21.15.118:0/2453601256 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0004b90 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.118+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb0147100 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.119+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb0075150 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.120+0000 7f0cacff9640 1 -- 172.21.15.118:0/2453601256 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f0ca0004cf0 con 0x7f0cb0143e10 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.120+0000 7f0cacff9640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0c9c06bc70 0x7f0c9c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.121+0000 7f0caf7fe640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0c9c06bc70 0x7f0c9c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:31.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.121+0000 7f0cacff9640 1 -- 172.21.15.118:0/2453601256 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0ca0089b00 con 0x7f0cb0143e10 2024-02-18T10:01:31.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.121+0000 7f0caf7fe640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0c9c06bc70 0x7f0c9c06e130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00b8270 tx=0x7f0ca4007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:31.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.125+0000 7f0cacff9640 1 -- 172.21.15.118:0/2453601256 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ca0054480 con 0x7f0cb0143e10 2024-02-18T10:01:31.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.337+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0cb0074af0 con 0x7f0cb0143e10 2024-02-18T10:01:31.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.992+0000 7f0cacff9640 1 -- 172.21.15.118:0/2453601256 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0ca0057b40 con 0x7f0cb0143e10 2024-02-18T10:01:31.995 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 4 and data pool 5 2024-02-18T10:01:31.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0c9c06bc70 msgr2=0x7f0c9c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0c9c06bc70 0x7f0c9c06e130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00b8270 tx=0x7f0ca4007e30 comp rx=0 tx=0).stop 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb0143e10 msgr2=0x7f0cb00b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb0143e10 0x7f0cb00b9260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c500 tx=0x7f0ca000c9c0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 shutdown_connections 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0c9c06bc70 0x7f0c9c06e130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0cb00b5450 0x7f0cb0144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0cb014cf80 0x7f0cb00b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 --2- 172.21.15.118:0/2453601256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cb0143e10 0x7f0cb00b9260 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c500 tx=0x7f0ca000c9c0 comp rx=0 tx=0).stop 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 >> 172.21.15.118:0/2453601256 conn(0x7f0cb006adc0 msgr2=0x7f0cb00baa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 shutdown_connections 2024-02-18T10:01:31.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:31.995+0000 7f0cb64d4640 1 -- 172.21.15.118:0/2453601256 wait complete. 2024-02-18T10:01:32.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:32.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.123+0000 7fed0705c640 1 Processor -- start 2024-02-18T10:01:32.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.123+0000 7fed0705c640 1 -- start start 2024-02-18T10:01:32.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed0705c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000b3180 0x7fed000b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed0705c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed000bc880 0x7fed000bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed0705c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed000b8a40 con 0x7fed000bb6c0 2024-02-18T10:01:32.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed0705c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed00066f90 con 0x7fed000bc880 2024-02-18T10:01:32.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed0705c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0006bcf0 con 0x7fed000b3180 2024-02-18T10:01:32.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fecfffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed000bc880 0x7fed000bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed055f9640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fed000bb6c0 0x7fed000bbb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48504/0 (socket says 172.21.15.118:48504) 2024-02-18T10:01:32.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed055f9640 1 -- 172.21.15.118:0/3249695320 learned_addr learned my addr 172.21.15.118:0/3249695320 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:32.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fed04df8640 1 --2- 172.21.15.118:0/3249695320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000b3180 0x7fed000b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fecfffff640 1 -- 172.21.15.118:0/3249695320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000b3180 msgr2=0x7fed000b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:32.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fecfffff640 1 --2- 172.21.15.118:0/3249695320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000b3180 0x7fed000b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fecfffff640 1 -- 172.21.15.118:0/3249695320 >> v1:172.21.15.118:6789/0 conn(0x7fed000bb6c0 legacy=0x7fed000bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fecfffff640 1 -- 172.21.15.118:0/3249695320 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00066960 con 0x7fed000bc880 2024-02-18T10:01:32.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.124+0000 7fecff7fe640 1 -- 172.21.15.118:0/3249695320 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411136732 0 0) 0x7fed000b8a40 con 0x7fed000bb6c0 2024-02-18T10:01:32.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fecfffff640 1 --2- 172.21.15.118:0/3249695320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000bcce0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fecec0097a0 tx=0x7fecec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dd13169eacc080 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fecff7fe640 1 -- 172.21.15.118:0/3249695320 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec031830 con 0x7fed000bc880 2024-02-18T10:01:32.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fecff7fe640 1 -- 172.21.15.118:0/3249695320 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec031990 con 0x7fed000bc880 2024-02-18T10:01:32.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fecff7fe640 1 -- 172.21.15.118:0/3249695320 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec031d20 con 0x7fed000bc880 2024-02-18T10:01:32.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fed0705c640 1 -- 172.21.15.118:0/3249695320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 msgr2=0x7fed000bcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fed0705c640 1 --2- 172.21.15.118:0/3249695320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000bcce0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fecec0097a0 tx=0x7fecec02b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fed0705c640 1 -- 172.21.15.118:0/3249695320 shutdown_connections 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fed0705c640 1 --2- 172.21.15.118:0/3249695320 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000bcce0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fed0705c640 1 --2- 172.21.15.118:0/3249695320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000b3180 0x7fed000b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.125+0000 7fed0705c640 1 -- 172.21.15.118:0/3249695320 >> 172.21.15.118:0/3249695320 conn(0x7fed000ba3c0 msgr2=0x7fed000ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.126+0000 7fed0705c640 1 -- 172.21.15.118:0/3249695320 shutdown_connections 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.126+0000 7fed0705c640 1 -- 172.21.15.118:0/3249695320 wait complete. 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.126+0000 7fed0705c640 1 Processor -- start 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed0705c640 1 -- start start 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed0705c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed000b3180 0x7fed001449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed0705c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000bb6c0 0x7fed00142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed0705c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed0705c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00143480 con 0x7fed000bc880 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed0705c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed001472e0 con 0x7fed000b3180 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed0705c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed00147530 con 0x7fed000bb6c0 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed055f9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed055f9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000b6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55062/0 (socket says 172.21.15.118:55062) 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.127+0000 7fed055f9640 1 -- 172.21.15.118:0/2131663269 learned_addr learned my addr 172.21.15.118:0/2131663269 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed04df8640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed000b3180 0x7fed001449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fecfffff640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000bb6c0 0x7fed00142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed055f9640 1 -- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000bb6c0 msgr2=0x7fed00142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed055f9640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000bb6c0 0x7fed00142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed055f9640 1 -- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed000b3180 msgr2=0x7fed001449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed055f9640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed000b3180 0x7fed001449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed055f9640 1 -- 172.21.15.118:0/2131663269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009400 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed04df8640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed000b3180 0x7fed001449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed055f9640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000b6e80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c7a0 tx=0x7fecf800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fecfd7fa640 1 -- 172.21.15.118:0/2131663269 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf800a640 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fecfd7fa640 1 -- 172.21.15.118:0/2131663269 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf800a7a0 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed000b7800 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fecfd7fa640 1 -- 172.21.15.118:0/2131663269 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf800abd0 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.128+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed000b6300 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.129+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed00067170 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.129+0000 7fecfd7fa640 1 -- 172.21.15.118:0/2131663269 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fecf800ad30 con 0x7fed000bc880 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.130+0000 7fecfd7fa640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fece406bc70 0x7fece406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.130+0000 7fed04df8640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fece406bc70 0x7fece406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.130+0000 7fecfd7fa640 1 -- 172.21.15.118:0/2131663269 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecf8089fa0 con 0x7fed000bc880 2024-02-18T10:01:32.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.130+0000 7fed04df8640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fece406bc70 0x7fece406e130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006fd0 tx=0x7fecf4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.134+0000 7fecfd7fa640 1 -- 172.21.15.118:0/2131663269 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fecf80bd8c0 con 0x7fed000bc880 2024-02-18T10:01:32.311 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.309+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed001435c0 con 0x7fed000bc880 2024-02-18T10:01:32.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.310+0000 7fecfd7fa640 1 -- 172.21.15.118:0/2131663269 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16706 (secure 0 0 0) 0x7fecf8018020 con 0x7fed000bc880 2024-02-18T10:01:32.313 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:32.313 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":30,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:31.339326+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:01:29.722354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-18T10:01:30.305941+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fece406bc70 msgr2=0x7fece406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fece406bc70 0x7fece406e130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006fd0 tx=0x7fecf4008040 comp rx=0 tx=0).stop 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 msgr2=0x7fed000b6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000b6e80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c7a0 tx=0x7fecf800cc60 comp rx=0 tx=0).stop 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 shutdown_connections 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fece406bc70 0x7fece406e130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed000bc880 0x7fed000b6e80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed000bb6c0 0x7fed00142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 --2- 172.21.15.118:0/2131663269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed000b3180 0x7fed001449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 >> 172.21.15.118:0/2131663269 conn(0x7fed000ba3c0 msgr2=0x7fed0009e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:32.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 shutdown_connections 2024-02-18T10:01:32.316 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.312+0000 7fed0705c640 1 -- 172.21.15.118:0/2131663269 wait complete. 2024-02-18T10:01:32.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:32.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.422+0000 7fb790393640 1 Processor -- start 2024-02-18T10:01:32.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.422+0000 7fb790393640 1 -- start start 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.423+0000 7fb790393640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb788070f70 0x7fb788157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.423+0000 7fb790393640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880ba190 con 0x7fb788145f30 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.423+0000 7fb790393640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880babe0 con 0x7fb788072c50 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.423+0000 7fb790393640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb788146310 con 0x7fb788070f70 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.423+0000 7fb78e12f640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb788145f30 0x7fb78806abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48520/0 (socket says 172.21.15.118:48520) 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.423+0000 7fb78e12f640 1 -- 172.21.15.118:0/1317858051 learned_addr learned my addr 172.21.15.118:0/1317858051 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78e930640 1 --2- 172.21.15.118:0/1317858051 >> v2:172.21.15.164:3300/0 conn(0x7fb788070f70 0x7fb788157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492159539 0 0) 0x7fb7880ba190 con 0x7fb788145f30 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb774003520 con 0x7fb788145f30 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911115148 0 0) 0x7fb774003520 con 0x7fb788145f30 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 >> v2:172.21.15.164:3300/0 conn(0x7fb788070f70 msgr2=0x7fb788157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:32.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 --2- 172.21.15.118:0/1317858051 >> v2:172.21.15.164:3300/0 conn(0x7fb788070f70 0x7fb788157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 >> v1:172.21.15.164:6789/0 conn(0x7fb788072c50 legacy=0x7fb78814bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78806b2f0 con 0x7fb788145f30 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fb7800019f0 con 0x7fb788145f30 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 >> v1:172.21.15.118:6789/0 conn(0x7fb788145f30 legacy=0x7fb78806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb774003970 0x7fb774003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb774004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb774005040 0x7fb77400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb788146310 con 0x7fb774004370 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77400bfa0 con 0x7fb774003970 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77400c160 con 0x7fb774005040 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d92e640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb774004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78e12f640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb774003970 0x7fb774003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78e930640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb774005040 0x7fb77400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d92e640 1 -- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb774005040 msgr2=0x7fb77400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d92e640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb774005040 0x7fb77400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d92e640 1 -- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb774003970 msgr2=0x7fb774003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d92e640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb774003970 0x7fb774003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78d92e640 1 -- 172.21.15.118:0/1317858051 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774003520 con 0x7fb774004370 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.424+0000 7fb78e930640 1 -- 172.21.15.118:0/1317858051 reap_dead start 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.425+0000 7fb78d92e640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb774004840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb778001860 tx=0x7fb7740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232ae4199d1fa33e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.425+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77802f050 con 0x7fb774004370 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.425+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb778033610 con 0x7fb774004370 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.425+0000 7fb78d12d640 1 -- 172.21.15.118:0/1317858051 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780339c0 con 0x7fb774004370 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.426+0000 7fb790393640 1 -- 172.21.15.118:0/1317858051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 msgr2=0x7fb774004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.426+0000 7fb790393640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb774004840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb778001860 tx=0x7fb7740057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.426+0000 7fb790393640 1 -- 172.21.15.118:0/1317858051 shutdown_connections 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.426+0000 7fb790393640 1 --2- 172.21.15.118:0/1317858051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb774004840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.426+0000 7fb790393640 1 -- 172.21.15.118:0/1317858051 >> 172.21.15.118:0/1317858051 conn(0x7fb78806bcf0 msgr2=0x7fb78806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.426+0000 7fb790393640 1 -- 172.21.15.118:0/1317858051 shutdown_connections 2024-02-18T10:01:32.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.426+0000 7fb790393640 1 -- 172.21.15.118:0/1317858051 wait complete. 2024-02-18T10:01:32.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 Processor -- start 2024-02-18T10:01:32.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 -- start start 2024-02-18T10:01:32.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb7880a2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7880a0430 0x7fb7880a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7881e4490 0x7fb7881e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880a1bc0 con 0x7fb774004370 2024-02-18T10:01:32.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880a3620 con 0x7fb7880a0430 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb790393640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880a3260 con 0x7fb7881e4490 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb78e12f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb7880a2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.427+0000 7fb78e12f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb7880a2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55070/0 (socket says 172.21.15.118:55070) 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e12f640 1 -- 172.21.15.118:0/1930789020 learned_addr learned my addr 172.21.15.118:0/1930789020 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78d92e640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7880a0430 0x7fb7880a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e930640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7881e4490 0x7fb7881e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e12f640 1 -- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7881e4490 msgr2=0x7fb7881e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e12f640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7881e4490 0x7fb7881e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e12f640 1 -- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7880a0430 msgr2=0x7fb7880a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e12f640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7880a0430 0x7fb7880a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e12f640 1 -- 172.21.15.118:0/1930789020 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7881e4e50 con 0x7fb774004370 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e930640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7881e4490 0x7fb7881e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb78e12f640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb7880a2940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb7800079d0 tx=0x7fb78000a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb77effd640 1 -- 172.21.15.118:0/1930789020 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780001990 con 0x7fb774004370 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb77effd640 1 -- 172.21.15.118:0/1930789020 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7800133f0 con 0x7fb774004370 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78814f9d0 con 0x7fb774004370 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb77effd640 1 -- 172.21.15.118:0/1930789020 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800137a0 con 0x7fb774004370 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.428+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880a2060 con 0x7fb774004370 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.429+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb788074af0 con 0x7fb774004370 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.429+0000 7fb77effd640 1 -- 172.21.15.118:0/1930789020 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fb780013900 con 0x7fb774004370 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.430+0000 7fb77effd640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb76c06bca0 0x7fb76c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.430+0000 7fb78d92e640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb76c06bca0 0x7fb76c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.430+0000 7fb77effd640 1 -- 172.21.15.118:0/1930789020 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb78008afd0 con 0x7fb774004370 2024-02-18T10:01:32.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.430+0000 7fb78d92e640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb76c06bca0 0x7fb76c06e160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb778036000 tx=0x7fb778031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.434+0000 7fb77effd640 1 -- 172.21.15.118:0/1930789020 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb780055840 con 0x7fb774004370 2024-02-18T10:01:32.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.606+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb78806eb70 con 0x7fb774004370 2024-02-18T10:01:32.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.607+0000 7fb77effd640 1 -- 172.21.15.118:0/1930789020 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16706 (secure 0 0 0) 0x7fb780058f00 con 0x7fb774004370 2024-02-18T10:01:32.610 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:32.610 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":30,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:31.339326+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:01:29.722354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-18T10:01:30.305941+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb76c06bca0 msgr2=0x7fb76c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb76c06bca0 0x7fb76c06e160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb778036000 tx=0x7fb778031000 comp rx=0 tx=0).stop 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 msgr2=0x7fb7880a2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb7880a2940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb7800079d0 tx=0x7fb78000a6f0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 shutdown_connections 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fb76c06bca0 0x7fb76c06e160 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb7881e4490 0x7fb7881e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb7880a0430 0x7fb7880a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 --2- 172.21.15.118:0/1930789020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb774004370 0x7fb7880a2940 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 >> 172.21.15.118:0/1930789020 conn(0x7fb78806bcf0 msgr2=0x7fb788143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:32.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 shutdown_connections 2024-02-18T10:01:32.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.609+0000 7fb790393640 1 -- 172.21.15.118:0/1930789020 wait complete. 2024-02-18T10:01:32.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-18T10:01:32.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.722+0000 7f0b74ace640 1 Processor -- start 2024-02-18T10:01:32.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.722+0000 7f0b74ace640 1 -- start start 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b74ace640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b70149440 0x7f0b7006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b74ace640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0b700bb600 0x7f0b700ba500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b74ace640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7006c450 con 0x7f0b700bf550 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b74ace640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b700bbb90 con 0x7f0b700bb600 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b74ace640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70149820 con 0x7f0b70149440 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6e59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b70149440 0x7f0b7006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6dd9b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0b700bb600 0x7f0b700ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6e59c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b70149440 0x7f0b7006d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:44832/0 (socket says 172.21.15.118:44832) 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6e59c640 1 -- 172.21.15.118:0/2341365861 learned_addr learned my addr 172.21.15.118:0/2341365861 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:32.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6e59c640 1 -- 172.21.15.118:0/2341365861 >> v2:172.21.15.164:3300/0 conn(0x7f0b700bb600 msgr2=0x7f0b700ba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:32.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6e59c640 1 --2- 172.21.15.118:0/2341365861 >> v2:172.21.15.164:3300/0 conn(0x7f0b700bb600 0x7f0b700ba500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6e59c640 1 -- 172.21.15.118:0/2341365861 >> v1:172.21.15.164:6789/0 conn(0x7f0b700bf550 legacy=0x7f0b7006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6d59a640 1 -- 172.21.15.118:0/2341365861 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613563807 0 0) 0x7f0b7006c450 con 0x7f0b700bf550 2024-02-18T10:01:32.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.723+0000 7f0b6e59c640 1 -- 172.21.15.118:0/2341365861 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7006be90 con 0x7f0b70149440 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.724+0000 7f0b6e59c640 1 --2- 172.21.15.118:0/2341365861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b70149440 0x7f0b7006d8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009870 tx=0x7f0b6802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc75de384acbf456 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.724+0000 7f0b6d59a640 1 -- 172.21.15.118:0/2341365861 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68030840 con 0x7f0b70149440 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.724+0000 7f0b6d59a640 1 -- 172.21.15.118:0/2341365861 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b680309a0 con 0x7f0b70149440 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.724+0000 7f0b6d59a640 1 -- 172.21.15.118:0/2341365861 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68030d30 con 0x7f0b70149440 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 -- 172.21.15.118:0/2341365861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b70149440 msgr2=0x7f0b7006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 --2- 172.21.15.118:0/2341365861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b70149440 0x7f0b7006d8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009870 tx=0x7f0b6802b980 comp rx=0 tx=0).stop 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 -- 172.21.15.118:0/2341365861 shutdown_connections 2024-02-18T10:01:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 --2- 172.21.15.118:0/2341365861 >> v2:172.21.15.164:3300/0 conn(0x7f0b700bb600 0x7f0b700ba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 --2- 172.21.15.118:0/2341365861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b70149440 0x7f0b7006d8f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 -- 172.21.15.118:0/2341365861 >> 172.21.15.118:0/2341365861 conn(0x7f0b7006adc0 msgr2=0x7f0b7006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 -- 172.21.15.118:0/2341365861 shutdown_connections 2024-02-18T10:01:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.725+0000 7f0b74ace640 1 -- 172.21.15.118:0/2341365861 wait complete. 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.726+0000 7f0b74ace640 1 Processor -- start 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.726+0000 7f0b74ace640 1 -- start start 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b74ace640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b700bb600 0x7f0b70142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b74ace640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b700bf550 0x7f0b700a2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b74ace640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b70149440 0x7f0b700a3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b74ace640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70142cb0 con 0x7f0b700bf550 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b74ace640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b701415a0 con 0x7f0b70149440 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b74ace640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b700b57f0 con 0x7f0b700bb600 2024-02-18T10:01:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b700bf550 0x7f0b700a2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b700bf550 0x7f0b700a2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55084/0 (socket says 172.21.15.118:55084) 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 -- 172.21.15.118:0/475244922 learned_addr learned my addr 172.21.15.118:0/475244922 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6ed9d640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b70149440 0x7f0b700a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6e59c640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b700bb600 0x7f0b70142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 -- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b700bb600 msgr2=0x7f0b70142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b700bb600 0x7f0b70142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 -- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b70149440 msgr2=0x7f0b700a3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b70149440 0x7f0b700a3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:32.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 -- 172.21.15.118:0/475244922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680094d0 con 0x7f0b700bf550 2024-02-18T10:01:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b6dd9b640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b700bf550 0x7f0b700a2fc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9b0 tx=0x7f0b5800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.727+0000 7f0b66ffd640 1 -- 172.21.15.118:0/475244922 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58009670 con 0x7f0b700bf550 2024-02-18T10:01:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.728+0000 7f0b66ffd640 1 -- 172.21.15.118:0/475244922 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5800c9a0 con 0x7f0b700bf550 2024-02-18T10:01:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.728+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70143b60 con 0x7f0b700bf550 2024-02-18T10:01:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.728+0000 7f0b66ffd640 1 -- 172.21.15.118:0/475244922 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800cd50 con 0x7f0b700bf550 2024-02-18T10:01:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.728+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b700a4b30 con 0x7f0b700bf550 2024-02-18T10:01:32.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.729+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b700a2c60 con 0x7f0b700bf550 2024-02-18T10:01:32.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.729+0000 7f0b66ffd640 1 -- 172.21.15.118:0/475244922 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f0b58013470 con 0x7f0b700bf550 2024-02-18T10:01:32.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.729+0000 7f0b66ffd640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0b5006bc70 0x7f0b5006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:32.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.729+0000 7f0b66ffd640 1 -- 172.21.15.118:0/475244922 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b5808aba0 con 0x7f0b700bf550 2024-02-18T10:01:32.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.729+0000 7f0b6e59c640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0b5006bc70 0x7f0b5006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:32.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.730+0000 7f0b6e59c640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0b5006bc70 0x7f0b5006e130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0b68036000 tx=0x7f0b68008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:32.736 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.734+0000 7f0b66ffd640 1 -- 172.21.15.118:0/475244922 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b580554c0 con 0x7f0b700bf550 2024-02-18T10:01:32.941 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:32.939+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0b70075150 con 0x7f0b700bf550 2024-02-18T10:01:33.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.004+0000 7f0b66ffd640 1 -- 172.21.15.118:0/475244922 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0b580170b0 con 0x7f0b700bf550 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0b5006bc70 msgr2=0x7f0b5006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0b5006bc70 0x7f0b5006e130 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0b68036000 tx=0x7f0b68008030 comp rx=0 tx=0).stop 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b700bf550 msgr2=0x7f0b700a2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b700bf550 0x7f0b700a2fc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800e9b0 tx=0x7f0b5800ee70 comp rx=0 tx=0).stop 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 shutdown_connections 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0b5006bc70 0x7f0b5006e130 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b70149440 0x7f0b700a3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b700bf550 0x7f0b700a2fc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 --2- 172.21.15.118:0/475244922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0b700bb600 0x7f0b70142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 >> 172.21.15.118:0/475244922 conn(0x7f0b7006adc0 msgr2=0x7f0b700bd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 shutdown_connections 2024-02-18T10:01:33.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.007+0000 7f0b74ace640 1 -- 172.21.15.118:0/475244922 wait complete. 2024-02-18T10:01:33.020 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-18T10:01:33.020 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-18T10:01:33.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.120+0000 7f568cbc7640 1 Processor -- start 2024-02-18T10:01:33.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.120+0000 7f568cbc7640 1 -- start start 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f568cbc7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5688070150 0x7f568806bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f568cbc7640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f568806dab0 0x7f568806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f568cbc7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f568806f6f0 0x7f568814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f568cbc7640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568814c6b0 con 0x7f568806dab0 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f568cbc7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5688146290 con 0x7f568806f6f0 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f568cbc7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568814c050 con 0x7f5688070150 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f5685d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f568806dab0 0x7f568806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f5685d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f568806dab0 0x7f568806f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55088/0 (socket says 172.21.15.118:55088) 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f5685d9b640 1 -- 172.21.15.118:0/1451322219 learned_addr learned my addr 172.21.15.118:0/1451322219 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f5686d9d640 1 --2- 172.21.15.118:0/1451322219 >> v2:172.21.15.164:3300/0 conn(0x7f568806f6f0 0x7f568814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:33.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.121+0000 7f568659c640 1 --2- 172.21.15.118:0/1451322219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5688070150 0x7f568806bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f5685d9b640 1 -- 172.21.15.118:0/1451322219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5688070150 msgr2=0x7f568806bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f5685d9b640 1 --2- 172.21.15.118:0/1451322219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5688070150 0x7f568806bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f5685d9b640 1 -- 172.21.15.118:0/1451322219 >> v2:172.21.15.164:3300/0 conn(0x7f568806f6f0 msgr2=0x7f568814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f5685d9b640 1 --2- 172.21.15.118:0/1451322219 >> v2:172.21.15.164:3300/0 conn(0x7f568806f6f0 0x7f568814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f5685d9b640 1 -- 172.21.15.118:0/1451322219 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568814cad0 con 0x7f568806dab0 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f5685d9b640 1 --2- 172.21.15.118:0/1451322219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568806dab0 0x7f568806f1b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56880bd1e0 tx=0x7f567c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50782178bc15e5b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f568559a640 1 -- 172.21.15.118:0/1451322219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c031870 con 0x7f568806dab0 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f568559a640 1 -- 172.21.15.118:0/1451322219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c0319d0 con 0x7f568806dab0 2024-02-18T10:01:33.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.122+0000 7f568559a640 1 -- 172.21.15.118:0/1451322219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c031d60 con 0x7f568806dab0 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 -- 172.21.15.118:0/1451322219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568806dab0 msgr2=0x7f568806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 --2- 172.21.15.118:0/1451322219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568806dab0 0x7f568806f1b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56880bd1e0 tx=0x7f567c02b910 comp rx=0 tx=0).stop 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 -- 172.21.15.118:0/1451322219 shutdown_connections 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 --2- 172.21.15.118:0/1451322219 >> v2:172.21.15.164:3300/0 conn(0x7f568806f6f0 0x7f568814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 --2- 172.21.15.118:0/1451322219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f568806dab0 0x7f568806f1b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 --2- 172.21.15.118:0/1451322219 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5688070150 0x7f568806bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 -- 172.21.15.118:0/1451322219 >> 172.21.15.118:0/1451322219 conn(0x7f56880bbe30 msgr2=0x7f56880bc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 -- 172.21.15.118:0/1451322219 shutdown_connections 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.123+0000 7f568cbc7640 1 -- 172.21.15.118:0/1451322219 wait complete. 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.124+0000 7f568cbc7640 1 Processor -- start 2024-02-18T10:01:33.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.124+0000 7f568cbc7640 1 -- start start 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568cbc7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f568806dab0 0x7f568813c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568cbc7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f568806f6f0 0x7f568814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568cbc7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5688070150 0x7f56881e51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568cbc7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568814b120 con 0x7f5688070150 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568cbc7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56880be050 con 0x7f568806f6f0 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568cbc7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56881e4d10 con 0x7f568806dab0 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5688070150 0x7f56881e51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5688070150 0x7f56881e51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55104/0 (socket says 172.21.15.118:55104) 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 -- 172.21.15.118:0/778835724 learned_addr learned my addr 172.21.15.118:0/778835724 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568659c640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f568806dab0 0x7f568813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5685d9b640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f568806f6f0 0x7f568814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 -- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f568806dab0 msgr2=0x7f568813c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f568806dab0 0x7f568813c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 -- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f568806f6f0 msgr2=0x7f568814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f568806f6f0 0x7f568814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 -- 172.21.15.118:0/778835724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c0094d0 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5686d9d640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5688070150 0x7f56881e51a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f568000d5c0 tx=0x7f568000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5676ffd640 1 -- 172.21.15.118:0/778835724 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800125f0 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f5676ffd640 1 -- 172.21.15.118:0/778835724 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680012770 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.125+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56880b6860 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.126+0000 7f5676ffd640 1 -- 172.21.15.118:0/778835724 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680012b20 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.126+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56881e49a0 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.126+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5688075150 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.127+0000 7f5676ffd640 1 -- 172.21.15.118:0/778835724 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f5680012c80 con 0x7f5688070150 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.127+0000 7f5676ffd640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f566806bc70 0x7f566806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.127+0000 7f568659c640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f566806bc70 0x7f566806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:33.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.127+0000 7f5676ffd640 1 -- 172.21.15.118:0/778835724 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f568008ab20 con 0x7f5688070150 2024-02-18T10:01:33.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.128+0000 7f568659c640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f566806bc70 0x7f566806e130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5678003aa0 tx=0x7f5678009830 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:33.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.132+0000 7f5676ffd640 1 -- 172.21.15.118:0/778835724 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56800553b0 con 0x7f5688070150 2024-02-18T10:01:33.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:33.343+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5688074af0 con 0x7f5688070150 2024-02-18T10:01:34.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.009+0000 7f5676ffd640 1 -- 172.21.15.118:0/778835724 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5680058a70 con 0x7f5688070150 2024-02-18T10:01:34.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f566806bc70 msgr2=0x7f566806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f566806bc70 0x7f566806e130 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5678003aa0 tx=0x7f5678009830 comp rx=0 tx=0).stop 2024-02-18T10:01:34.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5688070150 msgr2=0x7f56881e51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5688070150 0x7f56881e51a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f568000d5c0 tx=0x7f568000da80 comp rx=0 tx=0).stop 2024-02-18T10:01:34.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 shutdown_connections 2024-02-18T10:01:34.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f566806bc70 0x7f566806e130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5688070150 0x7f56881e51a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f568806f6f0 0x7f568814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 --2- 172.21.15.118:0/778835724 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f568806dab0 0x7f568813c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 >> 172.21.15.118:0/778835724 conn(0x7f56880bbe30 msgr2=0x7f5688145280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:34.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 shutdown_connections 2024-02-18T10:01:34.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.011+0000 7f568cbc7640 1 -- 172.21.15.118:0/778835724 wait complete. 2024-02-18T10:01:34.026 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-18T10:01:34.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:34.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.126+0000 7f94183c7640 1 Processor -- start 2024-02-18T10:01:34.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.126+0000 7f94183c7640 1 -- start start 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f94183c7640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f941014dc70 0x7f941006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f94183c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 0x7f941014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f94183c7640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941014cfd0 con 0x7f94100ba0f0 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f94183c7640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94100711a0 con 0x7f941014dc70 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f94183c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9410144200 con 0x7f94100ba560 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f9415962640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f94100ba0f0 0x7f9410149ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48528/0 (socket says 172.21.15.118:48528) 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f9415962640 1 -- 172.21.15.118:0/1905422673 learned_addr learned my addr 172.21.15.118:0/1905422673 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f9416163640 1 --2- 172.21.15.118:0/1905422673 >> v2:172.21.15.164:3300/0 conn(0x7f941014dc70 0x7f941006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f9416964640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 0x7f941014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124589100 0 0) 0x7f941014cfd0 con 0x7f94100ba0f0 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.127+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc003520 con 0x7f94100ba0f0 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2958380910 0 0) 0x7f93fc003520 con 0x7f94100ba0f0 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 msgr2=0x7f941014a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:34.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 0x7f941014a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 >> v2:172.21.15.164:3300/0 conn(0x7f941014dc70 msgr2=0x7f941006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 --2- 172.21.15.118:0/1905422673 >> v2:172.21.15.164:3300/0 conn(0x7f941014dc70 0x7f941006abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941006bb60 con 0x7f94100ba0f0 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f9400001670 con 0x7f94100ba0f0 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 >> v1:172.21.15.118:6789/0 conn(0x7f94100ba0f0 legacy=0x7f9410149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f93fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 0x7f93fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93fc004d00 0x7f93fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94100711a0 con 0x7f93fc003970 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410144200 con 0x7f93fc004d00 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00b980 con 0x7f94100ba560 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9416163640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f93fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415962640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 0x7f93fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9416964640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93fc004d00 0x7f93fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9416163640 1 -- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 msgr2=0x7f93fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9416163640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 0x7f93fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9416163640 1 -- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93fc004d00 msgr2=0x7f93fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9416163640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93fc004d00 0x7f93fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9416163640 1 -- 172.21.15.118:0/1905422673 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc003520 con 0x7f93fc003970 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.128+0000 7f9415962640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f94100ba560 0x7f93fc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.129+0000 7f9416163640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f93fc003d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f940c009fc0 tx=0x7f93fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb210ff0a2e250b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.129+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c02cc60 con 0x7f93fc003970 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.129+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c00f040 con 0x7f93fc003970 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.129+0000 7f9415161640 1 -- 172.21.15.118:0/1905422673 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c034440 con 0x7f93fc003970 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.129+0000 7f94183c7640 1 -- 172.21.15.118:0/1905422673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 msgr2=0x7f93fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.129+0000 7f94183c7640 1 --2- 172.21.15.118:0/1905422673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f93fc003d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f940c009fc0 tx=0x7f93fc0057f0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.129+0000 7f9416964640 1 -- 172.21.15.118:0/1905422673 reap_dead start 2024-02-18T10:01:34.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.130+0000 7f94183c7640 1 -- 172.21.15.118:0/1905422673 shutdown_connections 2024-02-18T10:01:34.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.130+0000 7f94183c7640 1 -- 172.21.15.118:0/1905422673 >> 172.21.15.118:0/1905422673 conn(0x7f941006bcf0 msgr2=0x7f941006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:34.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.130+0000 7f94183c7640 1 -- 172.21.15.118:0/1905422673 shutdown_connections 2024-02-18T10:01:34.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.130+0000 7f94183c7640 1 -- 172.21.15.118:0/1905422673 wait complete. 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 Processor -- start 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 -- start start 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f941014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9410147010 0x7f9410148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9410147dc0 0x7f9410148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941014cd40 con 0x7f93fc003970 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410149450 con 0x7f9410147dc0 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f94183c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9410145da0 con 0x7f9410147010 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f9416163640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f941014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f9416163640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f941014c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55128/0 (socket says 172.21.15.118:55128) 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f9416163640 1 -- 172.21.15.118:0/2563737314 learned_addr learned my addr 172.21.15.118:0/2563737314 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f9415962640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9410147010 0x7f9410148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.131+0000 7f9416964640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9410147dc0 0x7f9410148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9416163640 1 -- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9410147010 msgr2=0x7f9410148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9416163640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9410147010 0x7f9410148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9416163640 1 -- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9410147dc0 msgr2=0x7f9410148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9416163640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9410147dc0 0x7f9410148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9416163640 1 -- 172.21.15.118:0/2563737314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410072f40 con 0x7f93fc003970 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9415962640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9410147010 0x7f9410148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9416163640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f941014c800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f940c00e230 tx=0x7f940c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9406ffd640 1 -- 172.21.15.118:0/2563737314 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c034c50 con 0x7f93fc003970 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9406ffd640 1 -- 172.21.15.118:0/2563737314 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c034db0 con 0x7f93fc003970 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f9406ffd640 1 -- 172.21.15.118:0/2563737314 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c003bd0 con 0x7f93fc003970 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941014a1c0 con 0x7f93fc003970 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.132+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941014a4f0 con 0x7f93fc003970 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.133+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9410074af0 con 0x7f93fc003970 2024-02-18T10:01:34.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.133+0000 7f9406ffd640 1 -- 172.21.15.118:0/2563737314 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f940c040450 con 0x7f93fc003970 2024-02-18T10:01:34.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.134+0000 7f9406ffd640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f93f406bc70 0x7f93f406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.134+0000 7f9415962640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f93f406bc70 0x7f93f406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.134+0000 7f9406ffd640 1 -- 172.21.15.118:0/2563737314 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f940c0acec0 con 0x7f93fc003970 2024-02-18T10:01:34.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.134+0000 7f9415962640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f93f406bc70 0x7f93f406e130 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f941013f840 tx=0x7f9400009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.138+0000 7f9406ffd640 1 -- 172.21.15.118:0/2563737314 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f940c077730 con 0x7f93fc003970 2024-02-18T10:01:34.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.344+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f941006e9d0 con 0x7f93fc003970 2024-02-18T10:01:34.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.345+0000 7f9406ffd640 1 -- 172.21.15.118:0/2563737314 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4156 (secure 0 0 0) 0x7f940c07adf0 con 0x7f93fc003970 2024-02-18T10:01:34.347 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:34.348 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4732,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1586932009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1586932009},{"type":"v1","addr":"172.21.15.164:6833","nonce":1586932009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/1218312757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1218312757},{"type":"v1","addr":"172.21.15.118:6836","nonce":1218312757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:01:31.339623+0000","modified":"2024-02-18T10:01:33.344937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6837/2626574740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":2626574740},{"type":"v1","addr":"172.21.15.118:6837","nonce":2626574740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-18T10:01:34.348 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 13 2024-02-18T10:01:34.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f93f406bc70 msgr2=0x7f93f406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f93f406bc70 0x7f93f406e130 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f941013f840 tx=0x7f9400009040 comp rx=0 tx=0).stop 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 msgr2=0x7f941014c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f941014c800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f940c00e230 tx=0x7f940c009750 comp rx=0 tx=0).stop 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 shutdown_connections 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f93f406bc70 0x7f93f406e130 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9410147dc0 0x7f9410148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9410147010 0x7f9410148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 --2- 172.21.15.118:0/2563737314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93fc003970 0x7f941014c800 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 >> 172.21.15.118:0/2563737314 conn(0x7f941006bcf0 msgr2=0x7f94100bc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 shutdown_connections 2024-02-18T10:01:34.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.347+0000 7f94183c7640 1 -- 172.21.15.118:0/2563737314 wait complete. 2024-02-18T10:01:34.360 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T10:01:34.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.457+0000 7f028301b640 1 Processor -- start 2024-02-18T10:01:34.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.457+0000 7f028301b640 1 -- start start 2024-02-18T10:01:34.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.457+0000 7f028301b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f027c072e30 0x7f027c0bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.457+0000 7f028301b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c0b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.457+0000 7f028301b640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0b8b00 con 0x7f027c0bb6c0 2024-02-18T10:01:34.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.457+0000 7f028301b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c0bd050 con 0x7f027c072e30 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.457+0000 7f028301b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c073210 con 0x7f027c0b98f0 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f0280db7640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f027c072e30 0x7f027c0bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f027bfff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f027c0bb6c0 0x7f027c14bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48532/0 (socket says 172.21.15.118:48532) 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f0280db7640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f027c072e30 0x7f027c0bc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55140/0 (socket says 172.21.15.118:55140) 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f027bfff640 1 -- 172.21.15.118:0/258899619 learned_addr learned my addr 172.21.15.118:0/258899619 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f02815b8640 1 --2- 172.21.15.118:0/258899619 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c0b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f0280db7640 1 -- 172.21.15.118:0/258899619 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 msgr2=0x7f027c0b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f0280db7640 1 --2- 172.21.15.118:0/258899619 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c0b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f0280db7640 1 -- 172.21.15.118:0/258899619 >> v1:172.21.15.118:6789/0 conn(0x7f027c0bb6c0 legacy=0x7f027c14bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f0280db7640 1 -- 172.21.15.118:0/258899619 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c09cdd0 con 0x7f027c072e30 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.458+0000 7f027b7fe640 1 -- 172.21.15.118:0/258899619 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854266777 0 0) 0x7f0268001110 con 0x7f027c0bb6c0 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f0280db7640 1 --2- 172.21.15.118:0/258899619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c072e30 0x7f027c0bc680 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02700097a0 tx=0x7f027002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac663d2826f5887 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f027b7fe640 1 -- 172.21.15.118:0/258899619 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270031830 con 0x7f027c072e30 2024-02-18T10:01:34.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f027b7fe640 1 -- 172.21.15.118:0/258899619 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0270031990 con 0x7f027c072e30 2024-02-18T10:01:34.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f027b7fe640 1 -- 172.21.15.118:0/258899619 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270031d20 con 0x7f027c072e30 2024-02-18T10:01:34.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 -- 172.21.15.118:0/258899619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c072e30 msgr2=0x7f027c0bc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 --2- 172.21.15.118:0/258899619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c072e30 0x7f027c0bc680 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02700097a0 tx=0x7f027002b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 -- 172.21.15.118:0/258899619 shutdown_connections 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 --2- 172.21.15.118:0/258899619 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c0b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 --2- 172.21.15.118:0/258899619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c072e30 0x7f027c0bc680 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 -- 172.21.15.118:0/258899619 >> 172.21.15.118:0/258899619 conn(0x7f027c0ba3c0 msgr2=0x7f027c0ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 -- 172.21.15.118:0/258899619 shutdown_connections 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.459+0000 7f028301b640 1 -- 172.21.15.118:0/258899619 wait complete. 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.460+0000 7f028301b640 1 Processor -- start 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.460+0000 7f028301b640 1 -- start start 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f028301b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f027c072e30 0x7f027c1e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f028301b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c1e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f028301b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c0bb6c0 0x7f027c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f028301b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0a0d30 con 0x7f027c0bb6c0 2024-02-18T10:01:34.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f028301b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0b6ac0 con 0x7f027c072e30 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f028301b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0b6d60 con 0x7f027c0b98f0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f02815b8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c0bb6c0 0x7f027c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f02815b8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c0bb6c0 0x7f027c141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55150/0 (socket says 172.21.15.118:55150) 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f02815b8640 1 -- 172.21.15.118:0/1115522631 learned_addr learned my addr 172.21.15.118:0/1115522631 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f027bfff640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c1e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f0280db7640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f027c072e30 0x7f027c1e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f02815b8640 1 -- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 msgr2=0x7f027c1e1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f02815b8640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c1e1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f02815b8640 1 -- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f027c072e30 msgr2=0x7f027c1e1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.461+0000 7f02815b8640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f027c072e30 0x7f027c1e1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.462+0000 7f02815b8640 1 -- 172.21.15.118:0/1115522631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270009400 con 0x7f027c0bb6c0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.462+0000 7f02815b8640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c0bb6c0 0x7f027c141fc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f027400efc0 tx=0x7f027400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.462+0000 7f02797fa640 1 -- 172.21.15.118:0/1115522631 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274014480 con 0x7f027c0bb6c0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.462+0000 7f02797fa640 1 -- 172.21.15.118:0/1115522631 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400f040 con 0x7f027c0bb6c0 2024-02-18T10:01:34.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.462+0000 7f02797fa640 1 -- 172.21.15.118:0/1115522631 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274014820 con 0x7f027c0bb6c0 2024-02-18T10:01:34.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.462+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c0b7040 con 0x7f027c0bb6c0 2024-02-18T10:01:34.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.462+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c1e14b0 con 0x7f027c0bb6c0 2024-02-18T10:01:34.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.463+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c074af0 con 0x7f027c0bb6c0 2024-02-18T10:01:34.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.463+0000 7f02797fa640 1 -- 172.21.15.118:0/1115522631 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f0274014980 con 0x7f027c0bb6c0 2024-02-18T10:01:34.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.464+0000 7f02797fa640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f026006bc70 0x7f026006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.464+0000 7f02797fa640 1 -- 172.21.15.118:0/1115522631 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f027408b250 con 0x7f027c0bb6c0 2024-02-18T10:01:34.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.464+0000 7f0280db7640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f026006bc70 0x7f026006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.464+0000 7f0280db7640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f026006bc70 0x7f026006e130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0270036000 tx=0x7f027003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.468+0000 7f02797fa640 1 -- 172.21.15.118:0/1115522631 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0274055ae0 con 0x7f027c0bb6c0 2024-02-18T10:01:34.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.638+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f027c0a3c50 con 0x7f027c0bb6c0 2024-02-18T10:01:34.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.639+0000 7f02797fa640 1 -- 172.21.15.118:0/1115522631 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f02740591a0 con 0x7f027c0bb6c0 2024-02-18T10:01:34.642 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:34.642 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:33.001470+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:01:29.722354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-18T10:01:30.305941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f026006bc70 msgr2=0x7f026006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f026006bc70 0x7f026006e130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0270036000 tx=0x7f027003c040 comp rx=0 tx=0).stop 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c0bb6c0 msgr2=0x7f027c141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c0bb6c0 0x7f027c141fc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f027400efc0 tx=0x7f027400c490 comp rx=0 tx=0).stop 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 shutdown_connections 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f026006bc70 0x7f026006e130 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f027c0bb6c0 0x7f027c141fc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f027c0b98f0 0x7f027c1e1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 --2- 172.21.15.118:0/1115522631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f027c072e30 0x7f027c1e1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 >> 172.21.15.118:0/1115522631 conn(0x7f027c0ba3c0 msgr2=0x7f027c071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:34.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 shutdown_connections 2024-02-18T10:01:34.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.641+0000 7f028301b640 1 -- 172.21.15.118:0/1115522631 wait complete. 2024-02-18T10:01:34.654 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-18T10:01:34.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:01:34.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.752+0000 7f8ed196b640 1 Processor -- start 2024-02-18T10:01:34.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.752+0000 7f8ed196b640 1 -- start start 2024-02-18T10:01:34.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ed196b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ecc0a6e60 0x7f8ecc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ed196b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc1546d0 0x7f8ecc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ed196b640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc0b4aa0 con 0x7f8ecc14bf20 2024-02-18T10:01:34.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ed196b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc0b4cf0 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ed196b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0a7350 con 0x7f8ecc1546d0 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ecaffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ecc0a6e60 0x7f8ecc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8eca7fc640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8ecc14bf20 0x7f8ecc14c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48548/0 (socket says 172.21.15.118:48548) 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8eca7fc640 1 -- 172.21.15.118:0/3387575737 learned_addr learned my addr 172.21.15.118:0/3387575737 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ecb7fe640 1 --2- 172.21.15.118:0/3387575737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc1546d0 0x7f8ecc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ecaffd640 1 -- 172.21.15.118:0/3387575737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc1546d0 msgr2=0x7f8ecc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ecaffd640 1 --2- 172.21.15.118:0/3387575737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc1546d0 0x7f8ecc156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ecaffd640 1 -- 172.21.15.118:0/3387575737 >> v1:172.21.15.118:6789/0 conn(0x7f8ecc14bf20 legacy=0x7f8ecc14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ec9ffb640 1 -- 172.21.15.118:0/3387575737 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003089645 0 0) 0x7f8ecc0b4aa0 con 0x7f8ecc14bf20 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ecaffd640 1 -- 172.21.15.118:0/3387575737 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0c1140 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.753+0000 7f8ecb7fe640 1 --2- 172.21.15.118:0/3387575737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc1546d0 0x7f8ecc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:01:34.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ecaffd640 1 --2- 172.21.15.118:0/3387575737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc06b5c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6651e08a799378bc server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ec9ffb640 1 -- 172.21.15.118:0/3387575737 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc02f050 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ec9ffb640 1 -- 172.21.15.118:0/3387575737 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc031700 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ec9ffb640 1 -- 172.21.15.118:0/3387575737 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc031a90 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ed196b640 1 -- 172.21.15.118:0/3387575737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 msgr2=0x7f8ecc06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ed196b640 1 --2- 172.21.15.118:0/3387575737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc06b5c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02b7a0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ed196b640 1 -- 172.21.15.118:0/3387575737 shutdown_connections 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ed196b640 1 --2- 172.21.15.118:0/3387575737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc1546d0 0x7f8ecc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ed196b640 1 --2- 172.21.15.118:0/3387575737 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc06b5c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.754+0000 7f8ed196b640 1 -- 172.21.15.118:0/3387575737 >> 172.21.15.118:0/3387575737 conn(0x7f8ecc0c15b0 msgr2=0x7f8ecc0c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.755+0000 7f8ed196b640 1 -- 172.21.15.118:0/3387575737 shutdown_connections 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.755+0000 7f8ed196b640 1 -- 172.21.15.118:0/3387575737 wait complete. 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.755+0000 7f8ed196b640 1 Processor -- start 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ed196b640 1 -- start start 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ed196b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ed196b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc14bf20 0x7f8ecc0bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ed196b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ecc1546d0 0x7f8ecc1e1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ed196b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0c0410 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ed196b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc1e1650 con 0x7f8ecc1546d0 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ed196b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc14efe0 con 0x7f8ecc14bf20 2024-02-18T10:01:34.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ecaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ecaffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc14e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55180/0 (socket says 172.21.15.118:55180) 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.756+0000 7f8ecaffd640 1 -- 172.21.15.118:0/2092129749 learned_addr learned my addr 172.21.15.118:0/2092129749 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecaffd640 1 -- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc14bf20 msgr2=0x7f8ecc0bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecaffd640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc14bf20 0x7f8ecc0bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecaffd640 1 -- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ecc1546d0 msgr2=0x7f8ecc1e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecb7fe640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ecc1546d0 0x7f8ecc1e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecaffd640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ecc1546d0 0x7f8ecc1e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecaffd640 1 -- 172.21.15.118:0/2092129749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc009400 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecb7fe640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ecc1546d0 0x7f8ecc1e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ecaffd640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc14e910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc000c00 tx=0x7f8ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8eb3fff640 1 -- 172.21.15.118:0/2092129749 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc004030 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8eb3fff640 1 -- 172.21.15.118:0/2092129749 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc0041b0 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc14cfa0 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8eb3fff640 1 -- 172.21.15.118:0/2092129749 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc033930 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.757+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc14d560 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.758+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc14f1b0 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.758+0000 7f8eb3fff640 1 -- 172.21.15.118:0/2092129749 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f8ebc03a050 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.759+0000 7f8eb3fff640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8eb806bc70 0x7f8eb806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.759+0000 7f8eb3fff640 1 -- 172.21.15.118:0/2092129749 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ebc0ac3c0 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.759+0000 7f8eca7fc640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8eb806bc70 0x7f8eb806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:34.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.759+0000 7f8eca7fc640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8eb806bc70 0x7f8eb806e130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0007fd0 tx=0x7f8ec0007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:34.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.763+0000 7f8eb3fff640 1 -- 172.21.15.118:0/2092129749 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ebc076a90 con 0x7f8ecc0a6e60 2024-02-18T10:01:34.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.931+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ecc0bc380 con 0x7f8eb806bc70 2024-02-18T10:01:34.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.937+0000 7f8eb3fff640 1 -- 172.21.15.118:0/2092129749 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251879 (secure 0 0 0) 0x7f8ec00070d0 con 0x7f8eb806bc70 2024-02-18T10:01:34.942 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:34.943 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:01:34.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8eb806bc70 msgr2=0x7f8eb806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8eb806bc70 0x7f8eb806e130 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0007fd0 tx=0x7f8ec0007920 comp rx=0 tx=0).stop 2024-02-18T10:01:34.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 msgr2=0x7f8ecc14e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc14e910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc000c00 tx=0x7f8ebc0046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 shutdown_connections 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8eb806bc70 0x7f8eb806e130 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ecc1546d0 0x7f8ecc1e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ecc14bf20 0x7f8ecc0bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 --2- 172.21.15.118:0/2092129749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ecc0a6e60 0x7f8ecc14e910 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.939+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 >> 172.21.15.118:0/2092129749 conn(0x7f8ecc0c15b0 msgr2=0x7f8ecc0a4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.940+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 shutdown_connections 2024-02-18T10:01:34.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:34.940+0000 7f8ed196b640 1 -- 172.21.15.118:0/2092129749 wait complete. 2024-02-18T10:01:34.952 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-02-18T10:01:33.286622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236564,"kb_used_data":3744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738156,"statfs":{"total":773094113280,"available":772851871744,"internally_reserved":0,"allocated":3833856,"data_stored":2162874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000623"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014717+0000","last_change":"2024-02-18T10:01:32.013284+0000","last_active":"2024-02-18T10:01:32.014717+0000","last_peered":"2024-02-18T10:01:32.014717+0000","last_clean":"2024-02-18T10:01:32.014717+0000","last_became_active":"2024-02-18T10:01:32.013003+0000","last_became_peered":"2024-02-18T10:01:32.013003+0000","last_unstale":"2024-02-18T10:01:32.014717+0000","last_undegraded":"2024-02-18T10:01:32.014717+0000","last_fullsized":"2024-02-18T10:01:32.014717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:50.522189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013765+0000","last_change":"2024-02-18T10:01:32.006793+0000","last_active":"2024-02-18T10:01:32.013765+0000","last_peered":"2024-02-18T10:01:32.013765+0000","last_clean":"2024-02-18T10:01:32.013765+0000","last_became_active":"2024-02-18T10:01:32.006539+0000","last_became_peered":"2024-02-18T10:01:32.006539+0000","last_unstale":"2024-02-18T10:01:32.013765+0000","last_undegraded":"2024-02-18T10:01:32.013765+0000","last_fullsized":"2024-02-18T10:01:32.013765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:25.356461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020501+0000","last_change":"2024-02-18T10:01:32.018806+0000","last_active":"2024-02-18T10:01:32.020501+0000","last_peered":"2024-02-18T10:01:32.020501+0000","last_clean":"2024-02-18T10:01:32.020501+0000","last_became_active":"2024-02-18T10:01:32.018040+0000","last_became_peered":"2024-02-18T10:01:32.018040+0000","last_unstale":"2024-02-18T10:01:32.020501+0000","last_undegraded":"2024-02-18T10:01:32.020501+0000","last_fullsized":"2024-02-18T10:01:32.020501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:10.165836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017837+0000","last_change":"2024-02-18T10:01:32.015991+0000","last_active":"2024-02-18T10:01:32.017837+0000","last_peered":"2024-02-18T10:01:32.017837+0000","last_clean":"2024-02-18T10:01:32.017837+0000","last_became_active":"2024-02-18T10:01:32.015740+0000","last_became_peered":"2024-02-18T10:01:32.015740+0000","last_unstale":"2024-02-18T10:01:32.017837+0000","last_undegraded":"2024-02-18T10:01:32.017837+0000","last_fullsized":"2024-02-18T10:01:32.017837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:32.398447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016234+0000","last_change":"2024-02-18T10:01:32.007168+0000","last_active":"2024-02-18T10:01:32.016234+0000","last_peered":"2024-02-18T10:01:32.016234+0000","last_clean":"2024-02-18T10:01:32.016234+0000","last_became_active":"2024-02-18T10:01:32.006892+0000","last_became_peered":"2024-02-18T10:01:32.006892+0000","last_unstale":"2024-02-18T10:01:32.016234+0000","last_undegraded":"2024-02-18T10:01:32.016234+0000","last_fullsized":"2024-02-18T10:01:32.016234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:46.992409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022292+0000","last_change":"2024-02-18T10:01:32.018232+0000","last_active":"2024-02-18T10:01:32.022292+0000","last_peered":"2024-02-18T10:01:32.022292+0000","last_clean":"2024-02-18T10:01:32.022292+0000","last_became_active":"2024-02-18T10:01:32.017891+0000","last_became_peered":"2024-02-18T10:01:32.017891+0000","last_unstale":"2024-02-18T10:01:32.022292+0000","last_undegraded":"2024-02-18T10:01:32.022292+0000","last_fullsized":"2024-02-18T10:01:32.022292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:25:21.476136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019612+0000","last_change":"2024-02-18T10:01:32.017224+0000","last_active":"2024-02-18T10:01:32.019612+0000","last_peered":"2024-02-18T10:01:32.019612+0000","last_clean":"2024-02-18T10:01:32.019612+0000","last_became_active":"2024-02-18T10:01:32.016933+0000","last_became_peered":"2024-02-18T10:01:32.016933+0000","last_unstale":"2024-02-18T10:01:32.019612+0000","last_undegraded":"2024-02-18T10:01:32.019612+0000","last_fullsized":"2024-02-18T10:01:32.019612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:10.165836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019773+0000","last_change":"2024-02-18T10:01:32.017347+0000","last_active":"2024-02-18T10:01:32.019773+0000","last_peered":"2024-02-18T10:01:32.019773+0000","last_clean":"2024-02-18T10:01:32.019773+0000","last_became_active":"2024-02-18T10:01:32.017061+0000","last_became_peered":"2024-02-18T10:01:32.017061+0000","last_unstale":"2024-02-18T10:01:32.019773+0000","last_undegraded":"2024-02-18T10:01:32.019773+0000","last_fullsized":"2024-02-18T10:01:32.019773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:25.356461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013830+0000","last_change":"2024-02-18T10:01:32.009564+0000","last_active":"2024-02-18T10:01:32.013830+0000","last_peered":"2024-02-18T10:01:32.013830+0000","last_clean":"2024-02-18T10:01:32.013830+0000","last_became_active":"2024-02-18T10:01:32.009270+0000","last_became_peered":"2024-02-18T10:01:32.009270+0000","last_unstale":"2024-02-18T10:01:32.013830+0000","last_undegraded":"2024-02-18T10:01:32.013830+0000","last_fullsized":"2024-02-18T10:01:32.013830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:30.928987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017276+0000","last_change":"2024-02-18T10:01:32.015820+0000","last_active":"2024-02-18T10:01:32.017276+0000","last_peered":"2024-02-18T10:01:32.017276+0000","last_clean":"2024-02-18T10:01:32.017276+0000","last_became_active":"2024-02-18T10:01:32.015588+0000","last_became_peered":"2024-02-18T10:01:32.015588+0000","last_unstale":"2024-02-18T10:01:32.017276+0000","last_undegraded":"2024-02-18T10:01:32.017276+0000","last_fullsized":"2024-02-18T10:01:32.017276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:41.797830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019295+0000","last_change":"2024-02-18T10:01:32.016301+0000","last_active":"2024-02-18T10:01:32.019295+0000","last_peered":"2024-02-18T10:01:32.019295+0000","last_clean":"2024-02-18T10:01:32.019295+0000","last_became_active":"2024-02-18T10:01:32.016020+0000","last_became_peered":"2024-02-18T10:01:32.016020+0000","last_unstale":"2024-02-18T10:01:32.019295+0000","last_undegraded":"2024-02-18T10:01:32.019295+0000","last_fullsized":"2024-02-18T10:01:32.019295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:32.398447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019756+0000","last_change":"2024-02-18T10:01:32.014235+0000","last_active":"2024-02-18T10:01:32.019756+0000","last_peered":"2024-02-18T10:01:32.019756+0000","last_clean":"2024-02-18T10:01:32.019756+0000","last_became_active":"2024-02-18T10:01:32.013955+0000","last_became_peered":"2024-02-18T10:01:32.013955+0000","last_unstale":"2024-02-18T10:01:32.019756+0000","last_undegraded":"2024-02-18T10:01:32.019756+0000","last_fullsized":"2024-02-18T10:01:32.019756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:01.851993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016271+0000","last_change":"2024-02-18T10:01:32.008875+0000","last_active":"2024-02-18T10:01:32.016271+0000","last_peered":"2024-02-18T10:01:32.016271+0000","last_clean":"2024-02-18T10:01:32.016271+0000","last_became_active":"2024-02-18T10:01:32.008616+0000","last_became_peered":"2024-02-18T10:01:32.008616+0000","last_unstale":"2024-02-18T10:01:32.016271+0000","last_undegraded":"2024-02-18T10:01:32.016271+0000","last_fullsized":"2024-02-18T10:01:32.016271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:05:03.795424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019105+0000","last_change":"2024-02-18T10:01:32.015343+0000","last_active":"2024-02-18T10:01:32.019105+0000","last_peered":"2024-02-18T10:01:32.019105+0000","last_clean":"2024-02-18T10:01:32.019105+0000","last_became_active":"2024-02-18T10:01:32.015090+0000","last_became_peered":"2024-02-18T10:01:32.015090+0000","last_unstale":"2024-02-18T10:01:32.019105+0000","last_undegraded":"2024-02-18T10:01:32.019105+0000","last_fullsized":"2024-02-18T10:01:32.019105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:44:06.107041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012441+0000","last_change":"2024-02-18T10:01:32.006641+0000","last_active":"2024-02-18T10:01:32.012441+0000","last_peered":"2024-02-18T10:01:32.012441+0000","last_clean":"2024-02-18T10:01:32.012441+0000","last_became_active":"2024-02-18T10:01:32.006324+0000","last_became_peered":"2024-02-18T10:01:32.006324+0000","last_unstale":"2024-02-18T10:01:32.012441+0000","last_undegraded":"2024-02-18T10:01:32.012441+0000","last_fullsized":"2024-02-18T10:01:32.012441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019574+0000","last_change":"2024-02-18T10:01:32.017044+0000","last_active":"2024-02-18T10:01:32.019574+0000","last_peered":"2024-02-18T10:01:32.019574+0000","last_clean":"2024-02-18T10:01:32.019574+0000","last_became_active":"2024-02-18T10:01:32.015807+0000","last_became_peered":"2024-02-18T10:01:32.015807+0000","last_unstale":"2024-02-18T10:01:32.019574+0000","last_undegraded":"2024-02-18T10:01:32.019574+0000","last_fullsized":"2024-02-18T10:01:32.019574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:01.851993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014626+0000","last_change":"2024-02-18T10:01:32.013675+0000","last_active":"2024-02-18T10:01:32.014626+0000","last_peered":"2024-02-18T10:01:32.014626+0000","last_clean":"2024-02-18T10:01:32.014626+0000","last_became_active":"2024-02-18T10:01:32.013404+0000","last_became_peered":"2024-02-18T10:01:32.013404+0000","last_unstale":"2024-02-18T10:01:32.014626+0000","last_undegraded":"2024-02-18T10:01:32.014626+0000","last_fullsized":"2024-02-18T10:01:32.014626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019152+0000","last_change":"2024-02-18T10:01:32.010452+0000","last_active":"2024-02-18T10:01:32.019152+0000","last_peered":"2024-02-18T10:01:32.019152+0000","last_clean":"2024-02-18T10:01:32.019152+0000","last_became_active":"2024-02-18T10:01:32.010168+0000","last_became_peered":"2024-02-18T10:01:32.010168+0000","last_unstale":"2024-02-18T10:01:32.019152+0000","last_undegraded":"2024-02-18T10:01:32.019152+0000","last_fullsized":"2024-02-18T10:01:32.019152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:16:34.961345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014097+0000","last_change":"2024-02-18T10:01:32.009599+0000","last_active":"2024-02-18T10:01:32.014097+0000","last_peered":"2024-02-18T10:01:32.014097+0000","last_clean":"2024-02-18T10:01:32.014097+0000","last_became_active":"2024-02-18T10:01:32.009347+0000","last_became_peered":"2024-02-18T10:01:32.009347+0000","last_unstale":"2024-02-18T10:01:32.014097+0000","last_undegraded":"2024-02-18T10:01:32.014097+0000","last_fullsized":"2024-02-18T10:01:32.014097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:56:51.707365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017825+0000","last_change":"2024-02-18T10:01:32.013355+0000","last_active":"2024-02-18T10:01:32.017825+0000","last_peered":"2024-02-18T10:01:32.017825+0000","last_clean":"2024-02-18T10:01:32.017825+0000","last_became_active":"2024-02-18T10:01:32.013116+0000","last_became_peered":"2024-02-18T10:01:32.013116+0000","last_unstale":"2024-02-18T10:01:32.017825+0000","last_undegraded":"2024-02-18T10:01:32.017825+0000","last_fullsized":"2024-02-18T10:01:32.017825+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:27.851767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.002431+0000","last_change":"2024-02-18T10:01:32.000348+0000","last_active":"2024-02-18T10:01:32.002431+0000","last_peered":"2024-02-18T10:01:32.002431+0000","last_clean":"2024-02-18T10:01:32.002431+0000","last_became_active":"2024-02-18T10:01:32.000075+0000","last_became_peered":"2024-02-18T10:01:32.000075+0000","last_unstale":"2024-02-18T10:01:32.002431+0000","last_undegraded":"2024-02-18T10:01:32.002431+0000","last_fullsized":"2024-02-18T10:01:32.002431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:48.364320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014193+0000","last_change":"2024-02-18T10:01:32.009713+0000","last_active":"2024-02-18T10:01:32.014193+0000","last_peered":"2024-02-18T10:01:32.014193+0000","last_clean":"2024-02-18T10:01:32.014193+0000","last_became_active":"2024-02-18T10:01:32.009424+0000","last_became_peered":"2024-02-18T10:01:32.009424+0000","last_unstale":"2024-02-18T10:01:32.014193+0000","last_undegraded":"2024-02-18T10:01:32.014193+0000","last_fullsized":"2024-02-18T10:01:32.014193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013743+0000","last_change":"2024-02-18T10:01:32.010116+0000","last_active":"2024-02-18T10:01:32.013743+0000","last_peered":"2024-02-18T10:01:32.013743+0000","last_clean":"2024-02-18T10:01:32.013743+0000","last_became_active":"2024-02-18T10:01:32.009640+0000","last_became_peered":"2024-02-18T10:01:32.009640+0000","last_unstale":"2024-02-18T10:01:32.013743+0000","last_undegraded":"2024-02-18T10:01:32.013743+0000","last_fullsized":"2024-02-18T10:01:32.013743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:30.928987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012499+0000","last_change":"2024-02-18T10:01:32.008668+0000","last_active":"2024-02-18T10:01:32.012499+0000","last_peered":"2024-02-18T10:01:32.012499+0000","last_clean":"2024-02-18T10:01:32.012499+0000","last_became_active":"2024-02-18T10:01:32.008240+0000","last_became_peered":"2024-02-18T10:01:32.008240+0000","last_unstale":"2024-02-18T10:01:32.012499+0000","last_undegraded":"2024-02-18T10:01:32.012499+0000","last_fullsized":"2024-02-18T10:01:32.012499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:08.154709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014819+0000","last_change":"2024-02-18T10:01:32.012027+0000","last_active":"2024-02-18T10:01:32.014819+0000","last_peered":"2024-02-18T10:01:32.014819+0000","last_clean":"2024-02-18T10:01:32.014819+0000","last_became_active":"2024-02-18T10:01:32.011783+0000","last_became_peered":"2024-02-18T10:01:32.011783+0000","last_unstale":"2024-02-18T10:01:32.014819+0000","last_undegraded":"2024-02-18T10:01:32.014819+0000","last_fullsized":"2024-02-18T10:01:32.014819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021964+0000","last_change":"2024-02-18T10:01:32.015998+0000","last_active":"2024-02-18T10:01:32.021964+0000","last_peered":"2024-02-18T10:01:32.021964+0000","last_clean":"2024-02-18T10:01:32.021964+0000","last_became_active":"2024-02-18T10:01:32.015703+0000","last_became_peered":"2024-02-18T10:01:32.015703+0000","last_unstale":"2024-02-18T10:01:32.021964+0000","last_undegraded":"2024-02-18T10:01:32.021964+0000","last_fullsized":"2024-02-18T10:01:32.021964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:16.553553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018175+0000","last_change":"2024-02-18T10:01:32.016447+0000","last_active":"2024-02-18T10:01:32.018175+0000","last_peered":"2024-02-18T10:01:32.018175+0000","last_clean":"2024-02-18T10:01:32.018175+0000","last_became_active":"2024-02-18T10:01:32.015979+0000","last_became_peered":"2024-02-18T10:01:32.015979+0000","last_unstale":"2024-02-18T10:01:32.018175+0000","last_undegraded":"2024-02-18T10:01:32.018175+0000","last_fullsized":"2024-02-18T10:01:32.018175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:01.851993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017729+0000","last_change":"2024-02-18T10:01:32.011028+0000","last_active":"2024-02-18T10:01:32.017729+0000","last_peered":"2024-02-18T10:01:32.017729+0000","last_clean":"2024-02-18T10:01:32.017729+0000","last_became_active":"2024-02-18T10:01:32.010766+0000","last_became_peered":"2024-02-18T10:01:32.010766+0000","last_unstale":"2024-02-18T10:01:32.017729+0000","last_undegraded":"2024-02-18T10:01:32.017729+0000","last_fullsized":"2024-02-18T10:01:32.017729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:32.398447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013933+0000","last_change":"2024-02-18T10:01:32.009416+0000","last_active":"2024-02-18T10:01:32.013933+0000","last_peered":"2024-02-18T10:01:32.013933+0000","last_clean":"2024-02-18T10:01:32.013933+0000","last_became_active":"2024-02-18T10:01:32.008894+0000","last_became_peered":"2024-02-18T10:01:32.008894+0000","last_unstale":"2024-02-18T10:01:32.013933+0000","last_undegraded":"2024-02-18T10:01:32.013933+0000","last_fullsized":"2024-02-18T10:01:32.013933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:50.522189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014602+0000","last_change":"2024-02-18T10:01:32.012967+0000","last_active":"2024-02-18T10:01:32.014602+0000","last_peered":"2024-02-18T10:01:32.014602+0000","last_clean":"2024-02-18T10:01:32.014602+0000","last_became_active":"2024-02-18T10:01:32.012701+0000","last_became_peered":"2024-02-18T10:01:32.012701+0000","last_unstale":"2024-02-18T10:01:32.014602+0000","last_undegraded":"2024-02-18T10:01:32.014602+0000","last_fullsized":"2024-02-18T10:01:32.014602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:30.928987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012606+0000","last_change":"2024-02-18T10:01:32.005343+0000","last_active":"2024-02-18T10:01:32.012606+0000","last_peered":"2024-02-18T10:01:32.012606+0000","last_clean":"2024-02-18T10:01:32.012606+0000","last_became_active":"2024-02-18T10:01:32.005099+0000","last_became_peered":"2024-02-18T10:01:32.005099+0000","last_unstale":"2024-02-18T10:01:32.012606+0000","last_undegraded":"2024-02-18T10:01:32.012606+0000","last_fullsized":"2024-02-18T10:01:32.012606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:39.718829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018731+0000","last_change":"2024-02-18T10:01:32.015222+0000","last_active":"2024-02-18T10:01:32.018731+0000","last_peered":"2024-02-18T10:01:32.018731+0000","last_clean":"2024-02-18T10:01:32.018731+0000","last_became_active":"2024-02-18T10:01:32.014997+0000","last_became_peered":"2024-02-18T10:01:32.014997+0000","last_unstale":"2024-02-18T10:01:32.018731+0000","last_undegraded":"2024-02-18T10:01:32.018731+0000","last_fullsized":"2024-02-18T10:01:32.018731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014512+0000","last_change":"2024-02-18T10:01:32.010821+0000","last_active":"2024-02-18T10:01:32.014512+0000","last_peered":"2024-02-18T10:01:32.014512+0000","last_clean":"2024-02-18T10:01:32.014512+0000","last_became_active":"2024-02-18T10:01:32.010552+0000","last_became_peered":"2024-02-18T10:01:32.010552+0000","last_unstale":"2024-02-18T10:01:32.014512+0000","last_undegraded":"2024-02-18T10:01:32.014512+0000","last_fullsized":"2024-02-18T10:01:32.014512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025175+0000","last_change":"2024-02-18T10:01:30.998872+0000","last_active":"2024-02-18T10:01:32.025175+0000","last_peered":"2024-02-18T10:01:32.025175+0000","last_clean":"2024-02-18T10:01:32.025175+0000","last_became_active":"2024-02-18T10:01:30.998612+0000","last_became_peered":"2024-02-18T10:01:30.998612+0000","last_unstale":"2024-02-18T10:01:32.025175+0000","last_undegraded":"2024-02-18T10:01:32.025175+0000","last_fullsized":"2024-02-18T10:01:32.025175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:48:37.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.002941+0000","last_change":"2024-02-18T10:01:32.001237+0000","last_active":"2024-02-18T10:01:32.002941+0000","last_peered":"2024-02-18T10:01:32.002941+0000","last_clean":"2024-02-18T10:01:32.002941+0000","last_became_active":"2024-02-18T10:01:32.000940+0000","last_became_peered":"2024-02-18T10:01:32.000940+0000","last_unstale":"2024-02-18T10:01:32.002941+0000","last_undegraded":"2024-02-18T10:01:32.002941+0000","last_fullsized":"2024-02-18T10:01:32.002941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:48.364320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025839+0000","last_change":"2024-02-18T10:01:30.999768+0000","last_active":"2024-02-18T10:01:32.025839+0000","last_peered":"2024-02-18T10:01:32.025839+0000","last_clean":"2024-02-18T10:01:32.025839+0000","last_became_active":"2024-02-18T10:01:30.999522+0000","last_became_peered":"2024-02-18T10:01:30.999522+0000","last_unstale":"2024-02-18T10:01:32.025839+0000","last_undegraded":"2024-02-18T10:01:32.025839+0000","last_fullsized":"2024-02-18T10:01:32.025839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:47.360294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013943+0000","last_change":"2024-02-18T10:01:32.009057+0000","last_active":"2024-02-18T10:01:32.013943+0000","last_peered":"2024-02-18T10:01:32.013943+0000","last_clean":"2024-02-18T10:01:32.013943+0000","last_became_active":"2024-02-18T10:01:32.008745+0000","last_became_peered":"2024-02-18T10:01:32.008745+0000","last_unstale":"2024-02-18T10:01:32.013943+0000","last_undegraded":"2024-02-18T10:01:32.013943+0000","last_fullsized":"2024-02-18T10:01:32.013943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:39.718829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025343+0000","last_change":"2024-02-18T10:01:31.005696+0000","last_active":"2024-02-18T10:01:32.025343+0000","last_peered":"2024-02-18T10:01:32.025343+0000","last_clean":"2024-02-18T10:01:32.025343+0000","last_became_active":"2024-02-18T10:01:31.005316+0000","last_became_peered":"2024-02-18T10:01:31.005316+0000","last_unstale":"2024-02-18T10:01:32.025343+0000","last_undegraded":"2024-02-18T10:01:32.025343+0000","last_fullsized":"2024-02-18T10:01:32.025343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:00.847966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018156+0000","last_change":"2024-02-18T10:01:32.016231+0000","last_active":"2024-02-18T10:01:32.018156+0000","last_peered":"2024-02-18T10:01:32.018156+0000","last_clean":"2024-02-18T10:01:32.018156+0000","last_became_active":"2024-02-18T10:01:32.015684+0000","last_became_peered":"2024-02-18T10:01:32.015684+0000","last_unstale":"2024-02-18T10:01:32.018156+0000","last_undegraded":"2024-02-18T10:01:32.018156+0000","last_fullsized":"2024-02-18T10:01:32.018156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:21.646552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021520+0000","last_change":"2024-02-18T10:01:31.001606+0000","last_active":"2024-02-18T10:01:32.021520+0000","last_peered":"2024-02-18T10:01:32.021520+0000","last_clean":"2024-02-18T10:01:32.021520+0000","last_became_active":"2024-02-18T10:01:31.001350+0000","last_became_peered":"2024-02-18T10:01:31.001350+0000","last_unstale":"2024-02-18T10:01:32.021520+0000","last_undegraded":"2024-02-18T10:01:32.021520+0000","last_fullsized":"2024-02-18T10:01:32.021520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:42:11.518655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019321+0000","last_change":"2024-02-18T10:01:32.016102+0000","last_active":"2024-02-18T10:01:32.019321+0000","last_peered":"2024-02-18T10:01:32.019321+0000","last_clean":"2024-02-18T10:01:32.019321+0000","last_became_active":"2024-02-18T10:01:32.015785+0000","last_became_peered":"2024-02-18T10:01:32.015785+0000","last_unstale":"2024-02-18T10:01:32.019321+0000","last_undegraded":"2024-02-18T10:01:32.019321+0000","last_fullsized":"2024-02-18T10:01:32.019321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:41.797830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024941+0000","last_change":"2024-02-18T10:01:31.001402+0000","last_active":"2024-02-18T10:01:32.024941+0000","last_peered":"2024-02-18T10:01:32.024941+0000","last_clean":"2024-02-18T10:01:32.024941+0000","last_became_active":"2024-02-18T10:01:31.000872+0000","last_became_peered":"2024-02-18T10:01:31.000872+0000","last_unstale":"2024-02-18T10:01:32.024941+0000","last_undegraded":"2024-02-18T10:01:32.024941+0000","last_fullsized":"2024-02-18T10:01:32.024941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:06:08.144301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012501+0000","last_change":"2024-02-18T10:01:32.010458+0000","last_active":"2024-02-18T10:01:32.012501+0000","last_peered":"2024-02-18T10:01:32.012501+0000","last_clean":"2024-02-18T10:01:32.012501+0000","last_became_active":"2024-02-18T10:01:32.010203+0000","last_became_peered":"2024-02-18T10:01:32.010203+0000","last_unstale":"2024-02-18T10:01:32.012501+0000","last_undegraded":"2024-02-18T10:01:32.012501+0000","last_fullsized":"2024-02-18T10:01:32.012501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:41.797830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.026054+0000","last_change":"2024-02-18T10:01:31.000309+0000","last_active":"2024-02-18T10:01:32.026054+0000","last_peered":"2024-02-18T10:01:32.026054+0000","last_clean":"2024-02-18T10:01:32.026054+0000","last_became_active":"2024-02-18T10:01:30.999999+0000","last_became_peered":"2024-02-18T10:01:30.999999+0000","last_unstale":"2024-02-18T10:01:32.026054+0000","last_undegraded":"2024-02-18T10:01:32.026054+0000","last_fullsized":"2024-02-18T10:01:32.026054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:20:06.106625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.011518+0000","last_change":"2024-02-18T10:01:32.002682+0000","last_active":"2024-02-18T10:01:32.011518+0000","last_peered":"2024-02-18T10:01:32.011518+0000","last_clean":"2024-02-18T10:01:32.011518+0000","last_became_active":"2024-02-18T10:01:32.002367+0000","last_became_peered":"2024-02-18T10:01:32.002367+0000","last_unstale":"2024-02-18T10:01:32.011518+0000","last_undegraded":"2024-02-18T10:01:32.011518+0000","last_fullsized":"2024-02-18T10:01:32.011518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:24.086527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.004278+0000","last_change":"2024-02-18T10:01:31.002173+0000","last_active":"2024-02-18T10:01:32.004278+0000","last_peered":"2024-02-18T10:01:32.004278+0000","last_clean":"2024-02-18T10:01:32.004278+0000","last_became_active":"2024-02-18T10:01:31.001922+0000","last_became_peered":"2024-02-18T10:01:31.001922+0000","last_unstale":"2024-02-18T10:01:32.004278+0000","last_undegraded":"2024-02-18T10:01:32.004278+0000","last_fullsized":"2024-02-18T10:01:32.004278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:31.394420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017170+0000","last_change":"2024-02-18T10:01:32.013902+0000","last_active":"2024-02-18T10:01:32.017170+0000","last_peered":"2024-02-18T10:01:32.017170+0000","last_clean":"2024-02-18T10:01:32.017170+0000","last_became_active":"2024-02-18T10:01:32.013668+0000","last_became_peered":"2024-02-18T10:01:32.013668+0000","last_unstale":"2024-02-18T10:01:32.017170+0000","last_undegraded":"2024-02-18T10:01:32.017170+0000","last_fullsized":"2024-02-18T10:01:32.017170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:08.154709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.997499+0000","last_change":"2024-02-18T10:01:30.994919+0000","last_active":"2024-02-18T10:01:31.997499+0000","last_peered":"2024-02-18T10:01:31.997499+0000","last_clean":"2024-02-18T10:01:31.997499+0000","last_became_active":"2024-02-18T10:01:30.994650+0000","last_became_peered":"2024-02-18T10:01:30.994650+0000","last_unstale":"2024-02-18T10:01:31.997499+0000","last_undegraded":"2024-02-18T10:01:31.997499+0000","last_fullsized":"2024-02-18T10:01:31.997499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:26.847740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017884+0000","last_change":"2024-02-18T10:01:32.011605+0000","last_active":"2024-02-18T10:01:32.017884+0000","last_peered":"2024-02-18T10:01:32.017884+0000","last_clean":"2024-02-18T10:01:32.017884+0000","last_became_active":"2024-02-18T10:01:32.011335+0000","last_became_peered":"2024-02-18T10:01:32.011335+0000","last_unstale":"2024-02-18T10:01:32.017884+0000","last_undegraded":"2024-02-18T10:01:32.017884+0000","last_fullsized":"2024-02-18T10:01:32.017884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:21.646552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.005383+0000","last_change":"2024-02-18T10:01:31.003461+0000","last_active":"2024-02-18T10:01:32.005383+0000","last_peered":"2024-02-18T10:01:32.005383+0000","last_clean":"2024-02-18T10:01:32.005383+0000","last_became_active":"2024-02-18T10:01:31.003126+0000","last_became_peered":"2024-02-18T10:01:31.003126+0000","last_unstale":"2024-02-18T10:01:32.005383+0000","last_undegraded":"2024-02-18T10:01:32.005383+0000","last_fullsized":"2024-02-18T10:01:32.005383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:09.161810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014201+0000","last_change":"2024-02-18T10:01:32.010336+0000","last_active":"2024-02-18T10:01:32.014201+0000","last_peered":"2024-02-18T10:01:32.014201+0000","last_clean":"2024-02-18T10:01:32.014201+0000","last_became_active":"2024-02-18T10:01:32.010015+0000","last_became_peered":"2024-02-18T10:01:32.010015+0000","last_unstale":"2024-02-18T10:01:32.014201+0000","last_undegraded":"2024-02-18T10:01:32.014201+0000","last_fullsized":"2024-02-18T10:01:32.014201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:07:41.367699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.995653+0000","last_change":"2024-02-18T10:01:30.998263+0000","last_active":"2024-02-18T10:01:31.995653+0000","last_peered":"2024-02-18T10:01:31.995653+0000","last_clean":"2024-02-18T10:01:31.995653+0000","last_became_active":"2024-02-18T10:01:30.997137+0000","last_became_peered":"2024-02-18T10:01:30.997137+0000","last_unstale":"2024-02-18T10:01:31.995653+0000","last_undegraded":"2024-02-18T10:01:31.995653+0000","last_fullsized":"2024-02-18T10:01:31.995653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:33.115058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019330+0000","last_change":"2024-02-18T10:01:32.015283+0000","last_active":"2024-02-18T10:01:32.019330+0000","last_peered":"2024-02-18T10:01:32.019330+0000","last_clean":"2024-02-18T10:01:32.019330+0000","last_became_active":"2024-02-18T10:01:32.015043+0000","last_became_peered":"2024-02-18T10:01:32.015043+0000","last_unstale":"2024-02-18T10:01:32.019330+0000","last_undegraded":"2024-02-18T10:01:32.019330+0000","last_fullsized":"2024-02-18T10:01:32.019330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:45:21.010333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025142+0000","last_change":"2024-02-18T10:01:31.002295+0000","last_active":"2024-02-18T10:01:32.025142+0000","last_peered":"2024-02-18T10:01:32.025142+0000","last_clean":"2024-02-18T10:01:32.025142+0000","last_became_active":"2024-02-18T10:01:31.002021+0000","last_became_peered":"2024-02-18T10:01:31.002021+0000","last_unstale":"2024-02-18T10:01:32.025142+0000","last_undegraded":"2024-02-18T10:01:32.025142+0000","last_fullsized":"2024-02-18T10:01:32.025142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:04.557754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020522+0000","last_change":"2024-02-18T10:01:32.019250+0000","last_active":"2024-02-18T10:01:32.020522+0000","last_peered":"2024-02-18T10:01:32.020522+0000","last_clean":"2024-02-18T10:01:32.020522+0000","last_became_active":"2024-02-18T10:01:32.018533+0000","last_became_peered":"2024-02-18T10:01:32.018533+0000","last_unstale":"2024-02-18T10:01:32.020522+0000","last_undegraded":"2024-02-18T10:01:32.020522+0000","last_fullsized":"2024-02-18T10:01:32.020522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:25.356461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.027907+0000","last_change":"2024-02-18T10:01:31.005567+0000","last_active":"2024-02-18T10:01:32.027907+0000","last_peered":"2024-02-18T10:01:32.027907+0000","last_clean":"2024-02-18T10:01:32.027907+0000","last_became_active":"2024-02-18T10:01:31.005285+0000","last_became_peered":"2024-02-18T10:01:31.005285+0000","last_unstale":"2024-02-18T10:01:32.027907+0000","last_undegraded":"2024-02-18T10:01:32.027907+0000","last_fullsized":"2024-02-18T10:01:32.027907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:20.642526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019847+0000","last_change":"2024-02-18T10:01:32.017597+0000","last_active":"2024-02-18T10:01:32.019847+0000","last_peered":"2024-02-18T10:01:32.019847+0000","last_clean":"2024-02-18T10:01:32.019847+0000","last_became_active":"2024-02-18T10:01:32.017357+0000","last_became_peered":"2024-02-18T10:01:32.017357+0000","last_unstale":"2024-02-18T10:01:32.019847+0000","last_undegraded":"2024-02-18T10:01:32.019847+0000","last_fullsized":"2024-02-18T10:01:32.019847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:10.165836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024542+0000","last_change":"2024-02-18T10:01:30.996035+0000","last_active":"2024-02-18T10:01:32.024542+0000","last_peered":"2024-02-18T10:01:32.024542+0000","last_clean":"2024-02-18T10:01:32.024542+0000","last_became_active":"2024-02-18T10:01:30.995350+0000","last_became_peered":"2024-02-18T10:01:30.995350+0000","last_unstale":"2024-02-18T10:01:32.024542+0000","last_undegraded":"2024-02-18T10:01:32.024542+0000","last_fullsized":"2024-02-18T10:01:32.024542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:38:07.731801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019058+0000","last_change":"2024-02-18T10:01:32.011496+0000","last_active":"2024-02-18T10:01:32.019058+0000","last_peered":"2024-02-18T10:01:32.019058+0000","last_clean":"2024-02-18T10:01:32.019058+0000","last_became_active":"2024-02-18T10:01:32.011252+0000","last_became_peered":"2024-02-18T10:01:32.011252+0000","last_unstale":"2024-02-18T10:01:32.019058+0000","last_undegraded":"2024-02-18T10:01:32.019058+0000","last_fullsized":"2024-02-18T10:01:32.019058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:42:19.682939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.006611+0000","last_change":"2024-02-18T10:01:31.001637+0000","last_active":"2024-02-18T10:01:32.006611+0000","last_peered":"2024-02-18T10:01:32.006611+0000","last_clean":"2024-02-18T10:01:32.006611+0000","last_became_active":"2024-02-18T10:01:31.001386+0000","last_became_peered":"2024-02-18T10:01:31.001386+0000","last_unstale":"2024-02-18T10:01:32.006611+0000","last_undegraded":"2024-02-18T10:01:32.006611+0000","last_fullsized":"2024-02-18T10:01:32.006611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:23.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018752+0000","last_change":"2024-02-18T10:01:32.015793+0000","last_active":"2024-02-18T10:01:32.018752+0000","last_peered":"2024-02-18T10:01:32.018752+0000","last_clean":"2024-02-18T10:01:32.018752+0000","last_became_active":"2024-02-18T10:01:32.015538+0000","last_became_peered":"2024-02-18T10:01:32.015538+0000","last_unstale":"2024-02-18T10:01:32.018752+0000","last_undegraded":"2024-02-18T10:01:32.018752+0000","last_fullsized":"2024-02-18T10:01:32.018752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:08.154709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.004124+0000","last_change":"2024-02-18T10:01:31.003539+0000","last_active":"2024-02-18T10:01:32.004124+0000","last_peered":"2024-02-18T10:01:32.004124+0000","last_clean":"2024-02-18T10:01:32.004124+0000","last_became_active":"2024-02-18T10:01:31.003264+0000","last_became_peered":"2024-02-18T10:01:31.003264+0000","last_unstale":"2024-02-18T10:01:32.004124+0000","last_undegraded":"2024-02-18T10:01:32.004124+0000","last_fullsized":"2024-02-18T10:01:32.004124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:40.793804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012585+0000","last_change":"2024-02-18T10:01:32.003970+0000","last_active":"2024-02-18T10:01:32.012585+0000","last_peered":"2024-02-18T10:01:32.012585+0000","last_clean":"2024-02-18T10:01:32.012585+0000","last_became_active":"2024-02-18T10:01:32.003683+0000","last_became_peered":"2024-02-18T10:01:32.003683+0000","last_unstale":"2024-02-18T10:01:32.012585+0000","last_undegraded":"2024-02-18T10:01:32.012585+0000","last_fullsized":"2024-02-18T10:01:32.012585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:34.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.026838+0000","last_change":"2024-02-18T10:01:31.004909+0000","last_active":"2024-02-18T10:01:32.026838+0000","last_peered":"2024-02-18T10:01:32.026838+0000","last_clean":"2024-02-18T10:01:32.026838+0000","last_became_active":"2024-02-18T10:01:31.004625+0000","last_became_peered":"2024-02-18T10:01:31.004625+0000","last_unstale":"2024-02-18T10:01:32.026838+0000","last_undegraded":"2024-02-18T10:01:32.026838+0000","last_fullsized":"2024-02-18T10:01:32.026838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:07.150683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016539+0000","last_change":"2024-02-18T10:01:32.015082+0000","last_active":"2024-02-18T10:01:32.016539+0000","last_peered":"2024-02-18T10:01:32.016539+0000","last_clean":"2024-02-18T10:01:32.016539+0000","last_became_active":"2024-02-18T10:01:32.014779+0000","last_became_peered":"2024-02-18T10:01:32.014779+0000","last_unstale":"2024-02-18T10:01:32.016539+0000","last_undegraded":"2024-02-18T10:01:32.016539+0000","last_fullsized":"2024-02-18T10:01:32.016539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.026110+0000","last_change":"2024-02-18T10:01:31.005990+0000","last_active":"2024-02-18T10:01:32.026110+0000","last_peered":"2024-02-18T10:01:32.026110+0000","last_clean":"2024-02-18T10:01:32.026110+0000","last_became_active":"2024-02-18T10:01:31.005727+0000","last_became_peered":"2024-02-18T10:01:31.005727+0000","last_unstale":"2024-02-18T10:01:32.026110+0000","last_undegraded":"2024-02-18T10:01:32.026110+0000","last_fullsized":"2024-02-18T10:01:32.026110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:49.518163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020483+0000","last_change":"2024-02-18T10:01:32.019408+0000","last_active":"2024-02-18T10:01:32.020483+0000","last_peered":"2024-02-18T10:01:32.020483+0000","last_clean":"2024-02-18T10:01:32.020483+0000","last_became_active":"2024-02-18T10:01:32.014849+0000","last_became_peered":"2024-02-18T10:01:32.014849+0000","last_unstale":"2024-02-18T10:01:32.020483+0000","last_undegraded":"2024-02-18T10:01:32.020483+0000","last_fullsized":"2024-02-18T10:01:32.020483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:13:02.147073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.023042+0000","last_change":"2024-02-18T10:01:30.995875+0000","last_active":"2024-02-18T10:01:32.023042+0000","last_peered":"2024-02-18T10:01:32.023042+0000","last_clean":"2024-02-18T10:01:32.023042+0000","last_became_active":"2024-02-18T10:01:30.995575+0000","last_became_peered":"2024-02-18T10:01:30.995575+0000","last_unstale":"2024-02-18T10:01:32.023042+0000","last_undegraded":"2024-02-18T10:01:32.023042+0000","last_fullsized":"2024-02-18T10:01:32.023042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:02:50.504967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.010237+0000","last_change":"2024-02-18T10:01:32.007843+0000","last_active":"2024-02-18T10:01:32.010237+0000","last_peered":"2024-02-18T10:01:32.010237+0000","last_clean":"2024-02-18T10:01:32.010237+0000","last_became_active":"2024-02-18T10:01:32.007519+0000","last_became_peered":"2024-02-18T10:01:32.007519+0000","last_unstale":"2024-02-18T10:01:32.010237+0000","last_undegraded":"2024-02-18T10:01:32.010237+0000","last_fullsized":"2024-02-18T10:01:32.010237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024518+0000","last_change":"2024-02-18T10:01:30.998810+0000","last_active":"2024-02-18T10:01:32.024518+0000","last_peered":"2024-02-18T10:01:32.024518+0000","last_clean":"2024-02-18T10:01:32.024518+0000","last_became_active":"2024-02-18T10:01:30.998565+0000","last_became_peered":"2024-02-18T10:01:30.998565+0000","last_unstale":"2024-02-18T10:01:32.024518+0000","last_undegraded":"2024-02-18T10:01:32.024518+0000","last_fullsized":"2024-02-18T10:01:32.024518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:48:37.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016298+0000","last_change":"2024-02-18T10:01:32.010085+0000","last_active":"2024-02-18T10:01:32.016298+0000","last_peered":"2024-02-18T10:01:32.016298+0000","last_clean":"2024-02-18T10:01:32.016298+0000","last_became_active":"2024-02-18T10:01:32.009828+0000","last_became_peered":"2024-02-18T10:01:32.009828+0000","last_unstale":"2024-02-18T10:01:32.016298+0000","last_undegraded":"2024-02-18T10:01:32.016298+0000","last_fullsized":"2024-02-18T10:01:32.016298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:58.956726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.998285+0000","last_change":"2024-02-18T10:01:31.000640+0000","last_active":"2024-02-18T10:01:31.998285+0000","last_peered":"2024-02-18T10:01:31.998285+0000","last_clean":"2024-02-18T10:01:31.998285+0000","last_became_active":"2024-02-18T10:01:31.000373+0000","last_became_peered":"2024-02-18T10:01:31.000373+0000","last_unstale":"2024-02-18T10:01:31.998285+0000","last_undegraded":"2024-02-18T10:01:31.998285+0000","last_fullsized":"2024-02-18T10:01:31.998285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:40.032837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021433+0000","last_change":"2024-02-18T10:01:32.015356+0000","last_active":"2024-02-18T10:01:32.021433+0000","last_peered":"2024-02-18T10:01:32.021433+0000","last_clean":"2024-02-18T10:01:32.021433+0000","last_became_active":"2024-02-18T10:01:32.015018+0000","last_became_peered":"2024-02-18T10:01:32.015018+0000","last_unstale":"2024-02-18T10:01:32.021433+0000","last_undegraded":"2024-02-18T10:01:32.021433+0000","last_fullsized":"2024-02-18T10:01:32.021433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:20.690742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022698+0000","last_change":"2024-02-18T10:01:30.998557+0000","last_active":"2024-02-18T10:01:32.022698+0000","last_peered":"2024-02-18T10:01:32.022698+0000","last_clean":"2024-02-18T10:01:32.022698+0000","last_became_active":"2024-02-18T10:01:30.998296+0000","last_became_peered":"2024-02-18T10:01:30.998296+0000","last_unstale":"2024-02-18T10:01:32.022698+0000","last_undegraded":"2024-02-18T10:01:32.022698+0000","last_fullsized":"2024-02-18T10:01:32.022698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:38:07.731801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017791+0000","last_change":"2024-02-18T10:01:32.011821+0000","last_active":"2024-02-18T10:01:32.017791+0000","last_peered":"2024-02-18T10:01:32.017791+0000","last_clean":"2024-02-18T10:01:32.017791+0000","last_became_active":"2024-02-18T10:01:32.011561+0000","last_became_peered":"2024-02-18T10:01:32.011561+0000","last_unstale":"2024-02-18T10:01:32.017791+0000","last_undegraded":"2024-02-18T10:01:32.017791+0000","last_fullsized":"2024-02-18T10:01:32.017791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:10.623807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.999519+0000","last_change":"2024-02-18T10:01:30.997943+0000","last_active":"2024-02-18T10:01:31.999519+0000","last_peered":"2024-02-18T10:01:31.999519+0000","last_clean":"2024-02-18T10:01:31.999519+0000","last_became_active":"2024-02-18T10:01:30.997659+0000","last_became_peered":"2024-02-18T10:01:30.997659+0000","last_unstale":"2024-02-18T10:01:31.999519+0000","last_undegraded":"2024-02-18T10:01:31.999519+0000","last_fullsized":"2024-02-18T10:01:31.999519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:38:07.731801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017764+0000","last_change":"2024-02-18T10:01:32.011845+0000","last_active":"2024-02-18T10:01:32.017764+0000","last_peered":"2024-02-18T10:01:32.017764+0000","last_clean":"2024-02-18T10:01:32.017764+0000","last_became_active":"2024-02-18T10:01:32.011602+0000","last_became_peered":"2024-02-18T10:01:32.011602+0000","last_unstale":"2024-02-18T10:01:32.017764+0000","last_undegraded":"2024-02-18T10:01:32.017764+0000","last_fullsized":"2024-02-18T10:01:32.017764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:02.126849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.997697+0000","last_change":"2024-02-18T10:01:31.000493+0000","last_active":"2024-02-18T10:01:31.997697+0000","last_peered":"2024-02-18T10:01:31.997697+0000","last_clean":"2024-02-18T10:01:31.997697+0000","last_became_active":"2024-02-18T10:01:30.999565+0000","last_became_peered":"2024-02-18T10:01:30.999565+0000","last_unstale":"2024-02-18T10:01:31.997697+0000","last_undegraded":"2024-02-18T10:01:31.997697+0000","last_fullsized":"2024-02-18T10:01:31.997697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:41:30.442929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019499+0000","last_change":"2024-02-18T10:01:32.016656+0000","last_active":"2024-02-18T10:01:32.019499+0000","last_peered":"2024-02-18T10:01:32.019499+0000","last_clean":"2024-02-18T10:01:32.019499+0000","last_became_active":"2024-02-18T10:01:32.016396+0000","last_became_peered":"2024-02-18T10:01:32.016396+0000","last_unstale":"2024-02-18T10:01:32.019499+0000","last_undegraded":"2024-02-18T10:01:32.019499+0000","last_fullsized":"2024-02-18T10:01:32.019499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:21.646552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.004054+0000","last_change":"2024-02-18T10:01:31.001682+0000","last_active":"2024-02-18T10:01:32.004054+0000","last_peered":"2024-02-18T10:01:32.004054+0000","last_clean":"2024-02-18T10:01:32.004054+0000","last_became_active":"2024-02-18T10:01:31.001415+0000","last_became_peered":"2024-02-18T10:01:31.001415+0000","last_unstale":"2024-02-18T10:01:32.004054+0000","last_undegraded":"2024-02-18T10:01:32.004054+0000","last_fullsized":"2024-02-18T10:01:32.004054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:29.924961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021364+0000","last_change":"2024-02-18T10:01:32.014521+0000","last_active":"2024-02-18T10:01:32.021364+0000","last_peered":"2024-02-18T10:01:32.021364+0000","last_clean":"2024-02-18T10:01:32.021364+0000","last_became_active":"2024-02-18T10:01:32.014265+0000","last_became_peered":"2024-02-18T10:01:32.014265+0000","last_unstale":"2024-02-18T10:01:32.021364+0000","last_undegraded":"2024-02-18T10:01:32.021364+0000","last_fullsized":"2024-02-18T10:01:32.021364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:41:31.446955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024676+0000","last_change":"2024-02-18T10:01:31.001439+0000","last_active":"2024-02-18T10:01:32.024676+0000","last_peered":"2024-02-18T10:01:32.024676+0000","last_clean":"2024-02-18T10:01:32.024676+0000","last_became_active":"2024-02-18T10:01:31.000801+0000","last_became_peered":"2024-02-18T10:01:31.000801+0000","last_unstale":"2024-02-18T10:01:32.024676+0000","last_undegraded":"2024-02-18T10:01:32.024676+0000","last_fullsized":"2024-02-18T10:01:32.024676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:29.924961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022639+0000","last_change":"2024-02-18T10:01:32.019730+0000","last_active":"2024-02-18T10:01:32.022639+0000","last_peered":"2024-02-18T10:01:32.022639+0000","last_clean":"2024-02-18T10:01:32.022639+0000","last_became_active":"2024-02-18T10:01:32.018877+0000","last_became_peered":"2024-02-18T10:01:32.018877+0000","last_unstale":"2024-02-18T10:01:32.022639+0000","last_undegraded":"2024-02-18T10:01:32.022639+0000","last_fullsized":"2024-02-18T10:01:32.022639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:56:51.707365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.995748+0000","last_change":"2024-02-18T10:01:30.996979+0000","last_active":"2024-02-18T10:01:31.995748+0000","last_peered":"2024-02-18T10:01:31.995748+0000","last_clean":"2024-02-18T10:01:31.995748+0000","last_became_active":"2024-02-18T10:01:30.996713+0000","last_became_peered":"2024-02-18T10:01:30.996713+0000","last_unstale":"2024-02-18T10:01:31.995748+0000","last_undegraded":"2024-02-18T10:01:31.995748+0000","last_fullsized":"2024-02-18T10:01:31.995748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:38.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020186+0000","last_change":"2024-02-18T10:01:32.018388+0000","last_active":"2024-02-18T10:01:32.020186+0000","last_peered":"2024-02-18T10:01:32.020186+0000","last_clean":"2024-02-18T10:01:32.020186+0000","last_became_active":"2024-02-18T10:01:32.018150+0000","last_became_peered":"2024-02-18T10:01:32.018150+0000","last_unstale":"2024-02-18T10:01:32.020186+0000","last_undegraded":"2024-02-18T10:01:32.020186+0000","last_fullsized":"2024-02-18T10:01:32.020186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.007315+0000","last_change":"2024-02-18T10:01:30.999711+0000","last_active":"2024-02-18T10:01:32.007315+0000","last_peered":"2024-02-18T10:01:32.007315+0000","last_clean":"2024-02-18T10:01:32.007315+0000","last_became_active":"2024-02-18T10:01:30.999466+0000","last_became_peered":"2024-02-18T10:01:30.999466+0000","last_unstale":"2024-02-18T10:01:32.007315+0000","last_undegraded":"2024-02-18T10:01:32.007315+0000","last_fullsized":"2024-02-18T10:01:32.007315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:38.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.002967+0000","last_change":"2024-02-18T10:01:32.001245+0000","last_active":"2024-02-18T10:01:32.002967+0000","last_peered":"2024-02-18T10:01:32.002967+0000","last_clean":"2024-02-18T10:01:32.002967+0000","last_became_active":"2024-02-18T10:01:32.000963+0000","last_became_peered":"2024-02-18T10:01:32.000963+0000","last_unstale":"2024-02-18T10:01:32.002967+0000","last_undegraded":"2024-02-18T10:01:32.002967+0000","last_fullsized":"2024-02-18T10:01:32.002967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:24.086527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.995628+0000","last_change":"2024-02-18T10:01:30.999143+0000","last_active":"2024-02-18T10:01:31.995628+0000","last_peered":"2024-02-18T10:01:31.995628+0000","last_clean":"2024-02-18T10:01:31.995628+0000","last_became_active":"2024-02-18T10:01:30.998871+0000","last_became_peered":"2024-02-18T10:01:30.998871+0000","last_unstale":"2024-02-18T10:01:31.995628+0000","last_undegraded":"2024-02-18T10:01:31.995628+0000","last_fullsized":"2024-02-18T10:01:31.995628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:23.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.006558+0000","last_change":"2024-02-18T10:01:32.002618+0000","last_active":"2024-02-18T10:01:32.006558+0000","last_peered":"2024-02-18T10:01:32.006558+0000","last_clean":"2024-02-18T10:01:32.006558+0000","last_became_active":"2024-02-18T10:01:32.002360+0000","last_became_peered":"2024-02-18T10:01:32.002360+0000","last_unstale":"2024-02-18T10:01:32.006558+0000","last_undegraded":"2024-02-18T10:01:32.006558+0000","last_fullsized":"2024-02-18T10:01:32.006558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:50.522189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.006740+0000","last_change":"2024-02-18T10:01:31.001025+0000","last_active":"2024-02-18T10:01:32.006740+0000","last_peered":"2024-02-18T10:01:32.006740+0000","last_clean":"2024-02-18T10:01:32.006740+0000","last_became_active":"2024-02-18T10:01:31.000773+0000","last_became_peered":"2024-02-18T10:01:31.000773+0000","last_unstale":"2024-02-18T10:01:32.006740+0000","last_undegraded":"2024-02-18T10:01:32.006740+0000","last_fullsized":"2024-02-18T10:01:32.006740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:33.115058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013815+0000","last_change":"2024-02-18T10:01:32.008812+0000","last_active":"2024-02-18T10:01:32.013815+0000","last_peered":"2024-02-18T10:01:32.013815+0000","last_clean":"2024-02-18T10:01:32.013815+0000","last_became_active":"2024-02-18T10:01:32.008015+0000","last_became_peered":"2024-02-18T10:01:32.008015+0000","last_unstale":"2024-02-18T10:01:32.013815+0000","last_undegraded":"2024-02-18T10:01:32.013815+0000","last_fullsized":"2024-02-18T10:01:32.013815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:13:02.147073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.998255+0000","last_change":"2024-02-18T10:01:31.001802+0000","last_active":"2024-02-18T10:01:31.998255+0000","last_peered":"2024-02-18T10:01:31.998255+0000","last_clean":"2024-02-18T10:01:31.998255+0000","last_became_active":"2024-02-18T10:01:31.000880+0000","last_became_peered":"2024-02-18T10:01:31.000880+0000","last_unstale":"2024-02-18T10:01:31.998255+0000","last_undegraded":"2024-02-18T10:01:31.998255+0000","last_fullsized":"2024-02-18T10:01:31.998255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:19.686715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013881+0000","last_change":"2024-02-18T10:01:32.007909+0000","last_active":"2024-02-18T10:01:32.013881+0000","last_peered":"2024-02-18T10:01:32.013881+0000","last_clean":"2024-02-18T10:01:32.013881+0000","last_became_active":"2024-02-18T10:01:32.007621+0000","last_became_peered":"2024-02-18T10:01:32.007621+0000","last_unstale":"2024-02-18T10:01:32.013881+0000","last_undegraded":"2024-02-18T10:01:32.013881+0000","last_fullsized":"2024-02-18T10:01:32.013881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:34.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.003496+0000","last_change":"2024-02-18T10:01:31.002715+0000","last_active":"2024-02-18T10:01:32.003496+0000","last_peered":"2024-02-18T10:01:32.003496+0000","last_clean":"2024-02-18T10:01:32.003496+0000","last_became_active":"2024-02-18T10:01:31.002463+0000","last_became_peered":"2024-02-18T10:01:31.002463+0000","last_unstale":"2024-02-18T10:01:32.003496+0000","last_undegraded":"2024-02-18T10:01:32.003496+0000","last_fullsized":"2024-02-18T10:01:32.003496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:50.680558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022539+0000","last_change":"2024-02-18T10:01:32.021461+0000","last_active":"2024-02-18T10:01:32.022539+0000","last_peered":"2024-02-18T10:01:32.022539+0000","last_clean":"2024-02-18T10:01:32.022539+0000","last_became_active":"2024-02-18T10:01:32.021132+0000","last_became_peered":"2024-02-18T10:01:32.021132+0000","last_unstale":"2024-02-18T10:01:32.022539+0000","last_undegraded":"2024-02-18T10:01:32.022539+0000","last_fullsized":"2024-02-18T10:01:32.022539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:13:02.147073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.998216+0000","last_change":"2024-02-18T10:01:30.998749+0000","last_active":"2024-02-18T10:01:31.998216+0000","last_peered":"2024-02-18T10:01:31.998216+0000","last_clean":"2024-02-18T10:01:31.998216+0000","last_became_active":"2024-02-18T10:01:30.998449+0000","last_became_peered":"2024-02-18T10:01:30.998449+0000","last_unstale":"2024-02-18T10:01:31.998216+0000","last_undegraded":"2024-02-18T10:01:31.998216+0000","last_fullsized":"2024-02-18T10:01:31.998216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:06:08.144301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.007286+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:01:32.007286+0000","last_peered":"2024-02-18T10:01:32.007286+0000","last_clean":"2024-02-18T10:01:32.007286+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:01:32.007286+0000","last_undegraded":"2024-02-18T10:01:32.007286+0000","last_fullsized":"2024-02-18T10:01:32.007286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:01:34.957 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T10:01:35.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.091+0000 7f20d069d640 1 Processor -- start 2024-02-18T10:01:35.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.091+0000 7f20d069d640 1 -- start start 2024-02-18T10:01:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20d069d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c8072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20d069d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20c8148900 0x7f20c8148d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20d069d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c80b9810 con 0x7f20c806e090 2024-02-18T10:01:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20d069d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c8072a40 con 0x7f20c8148900 2024-02-18T10:01:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20d069d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80b9a30 con 0x7f20c80b93f0 2024-02-18T10:01:35.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20cec3a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20c8148900 0x7f20c8148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20cec3a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20c8148900 0x7f20c8148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55186/0 (socket says 172.21.15.118:55186) 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.092+0000 7f20cec3a640 1 -- 172.21.15.118:0/2229995276 learned_addr learned my addr 172.21.15.118:0/2229995276 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.093+0000 7f20cdc38640 1 --2- 172.21.15.118:0/2229995276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c8072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.093+0000 7f20cec3a640 1 -- 172.21.15.118:0/2229995276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 msgr2=0x7f20c8072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.093+0000 7f20cec3a640 1 --2- 172.21.15.118:0/2229995276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c8072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.093+0000 7f20cec3a640 1 -- 172.21.15.118:0/2229995276 >> v1:172.21.15.164:6789/0 conn(0x7f20c806e090 legacy=0x7f20c8142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.093+0000 7f20cec3a640 1 -- 172.21.15.118:0/2229995276 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c80ba440 con 0x7f20c8148900 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.093+0000 7f20cec3a640 1 --2- 172.21.15.118:0/2229995276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8148d90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009e50 tx=0x7f20c002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769649622f005fdc server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20cd437640 1 -- 172.21.15.118:0/2229995276 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c002cb00 con 0x7f20c8148900 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20cd437640 1 -- 172.21.15.118:0/2229995276 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c002cc60 con 0x7f20c8148900 2024-02-18T10:01:35.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20cd437640 1 -- 172.21.15.118:0/2229995276 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00343f0 con 0x7f20c8148900 2024-02-18T10:01:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 -- 172.21.15.118:0/2229995276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 msgr2=0x7f20c8148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 --2- 172.21.15.118:0/2229995276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8148d90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009e50 tx=0x7f20c002bf60 comp rx=0 tx=0).stop 2024-02-18T10:01:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 -- 172.21.15.118:0/2229995276 shutdown_connections 2024-02-18T10:01:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 --2- 172.21.15.118:0/2229995276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8148d90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 --2- 172.21.15.118:0/2229995276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c8072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 -- 172.21.15.118:0/2229995276 >> 172.21.15.118:0/2229995276 conn(0x7f20c80bb1d0 msgr2=0x7f20c80bb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:35.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 -- 172.21.15.118:0/2229995276 shutdown_connections 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.094+0000 7f20d069d640 1 -- 172.21.15.118:0/2229995276 wait complete. 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.095+0000 7f20d069d640 1 Processor -- start 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.095+0000 7f20d069d640 1 -- start start 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20d069d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c806e090 0x7f20c81379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20d069d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c81478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20d069d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20d069d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8154d90 con 0x7f20c8148900 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20d069d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8147e30 con 0x7f20c806e090 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20d069d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8154a40 con 0x7f20c80b93f0 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8136610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55202/0 (socket says 172.21.15.118:55202) 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 -- 172.21.15.118:0/1607533428 learned_addr learned my addr 172.21.15.118:0/1607533428 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:35.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20ce439640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c806e090 0x7f20c81379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cdc38640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c81478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 -- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 msgr2=0x7f20c81478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c81478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 -- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c806e090 msgr2=0x7f20c81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c806e090 0x7f20c81379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 -- 172.21.15.118:0/1607533428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0009b30 con 0x7f20c8148900 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.096+0000 7f20cec3a640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8136610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009e50 tx=0x7f20c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.097+0000 7f20beffd640 1 -- 172.21.15.118:0/1607533428 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0009510 con 0x7f20c8148900 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.097+0000 7f20beffd640 1 -- 172.21.15.118:0/1607533428 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c003e450 con 0x7f20c8148900 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.097+0000 7f20beffd640 1 -- 172.21.15.118:0/1607533428 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c003e7e0 con 0x7f20c8148900 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.097+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c8155d00 con 0x7f20c8148900 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.097+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c80a4490 con 0x7f20c8148900 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.098+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c8154ed0 con 0x7f20c8148900 2024-02-18T10:01:35.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.098+0000 7f20beffd640 1 -- 172.21.15.118:0/1607533428 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f20c003e940 con 0x7f20c8148900 2024-02-18T10:01:35.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.098+0000 7f20beffd640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f20ac06bc70 0x7f20ac06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.098+0000 7f20ce439640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f20ac06bc70 0x7f20ac06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.098+0000 7f20beffd640 1 -- 172.21.15.118:0/1607533428 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20c00ad6d0 con 0x7f20c8148900 2024-02-18T10:01:35.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.099+0000 7f20ce439640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f20ac06bc70 0x7f20ac06e130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20b8003d90 tx=0x7f20b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.103+0000 7f20beffd640 1 -- 172.21.15.118:0/1607533428 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20c8154ed0 con 0x7f20c8148900 2024-02-18T10:01:35.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.270+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20c80b9c40 con 0x7f20ac06bc70 2024-02-18T10:01:35.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.275+0000 7f20beffd640 1 -- 172.21.15.118:0/1607533428 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251879 (secure 0 0 0) 0x7f20b8003a30 con 0x7f20ac06bc70 2024-02-18T10:01:35.281 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:35.282 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f20ac06bc70 msgr2=0x7f20ac06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f20ac06bc70 0x7f20ac06e130 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20b8003d90 tx=0x7f20b8009040 comp rx=0 tx=0).stop 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 msgr2=0x7f20c8136610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8136610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009e50 tx=0x7f20c0004a40 comp rx=0 tx=0).stop 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 shutdown_connections 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f20ac06bc70 0x7f20ac06e130 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20c8148900 0x7f20c8136610 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f20c80b93f0 0x7f20c81478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 --2- 172.21.15.118:0/1607533428 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f20c806e090 0x7f20c81379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 >> 172.21.15.118:0/1607533428 conn(0x7f20c80bb1d0 msgr2=0x7f20c81408e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 shutdown_connections 2024-02-18T10:01:35.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.278+0000 7f20d069d640 1 -- 172.21.15.118:0/1607533428 wait complete. 2024-02-18T10:01:35.292 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-02-18T10:01:33.286622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236564,"kb_used_data":3744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738156,"statfs":{"total":773094113280,"available":772851871744,"internally_reserved":0,"allocated":3833856,"data_stored":2162874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000623"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014717+0000","last_change":"2024-02-18T10:01:32.013284+0000","last_active":"2024-02-18T10:01:32.014717+0000","last_peered":"2024-02-18T10:01:32.014717+0000","last_clean":"2024-02-18T10:01:32.014717+0000","last_became_active":"2024-02-18T10:01:32.013003+0000","last_became_peered":"2024-02-18T10:01:32.013003+0000","last_unstale":"2024-02-18T10:01:32.014717+0000","last_undegraded":"2024-02-18T10:01:32.014717+0000","last_fullsized":"2024-02-18T10:01:32.014717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:50.522189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013765+0000","last_change":"2024-02-18T10:01:32.006793+0000","last_active":"2024-02-18T10:01:32.013765+0000","last_peered":"2024-02-18T10:01:32.013765+0000","last_clean":"2024-02-18T10:01:32.013765+0000","last_became_active":"2024-02-18T10:01:32.006539+0000","last_became_peered":"2024-02-18T10:01:32.006539+0000","last_unstale":"2024-02-18T10:01:32.013765+0000","last_undegraded":"2024-02-18T10:01:32.013765+0000","last_fullsized":"2024-02-18T10:01:32.013765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:25.356461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020501+0000","last_change":"2024-02-18T10:01:32.018806+0000","last_active":"2024-02-18T10:01:32.020501+0000","last_peered":"2024-02-18T10:01:32.020501+0000","last_clean":"2024-02-18T10:01:32.020501+0000","last_became_active":"2024-02-18T10:01:32.018040+0000","last_became_peered":"2024-02-18T10:01:32.018040+0000","last_unstale":"2024-02-18T10:01:32.020501+0000","last_undegraded":"2024-02-18T10:01:32.020501+0000","last_fullsized":"2024-02-18T10:01:32.020501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:10.165836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017837+0000","last_change":"2024-02-18T10:01:32.015991+0000","last_active":"2024-02-18T10:01:32.017837+0000","last_peered":"2024-02-18T10:01:32.017837+0000","last_clean":"2024-02-18T10:01:32.017837+0000","last_became_active":"2024-02-18T10:01:32.015740+0000","last_became_peered":"2024-02-18T10:01:32.015740+0000","last_unstale":"2024-02-18T10:01:32.017837+0000","last_undegraded":"2024-02-18T10:01:32.017837+0000","last_fullsized":"2024-02-18T10:01:32.017837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:32.398447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016234+0000","last_change":"2024-02-18T10:01:32.007168+0000","last_active":"2024-02-18T10:01:32.016234+0000","last_peered":"2024-02-18T10:01:32.016234+0000","last_clean":"2024-02-18T10:01:32.016234+0000","last_became_active":"2024-02-18T10:01:32.006892+0000","last_became_peered":"2024-02-18T10:01:32.006892+0000","last_unstale":"2024-02-18T10:01:32.016234+0000","last_undegraded":"2024-02-18T10:01:32.016234+0000","last_fullsized":"2024-02-18T10:01:32.016234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:27:46.992409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022292+0000","last_change":"2024-02-18T10:01:32.018232+0000","last_active":"2024-02-18T10:01:32.022292+0000","last_peered":"2024-02-18T10:01:32.022292+0000","last_clean":"2024-02-18T10:01:32.022292+0000","last_became_active":"2024-02-18T10:01:32.017891+0000","last_became_peered":"2024-02-18T10:01:32.017891+0000","last_unstale":"2024-02-18T10:01:32.022292+0000","last_undegraded":"2024-02-18T10:01:32.022292+0000","last_fullsized":"2024-02-18T10:01:32.022292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:25:21.476136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019612+0000","last_change":"2024-02-18T10:01:32.017224+0000","last_active":"2024-02-18T10:01:32.019612+0000","last_peered":"2024-02-18T10:01:32.019612+0000","last_clean":"2024-02-18T10:01:32.019612+0000","last_became_active":"2024-02-18T10:01:32.016933+0000","last_became_peered":"2024-02-18T10:01:32.016933+0000","last_unstale":"2024-02-18T10:01:32.019612+0000","last_undegraded":"2024-02-18T10:01:32.019612+0000","last_fullsized":"2024-02-18T10:01:32.019612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:10.165836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019773+0000","last_change":"2024-02-18T10:01:32.017347+0000","last_active":"2024-02-18T10:01:32.019773+0000","last_peered":"2024-02-18T10:01:32.019773+0000","last_clean":"2024-02-18T10:01:32.019773+0000","last_became_active":"2024-02-18T10:01:32.017061+0000","last_became_peered":"2024-02-18T10:01:32.017061+0000","last_unstale":"2024-02-18T10:01:32.019773+0000","last_undegraded":"2024-02-18T10:01:32.019773+0000","last_fullsized":"2024-02-18T10:01:32.019773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:25.356461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013830+0000","last_change":"2024-02-18T10:01:32.009564+0000","last_active":"2024-02-18T10:01:32.013830+0000","last_peered":"2024-02-18T10:01:32.013830+0000","last_clean":"2024-02-18T10:01:32.013830+0000","last_became_active":"2024-02-18T10:01:32.009270+0000","last_became_peered":"2024-02-18T10:01:32.009270+0000","last_unstale":"2024-02-18T10:01:32.013830+0000","last_undegraded":"2024-02-18T10:01:32.013830+0000","last_fullsized":"2024-02-18T10:01:32.013830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:30.928987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017276+0000","last_change":"2024-02-18T10:01:32.015820+0000","last_active":"2024-02-18T10:01:32.017276+0000","last_peered":"2024-02-18T10:01:32.017276+0000","last_clean":"2024-02-18T10:01:32.017276+0000","last_became_active":"2024-02-18T10:01:32.015588+0000","last_became_peered":"2024-02-18T10:01:32.015588+0000","last_unstale":"2024-02-18T10:01:32.017276+0000","last_undegraded":"2024-02-18T10:01:32.017276+0000","last_fullsized":"2024-02-18T10:01:32.017276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:41.797830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019295+0000","last_change":"2024-02-18T10:01:32.016301+0000","last_active":"2024-02-18T10:01:32.019295+0000","last_peered":"2024-02-18T10:01:32.019295+0000","last_clean":"2024-02-18T10:01:32.019295+0000","last_became_active":"2024-02-18T10:01:32.016020+0000","last_became_peered":"2024-02-18T10:01:32.016020+0000","last_unstale":"2024-02-18T10:01:32.019295+0000","last_undegraded":"2024-02-18T10:01:32.019295+0000","last_fullsized":"2024-02-18T10:01:32.019295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:32.398447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019756+0000","last_change":"2024-02-18T10:01:32.014235+0000","last_active":"2024-02-18T10:01:32.019756+0000","last_peered":"2024-02-18T10:01:32.019756+0000","last_clean":"2024-02-18T10:01:32.019756+0000","last_became_active":"2024-02-18T10:01:32.013955+0000","last_became_peered":"2024-02-18T10:01:32.013955+0000","last_unstale":"2024-02-18T10:01:32.019756+0000","last_undegraded":"2024-02-18T10:01:32.019756+0000","last_fullsized":"2024-02-18T10:01:32.019756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:01.851993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016271+0000","last_change":"2024-02-18T10:01:32.008875+0000","last_active":"2024-02-18T10:01:32.016271+0000","last_peered":"2024-02-18T10:01:32.016271+0000","last_clean":"2024-02-18T10:01:32.016271+0000","last_became_active":"2024-02-18T10:01:32.008616+0000","last_became_peered":"2024-02-18T10:01:32.008616+0000","last_unstale":"2024-02-18T10:01:32.016271+0000","last_undegraded":"2024-02-18T10:01:32.016271+0000","last_fullsized":"2024-02-18T10:01:32.016271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:05:03.795424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019105+0000","last_change":"2024-02-18T10:01:32.015343+0000","last_active":"2024-02-18T10:01:32.019105+0000","last_peered":"2024-02-18T10:01:32.019105+0000","last_clean":"2024-02-18T10:01:32.019105+0000","last_became_active":"2024-02-18T10:01:32.015090+0000","last_became_peered":"2024-02-18T10:01:32.015090+0000","last_unstale":"2024-02-18T10:01:32.019105+0000","last_undegraded":"2024-02-18T10:01:32.019105+0000","last_fullsized":"2024-02-18T10:01:32.019105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T12:44:06.107041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012441+0000","last_change":"2024-02-18T10:01:32.006641+0000","last_active":"2024-02-18T10:01:32.012441+0000","last_peered":"2024-02-18T10:01:32.012441+0000","last_clean":"2024-02-18T10:01:32.012441+0000","last_became_active":"2024-02-18T10:01:32.006324+0000","last_became_peered":"2024-02-18T10:01:32.006324+0000","last_unstale":"2024-02-18T10:01:32.012441+0000","last_undegraded":"2024-02-18T10:01:32.012441+0000","last_fullsized":"2024-02-18T10:01:32.012441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019574+0000","last_change":"2024-02-18T10:01:32.017044+0000","last_active":"2024-02-18T10:01:32.019574+0000","last_peered":"2024-02-18T10:01:32.019574+0000","last_clean":"2024-02-18T10:01:32.019574+0000","last_became_active":"2024-02-18T10:01:32.015807+0000","last_became_peered":"2024-02-18T10:01:32.015807+0000","last_unstale":"2024-02-18T10:01:32.019574+0000","last_undegraded":"2024-02-18T10:01:32.019574+0000","last_fullsized":"2024-02-18T10:01:32.019574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:01.851993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014626+0000","last_change":"2024-02-18T10:01:32.013675+0000","last_active":"2024-02-18T10:01:32.014626+0000","last_peered":"2024-02-18T10:01:32.014626+0000","last_clean":"2024-02-18T10:01:32.014626+0000","last_became_active":"2024-02-18T10:01:32.013404+0000","last_became_peered":"2024-02-18T10:01:32.013404+0000","last_unstale":"2024-02-18T10:01:32.014626+0000","last_undegraded":"2024-02-18T10:01:32.014626+0000","last_fullsized":"2024-02-18T10:01:32.014626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019152+0000","last_change":"2024-02-18T10:01:32.010452+0000","last_active":"2024-02-18T10:01:32.019152+0000","last_peered":"2024-02-18T10:01:32.019152+0000","last_clean":"2024-02-18T10:01:32.019152+0000","last_became_active":"2024-02-18T10:01:32.010168+0000","last_became_peered":"2024-02-18T10:01:32.010168+0000","last_unstale":"2024-02-18T10:01:32.019152+0000","last_undegraded":"2024-02-18T10:01:32.019152+0000","last_fullsized":"2024-02-18T10:01:32.019152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:16:34.961345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014097+0000","last_change":"2024-02-18T10:01:32.009599+0000","last_active":"2024-02-18T10:01:32.014097+0000","last_peered":"2024-02-18T10:01:32.014097+0000","last_clean":"2024-02-18T10:01:32.014097+0000","last_became_active":"2024-02-18T10:01:32.009347+0000","last_became_peered":"2024-02-18T10:01:32.009347+0000","last_unstale":"2024-02-18T10:01:32.014097+0000","last_undegraded":"2024-02-18T10:01:32.014097+0000","last_fullsized":"2024-02-18T10:01:32.014097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:56:51.707365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017825+0000","last_change":"2024-02-18T10:01:32.013355+0000","last_active":"2024-02-18T10:01:32.017825+0000","last_peered":"2024-02-18T10:01:32.017825+0000","last_clean":"2024-02-18T10:01:32.017825+0000","last_became_active":"2024-02-18T10:01:32.013116+0000","last_became_peered":"2024-02-18T10:01:32.013116+0000","last_unstale":"2024-02-18T10:01:32.017825+0000","last_undegraded":"2024-02-18T10:01:32.017825+0000","last_fullsized":"2024-02-18T10:01:32.017825+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:27.851767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.002431+0000","last_change":"2024-02-18T10:01:32.000348+0000","last_active":"2024-02-18T10:01:32.002431+0000","last_peered":"2024-02-18T10:01:32.002431+0000","last_clean":"2024-02-18T10:01:32.002431+0000","last_became_active":"2024-02-18T10:01:32.000075+0000","last_became_peered":"2024-02-18T10:01:32.000075+0000","last_unstale":"2024-02-18T10:01:32.002431+0000","last_undegraded":"2024-02-18T10:01:32.002431+0000","last_fullsized":"2024-02-18T10:01:32.002431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:48.364320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014193+0000","last_change":"2024-02-18T10:01:32.009713+0000","last_active":"2024-02-18T10:01:32.014193+0000","last_peered":"2024-02-18T10:01:32.014193+0000","last_clean":"2024-02-18T10:01:32.014193+0000","last_became_active":"2024-02-18T10:01:32.009424+0000","last_became_peered":"2024-02-18T10:01:32.009424+0000","last_unstale":"2024-02-18T10:01:32.014193+0000","last_undegraded":"2024-02-18T10:01:32.014193+0000","last_fullsized":"2024-02-18T10:01:32.014193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013743+0000","last_change":"2024-02-18T10:01:32.010116+0000","last_active":"2024-02-18T10:01:32.013743+0000","last_peered":"2024-02-18T10:01:32.013743+0000","last_clean":"2024-02-18T10:01:32.013743+0000","last_became_active":"2024-02-18T10:01:32.009640+0000","last_became_peered":"2024-02-18T10:01:32.009640+0000","last_unstale":"2024-02-18T10:01:32.013743+0000","last_undegraded":"2024-02-18T10:01:32.013743+0000","last_fullsized":"2024-02-18T10:01:32.013743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:30.928987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012499+0000","last_change":"2024-02-18T10:01:32.008668+0000","last_active":"2024-02-18T10:01:32.012499+0000","last_peered":"2024-02-18T10:01:32.012499+0000","last_clean":"2024-02-18T10:01:32.012499+0000","last_became_active":"2024-02-18T10:01:32.008240+0000","last_became_peered":"2024-02-18T10:01:32.008240+0000","last_unstale":"2024-02-18T10:01:32.012499+0000","last_undegraded":"2024-02-18T10:01:32.012499+0000","last_fullsized":"2024-02-18T10:01:32.012499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:08.154709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014819+0000","last_change":"2024-02-18T10:01:32.012027+0000","last_active":"2024-02-18T10:01:32.014819+0000","last_peered":"2024-02-18T10:01:32.014819+0000","last_clean":"2024-02-18T10:01:32.014819+0000","last_became_active":"2024-02-18T10:01:32.011783+0000","last_became_peered":"2024-02-18T10:01:32.011783+0000","last_unstale":"2024-02-18T10:01:32.014819+0000","last_undegraded":"2024-02-18T10:01:32.014819+0000","last_fullsized":"2024-02-18T10:01:32.014819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021964+0000","last_change":"2024-02-18T10:01:32.015998+0000","last_active":"2024-02-18T10:01:32.021964+0000","last_peered":"2024-02-18T10:01:32.021964+0000","last_clean":"2024-02-18T10:01:32.021964+0000","last_became_active":"2024-02-18T10:01:32.015703+0000","last_became_peered":"2024-02-18T10:01:32.015703+0000","last_unstale":"2024-02-18T10:01:32.021964+0000","last_undegraded":"2024-02-18T10:01:32.021964+0000","last_fullsized":"2024-02-18T10:01:32.021964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:35:16.553553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018175+0000","last_change":"2024-02-18T10:01:32.016447+0000","last_active":"2024-02-18T10:01:32.018175+0000","last_peered":"2024-02-18T10:01:32.018175+0000","last_clean":"2024-02-18T10:01:32.018175+0000","last_became_active":"2024-02-18T10:01:32.015979+0000","last_became_peered":"2024-02-18T10:01:32.015979+0000","last_unstale":"2024-02-18T10:01:32.018175+0000","last_undegraded":"2024-02-18T10:01:32.018175+0000","last_fullsized":"2024-02-18T10:01:32.018175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:01.851993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017729+0000","last_change":"2024-02-18T10:01:32.011028+0000","last_active":"2024-02-18T10:01:32.017729+0000","last_peered":"2024-02-18T10:01:32.017729+0000","last_clean":"2024-02-18T10:01:32.017729+0000","last_became_active":"2024-02-18T10:01:32.010766+0000","last_became_peered":"2024-02-18T10:01:32.010766+0000","last_unstale":"2024-02-18T10:01:32.017729+0000","last_undegraded":"2024-02-18T10:01:32.017729+0000","last_fullsized":"2024-02-18T10:01:32.017729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:32.398447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013933+0000","last_change":"2024-02-18T10:01:32.009416+0000","last_active":"2024-02-18T10:01:32.013933+0000","last_peered":"2024-02-18T10:01:32.013933+0000","last_clean":"2024-02-18T10:01:32.013933+0000","last_became_active":"2024-02-18T10:01:32.008894+0000","last_became_peered":"2024-02-18T10:01:32.008894+0000","last_unstale":"2024-02-18T10:01:32.013933+0000","last_undegraded":"2024-02-18T10:01:32.013933+0000","last_fullsized":"2024-02-18T10:01:32.013933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:50.522189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014602+0000","last_change":"2024-02-18T10:01:32.012967+0000","last_active":"2024-02-18T10:01:32.014602+0000","last_peered":"2024-02-18T10:01:32.014602+0000","last_clean":"2024-02-18T10:01:32.014602+0000","last_became_active":"2024-02-18T10:01:32.012701+0000","last_became_peered":"2024-02-18T10:01:32.012701+0000","last_unstale":"2024-02-18T10:01:32.014602+0000","last_undegraded":"2024-02-18T10:01:32.014602+0000","last_fullsized":"2024-02-18T10:01:32.014602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:30.928987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012606+0000","last_change":"2024-02-18T10:01:32.005343+0000","last_active":"2024-02-18T10:01:32.012606+0000","last_peered":"2024-02-18T10:01:32.012606+0000","last_clean":"2024-02-18T10:01:32.012606+0000","last_became_active":"2024-02-18T10:01:32.005099+0000","last_became_peered":"2024-02-18T10:01:32.005099+0000","last_unstale":"2024-02-18T10:01:32.012606+0000","last_undegraded":"2024-02-18T10:01:32.012606+0000","last_fullsized":"2024-02-18T10:01:32.012606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:39.718829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018731+0000","last_change":"2024-02-18T10:01:32.015222+0000","last_active":"2024-02-18T10:01:32.018731+0000","last_peered":"2024-02-18T10:01:32.018731+0000","last_clean":"2024-02-18T10:01:32.018731+0000","last_became_active":"2024-02-18T10:01:32.014997+0000","last_became_peered":"2024-02-18T10:01:32.014997+0000","last_unstale":"2024-02-18T10:01:32.018731+0000","last_undegraded":"2024-02-18T10:01:32.018731+0000","last_fullsized":"2024-02-18T10:01:32.018731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014512+0000","last_change":"2024-02-18T10:01:32.010821+0000","last_active":"2024-02-18T10:01:32.014512+0000","last_peered":"2024-02-18T10:01:32.014512+0000","last_clean":"2024-02-18T10:01:32.014512+0000","last_became_active":"2024-02-18T10:01:32.010552+0000","last_became_peered":"2024-02-18T10:01:32.010552+0000","last_unstale":"2024-02-18T10:01:32.014512+0000","last_undegraded":"2024-02-18T10:01:32.014512+0000","last_fullsized":"2024-02-18T10:01:32.014512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025175+0000","last_change":"2024-02-18T10:01:30.998872+0000","last_active":"2024-02-18T10:01:32.025175+0000","last_peered":"2024-02-18T10:01:32.025175+0000","last_clean":"2024-02-18T10:01:32.025175+0000","last_became_active":"2024-02-18T10:01:30.998612+0000","last_became_peered":"2024-02-18T10:01:30.998612+0000","last_unstale":"2024-02-18T10:01:32.025175+0000","last_undegraded":"2024-02-18T10:01:32.025175+0000","last_fullsized":"2024-02-18T10:01:32.025175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:48:37.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.002941+0000","last_change":"2024-02-18T10:01:32.001237+0000","last_active":"2024-02-18T10:01:32.002941+0000","last_peered":"2024-02-18T10:01:32.002941+0000","last_clean":"2024-02-18T10:01:32.002941+0000","last_became_active":"2024-02-18T10:01:32.000940+0000","last_became_peered":"2024-02-18T10:01:32.000940+0000","last_unstale":"2024-02-18T10:01:32.002941+0000","last_undegraded":"2024-02-18T10:01:32.002941+0000","last_fullsized":"2024-02-18T10:01:32.002941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:48.364320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025839+0000","last_change":"2024-02-18T10:01:30.999768+0000","last_active":"2024-02-18T10:01:32.025839+0000","last_peered":"2024-02-18T10:01:32.025839+0000","last_clean":"2024-02-18T10:01:32.025839+0000","last_became_active":"2024-02-18T10:01:30.999522+0000","last_became_peered":"2024-02-18T10:01:30.999522+0000","last_unstale":"2024-02-18T10:01:32.025839+0000","last_undegraded":"2024-02-18T10:01:32.025839+0000","last_fullsized":"2024-02-18T10:01:32.025839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:37:47.360294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013943+0000","last_change":"2024-02-18T10:01:32.009057+0000","last_active":"2024-02-18T10:01:32.013943+0000","last_peered":"2024-02-18T10:01:32.013943+0000","last_clean":"2024-02-18T10:01:32.013943+0000","last_became_active":"2024-02-18T10:01:32.008745+0000","last_became_peered":"2024-02-18T10:01:32.008745+0000","last_unstale":"2024-02-18T10:01:32.013943+0000","last_undegraded":"2024-02-18T10:01:32.013943+0000","last_fullsized":"2024-02-18T10:01:32.013943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:39.718829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025343+0000","last_change":"2024-02-18T10:01:31.005696+0000","last_active":"2024-02-18T10:01:32.025343+0000","last_peered":"2024-02-18T10:01:32.025343+0000","last_clean":"2024-02-18T10:01:32.025343+0000","last_became_active":"2024-02-18T10:01:31.005316+0000","last_became_peered":"2024-02-18T10:01:31.005316+0000","last_unstale":"2024-02-18T10:01:32.025343+0000","last_undegraded":"2024-02-18T10:01:32.025343+0000","last_fullsized":"2024-02-18T10:01:32.025343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:14:00.847966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018156+0000","last_change":"2024-02-18T10:01:32.016231+0000","last_active":"2024-02-18T10:01:32.018156+0000","last_peered":"2024-02-18T10:01:32.018156+0000","last_clean":"2024-02-18T10:01:32.018156+0000","last_became_active":"2024-02-18T10:01:32.015684+0000","last_became_peered":"2024-02-18T10:01:32.015684+0000","last_unstale":"2024-02-18T10:01:32.018156+0000","last_undegraded":"2024-02-18T10:01:32.018156+0000","last_fullsized":"2024-02-18T10:01:32.018156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:21.646552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021520+0000","last_change":"2024-02-18T10:01:31.001606+0000","last_active":"2024-02-18T10:01:32.021520+0000","last_peered":"2024-02-18T10:01:32.021520+0000","last_clean":"2024-02-18T10:01:32.021520+0000","last_became_active":"2024-02-18T10:01:31.001350+0000","last_became_peered":"2024-02-18T10:01:31.001350+0000","last_unstale":"2024-02-18T10:01:32.021520+0000","last_undegraded":"2024-02-18T10:01:32.021520+0000","last_fullsized":"2024-02-18T10:01:32.021520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:42:11.518655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019321+0000","last_change":"2024-02-18T10:01:32.016102+0000","last_active":"2024-02-18T10:01:32.019321+0000","last_peered":"2024-02-18T10:01:32.019321+0000","last_clean":"2024-02-18T10:01:32.019321+0000","last_became_active":"2024-02-18T10:01:32.015785+0000","last_became_peered":"2024-02-18T10:01:32.015785+0000","last_unstale":"2024-02-18T10:01:32.019321+0000","last_undegraded":"2024-02-18T10:01:32.019321+0000","last_fullsized":"2024-02-18T10:01:32.019321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:41.797830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024941+0000","last_change":"2024-02-18T10:01:31.001402+0000","last_active":"2024-02-18T10:01:32.024941+0000","last_peered":"2024-02-18T10:01:32.024941+0000","last_clean":"2024-02-18T10:01:32.024941+0000","last_became_active":"2024-02-18T10:01:31.000872+0000","last_became_peered":"2024-02-18T10:01:31.000872+0000","last_unstale":"2024-02-18T10:01:32.024941+0000","last_undegraded":"2024-02-18T10:01:32.024941+0000","last_fullsized":"2024-02-18T10:01:32.024941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:06:08.144301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012501+0000","last_change":"2024-02-18T10:01:32.010458+0000","last_active":"2024-02-18T10:01:32.012501+0000","last_peered":"2024-02-18T10:01:32.012501+0000","last_clean":"2024-02-18T10:01:32.012501+0000","last_became_active":"2024-02-18T10:01:32.010203+0000","last_became_peered":"2024-02-18T10:01:32.010203+0000","last_unstale":"2024-02-18T10:01:32.012501+0000","last_undegraded":"2024-02-18T10:01:32.012501+0000","last_fullsized":"2024-02-18T10:01:32.012501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:41.797830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.026054+0000","last_change":"2024-02-18T10:01:31.000309+0000","last_active":"2024-02-18T10:01:32.026054+0000","last_peered":"2024-02-18T10:01:32.026054+0000","last_clean":"2024-02-18T10:01:32.026054+0000","last_became_active":"2024-02-18T10:01:30.999999+0000","last_became_peered":"2024-02-18T10:01:30.999999+0000","last_unstale":"2024-02-18T10:01:32.026054+0000","last_undegraded":"2024-02-18T10:01:32.026054+0000","last_fullsized":"2024-02-18T10:01:32.026054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:20:06.106625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.011518+0000","last_change":"2024-02-18T10:01:32.002682+0000","last_active":"2024-02-18T10:01:32.011518+0000","last_peered":"2024-02-18T10:01:32.011518+0000","last_clean":"2024-02-18T10:01:32.011518+0000","last_became_active":"2024-02-18T10:01:32.002367+0000","last_became_peered":"2024-02-18T10:01:32.002367+0000","last_unstale":"2024-02-18T10:01:32.011518+0000","last_undegraded":"2024-02-18T10:01:32.011518+0000","last_fullsized":"2024-02-18T10:01:32.011518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:24.086527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.004278+0000","last_change":"2024-02-18T10:01:31.002173+0000","last_active":"2024-02-18T10:01:32.004278+0000","last_peered":"2024-02-18T10:01:32.004278+0000","last_clean":"2024-02-18T10:01:32.004278+0000","last_became_active":"2024-02-18T10:01:31.001922+0000","last_became_peered":"2024-02-18T10:01:31.001922+0000","last_unstale":"2024-02-18T10:01:32.004278+0000","last_undegraded":"2024-02-18T10:01:32.004278+0000","last_fullsized":"2024-02-18T10:01:32.004278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:00:31.394420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017170+0000","last_change":"2024-02-18T10:01:32.013902+0000","last_active":"2024-02-18T10:01:32.017170+0000","last_peered":"2024-02-18T10:01:32.017170+0000","last_clean":"2024-02-18T10:01:32.017170+0000","last_became_active":"2024-02-18T10:01:32.013668+0000","last_became_peered":"2024-02-18T10:01:32.013668+0000","last_unstale":"2024-02-18T10:01:32.017170+0000","last_undegraded":"2024-02-18T10:01:32.017170+0000","last_fullsized":"2024-02-18T10:01:32.017170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:08.154709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.997499+0000","last_change":"2024-02-18T10:01:30.994919+0000","last_active":"2024-02-18T10:01:31.997499+0000","last_peered":"2024-02-18T10:01:31.997499+0000","last_clean":"2024-02-18T10:01:31.997499+0000","last_became_active":"2024-02-18T10:01:30.994650+0000","last_became_peered":"2024-02-18T10:01:30.994650+0000","last_unstale":"2024-02-18T10:01:31.997499+0000","last_undegraded":"2024-02-18T10:01:31.997499+0000","last_fullsized":"2024-02-18T10:01:31.997499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:54:26.847740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017884+0000","last_change":"2024-02-18T10:01:32.011605+0000","last_active":"2024-02-18T10:01:32.017884+0000","last_peered":"2024-02-18T10:01:32.017884+0000","last_clean":"2024-02-18T10:01:32.017884+0000","last_became_active":"2024-02-18T10:01:32.011335+0000","last_became_peered":"2024-02-18T10:01:32.011335+0000","last_unstale":"2024-02-18T10:01:32.017884+0000","last_undegraded":"2024-02-18T10:01:32.017884+0000","last_fullsized":"2024-02-18T10:01:32.017884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:21.646552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.005383+0000","last_change":"2024-02-18T10:01:31.003461+0000","last_active":"2024-02-18T10:01:32.005383+0000","last_peered":"2024-02-18T10:01:32.005383+0000","last_clean":"2024-02-18T10:01:32.005383+0000","last_became_active":"2024-02-18T10:01:31.003126+0000","last_became_peered":"2024-02-18T10:01:31.003126+0000","last_unstale":"2024-02-18T10:01:32.005383+0000","last_undegraded":"2024-02-18T10:01:32.005383+0000","last_fullsized":"2024-02-18T10:01:32.005383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:09.161810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.014201+0000","last_change":"2024-02-18T10:01:32.010336+0000","last_active":"2024-02-18T10:01:32.014201+0000","last_peered":"2024-02-18T10:01:32.014201+0000","last_clean":"2024-02-18T10:01:32.014201+0000","last_became_active":"2024-02-18T10:01:32.010015+0000","last_became_peered":"2024-02-18T10:01:32.010015+0000","last_unstale":"2024-02-18T10:01:32.014201+0000","last_undegraded":"2024-02-18T10:01:32.014201+0000","last_fullsized":"2024-02-18T10:01:32.014201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:07:41.367699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.995653+0000","last_change":"2024-02-18T10:01:30.998263+0000","last_active":"2024-02-18T10:01:31.995653+0000","last_peered":"2024-02-18T10:01:31.995653+0000","last_clean":"2024-02-18T10:01:31.995653+0000","last_became_active":"2024-02-18T10:01:30.997137+0000","last_became_peered":"2024-02-18T10:01:30.997137+0000","last_unstale":"2024-02-18T10:01:31.995653+0000","last_undegraded":"2024-02-18T10:01:31.995653+0000","last_fullsized":"2024-02-18T10:01:31.995653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:33.115058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019330+0000","last_change":"2024-02-18T10:01:32.015283+0000","last_active":"2024-02-18T10:01:32.019330+0000","last_peered":"2024-02-18T10:01:32.019330+0000","last_clean":"2024-02-18T10:01:32.019330+0000","last_became_active":"2024-02-18T10:01:32.015043+0000","last_became_peered":"2024-02-18T10:01:32.015043+0000","last_unstale":"2024-02-18T10:01:32.019330+0000","last_undegraded":"2024-02-18T10:01:32.019330+0000","last_fullsized":"2024-02-18T10:01:32.019330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:45:21.010333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.025142+0000","last_change":"2024-02-18T10:01:31.002295+0000","last_active":"2024-02-18T10:01:32.025142+0000","last_peered":"2024-02-18T10:01:32.025142+0000","last_clean":"2024-02-18T10:01:32.025142+0000","last_became_active":"2024-02-18T10:01:31.002021+0000","last_became_peered":"2024-02-18T10:01:31.002021+0000","last_unstale":"2024-02-18T10:01:32.025142+0000","last_undegraded":"2024-02-18T10:01:32.025142+0000","last_fullsized":"2024-02-18T10:01:32.025142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:04.557754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020522+0000","last_change":"2024-02-18T10:01:32.019250+0000","last_active":"2024-02-18T10:01:32.020522+0000","last_peered":"2024-02-18T10:01:32.020522+0000","last_clean":"2024-02-18T10:01:32.020522+0000","last_became_active":"2024-02-18T10:01:32.018533+0000","last_became_peered":"2024-02-18T10:01:32.018533+0000","last_unstale":"2024-02-18T10:01:32.020522+0000","last_undegraded":"2024-02-18T10:01:32.020522+0000","last_fullsized":"2024-02-18T10:01:32.020522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:25.356461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.027907+0000","last_change":"2024-02-18T10:01:31.005567+0000","last_active":"2024-02-18T10:01:32.027907+0000","last_peered":"2024-02-18T10:01:32.027907+0000","last_clean":"2024-02-18T10:01:32.027907+0000","last_became_active":"2024-02-18T10:01:31.005285+0000","last_became_peered":"2024-02-18T10:01:31.005285+0000","last_unstale":"2024-02-18T10:01:32.027907+0000","last_undegraded":"2024-02-18T10:01:32.027907+0000","last_fullsized":"2024-02-18T10:01:32.027907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:20.642526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019847+0000","last_change":"2024-02-18T10:01:32.017597+0000","last_active":"2024-02-18T10:01:32.019847+0000","last_peered":"2024-02-18T10:01:32.019847+0000","last_clean":"2024-02-18T10:01:32.019847+0000","last_became_active":"2024-02-18T10:01:32.017357+0000","last_became_peered":"2024-02-18T10:01:32.017357+0000","last_unstale":"2024-02-18T10:01:32.019847+0000","last_undegraded":"2024-02-18T10:01:32.019847+0000","last_fullsized":"2024-02-18T10:01:32.019847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:16:10.165836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024542+0000","last_change":"2024-02-18T10:01:30.996035+0000","last_active":"2024-02-18T10:01:32.024542+0000","last_peered":"2024-02-18T10:01:32.024542+0000","last_clean":"2024-02-18T10:01:32.024542+0000","last_became_active":"2024-02-18T10:01:30.995350+0000","last_became_peered":"2024-02-18T10:01:30.995350+0000","last_unstale":"2024-02-18T10:01:32.024542+0000","last_undegraded":"2024-02-18T10:01:32.024542+0000","last_fullsized":"2024-02-18T10:01:32.024542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:38:07.731801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019058+0000","last_change":"2024-02-18T10:01:32.011496+0000","last_active":"2024-02-18T10:01:32.019058+0000","last_peered":"2024-02-18T10:01:32.019058+0000","last_clean":"2024-02-18T10:01:32.019058+0000","last_became_active":"2024-02-18T10:01:32.011252+0000","last_became_peered":"2024-02-18T10:01:32.011252+0000","last_unstale":"2024-02-18T10:01:32.019058+0000","last_undegraded":"2024-02-18T10:01:32.019058+0000","last_fullsized":"2024-02-18T10:01:32.019058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:42:19.682939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.006611+0000","last_change":"2024-02-18T10:01:31.001637+0000","last_active":"2024-02-18T10:01:32.006611+0000","last_peered":"2024-02-18T10:01:32.006611+0000","last_clean":"2024-02-18T10:01:32.006611+0000","last_became_active":"2024-02-18T10:01:31.001386+0000","last_became_peered":"2024-02-18T10:01:31.001386+0000","last_unstale":"2024-02-18T10:01:32.006611+0000","last_undegraded":"2024-02-18T10:01:32.006611+0000","last_fullsized":"2024-02-18T10:01:32.006611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:23.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.018752+0000","last_change":"2024-02-18T10:01:32.015793+0000","last_active":"2024-02-18T10:01:32.018752+0000","last_peered":"2024-02-18T10:01:32.018752+0000","last_clean":"2024-02-18T10:01:32.018752+0000","last_became_active":"2024-02-18T10:01:32.015538+0000","last_became_peered":"2024-02-18T10:01:32.015538+0000","last_unstale":"2024-02-18T10:01:32.018752+0000","last_undegraded":"2024-02-18T10:01:32.018752+0000","last_fullsized":"2024-02-18T10:01:32.018752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:08.154709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.004124+0000","last_change":"2024-02-18T10:01:31.003539+0000","last_active":"2024-02-18T10:01:32.004124+0000","last_peered":"2024-02-18T10:01:32.004124+0000","last_clean":"2024-02-18T10:01:32.004124+0000","last_became_active":"2024-02-18T10:01:31.003264+0000","last_became_peered":"2024-02-18T10:01:31.003264+0000","last_unstale":"2024-02-18T10:01:32.004124+0000","last_undegraded":"2024-02-18T10:01:32.004124+0000","last_fullsized":"2024-02-18T10:01:32.004124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:45:40.793804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.012585+0000","last_change":"2024-02-18T10:01:32.003970+0000","last_active":"2024-02-18T10:01:32.012585+0000","last_peered":"2024-02-18T10:01:32.012585+0000","last_clean":"2024-02-18T10:01:32.012585+0000","last_became_active":"2024-02-18T10:01:32.003683+0000","last_became_peered":"2024-02-18T10:01:32.003683+0000","last_unstale":"2024-02-18T10:01:32.012585+0000","last_undegraded":"2024-02-18T10:01:32.012585+0000","last_fullsized":"2024-02-18T10:01:32.012585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:34.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.026838+0000","last_change":"2024-02-18T10:01:31.004909+0000","last_active":"2024-02-18T10:01:32.026838+0000","last_peered":"2024-02-18T10:01:32.026838+0000","last_clean":"2024-02-18T10:01:32.026838+0000","last_became_active":"2024-02-18T10:01:31.004625+0000","last_became_peered":"2024-02-18T10:01:31.004625+0000","last_unstale":"2024-02-18T10:01:32.026838+0000","last_undegraded":"2024-02-18T10:01:32.026838+0000","last_fullsized":"2024-02-18T10:01:32.026838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:58:07.150683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016539+0000","last_change":"2024-02-18T10:01:32.015082+0000","last_active":"2024-02-18T10:01:32.016539+0000","last_peered":"2024-02-18T10:01:32.016539+0000","last_clean":"2024-02-18T10:01:32.016539+0000","last_became_active":"2024-02-18T10:01:32.014779+0000","last_became_peered":"2024-02-18T10:01:32.014779+0000","last_unstale":"2024-02-18T10:01:32.016539+0000","last_undegraded":"2024-02-18T10:01:32.016539+0000","last_fullsized":"2024-02-18T10:01:32.016539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.026110+0000","last_change":"2024-02-18T10:01:31.005990+0000","last_active":"2024-02-18T10:01:32.026110+0000","last_peered":"2024-02-18T10:01:32.026110+0000","last_clean":"2024-02-18T10:01:32.026110+0000","last_became_active":"2024-02-18T10:01:31.005727+0000","last_became_peered":"2024-02-18T10:01:31.005727+0000","last_unstale":"2024-02-18T10:01:32.026110+0000","last_undegraded":"2024-02-18T10:01:32.026110+0000","last_fullsized":"2024-02-18T10:01:32.026110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:49.518163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020483+0000","last_change":"2024-02-18T10:01:32.019408+0000","last_active":"2024-02-18T10:01:32.020483+0000","last_peered":"2024-02-18T10:01:32.020483+0000","last_clean":"2024-02-18T10:01:32.020483+0000","last_became_active":"2024-02-18T10:01:32.014849+0000","last_became_peered":"2024-02-18T10:01:32.014849+0000","last_unstale":"2024-02-18T10:01:32.020483+0000","last_undegraded":"2024-02-18T10:01:32.020483+0000","last_fullsized":"2024-02-18T10:01:32.020483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:13:02.147073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.023042+0000","last_change":"2024-02-18T10:01:30.995875+0000","last_active":"2024-02-18T10:01:32.023042+0000","last_peered":"2024-02-18T10:01:32.023042+0000","last_clean":"2024-02-18T10:01:32.023042+0000","last_became_active":"2024-02-18T10:01:30.995575+0000","last_became_peered":"2024-02-18T10:01:30.995575+0000","last_unstale":"2024-02-18T10:01:32.023042+0000","last_undegraded":"2024-02-18T10:01:32.023042+0000","last_fullsized":"2024-02-18T10:01:32.023042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:02:50.504967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.010237+0000","last_change":"2024-02-18T10:01:32.007843+0000","last_active":"2024-02-18T10:01:32.010237+0000","last_peered":"2024-02-18T10:01:32.010237+0000","last_clean":"2024-02-18T10:01:32.010237+0000","last_became_active":"2024-02-18T10:01:32.007519+0000","last_became_peered":"2024-02-18T10:01:32.007519+0000","last_unstale":"2024-02-18T10:01:32.010237+0000","last_undegraded":"2024-02-18T10:01:32.010237+0000","last_fullsized":"2024-02-18T10:01:32.010237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:20:05.561780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024518+0000","last_change":"2024-02-18T10:01:30.998810+0000","last_active":"2024-02-18T10:01:32.024518+0000","last_peered":"2024-02-18T10:01:32.024518+0000","last_clean":"2024-02-18T10:01:32.024518+0000","last_became_active":"2024-02-18T10:01:30.998565+0000","last_became_peered":"2024-02-18T10:01:30.998565+0000","last_unstale":"2024-02-18T10:01:32.024518+0000","last_undegraded":"2024-02-18T10:01:32.024518+0000","last_fullsized":"2024-02-18T10:01:32.024518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:48:37.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.016298+0000","last_change":"2024-02-18T10:01:32.010085+0000","last_active":"2024-02-18T10:01:32.016298+0000","last_peered":"2024-02-18T10:01:32.016298+0000","last_clean":"2024-02-18T10:01:32.016298+0000","last_became_active":"2024-02-18T10:01:32.009828+0000","last_became_peered":"2024-02-18T10:01:32.009828+0000","last_unstale":"2024-02-18T10:01:32.016298+0000","last_undegraded":"2024-02-18T10:01:32.016298+0000","last_fullsized":"2024-02-18T10:01:32.016298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:46:58.956726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.998285+0000","last_change":"2024-02-18T10:01:31.000640+0000","last_active":"2024-02-18T10:01:31.998285+0000","last_peered":"2024-02-18T10:01:31.998285+0000","last_clean":"2024-02-18T10:01:31.998285+0000","last_became_active":"2024-02-18T10:01:31.000373+0000","last_became_peered":"2024-02-18T10:01:31.000373+0000","last_unstale":"2024-02-18T10:01:31.998285+0000","last_undegraded":"2024-02-18T10:01:31.998285+0000","last_fullsized":"2024-02-18T10:01:31.998285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T20:41:40.032837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021433+0000","last_change":"2024-02-18T10:01:32.015356+0000","last_active":"2024-02-18T10:01:32.021433+0000","last_peered":"2024-02-18T10:01:32.021433+0000","last_clean":"2024-02-18T10:01:32.021433+0000","last_became_active":"2024-02-18T10:01:32.015018+0000","last_became_peered":"2024-02-18T10:01:32.015018+0000","last_unstale":"2024-02-18T10:01:32.021433+0000","last_undegraded":"2024-02-18T10:01:32.021433+0000","last_fullsized":"2024-02-18T10:01:32.021433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:20.690742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022698+0000","last_change":"2024-02-18T10:01:30.998557+0000","last_active":"2024-02-18T10:01:32.022698+0000","last_peered":"2024-02-18T10:01:32.022698+0000","last_clean":"2024-02-18T10:01:32.022698+0000","last_became_active":"2024-02-18T10:01:30.998296+0000","last_became_peered":"2024-02-18T10:01:30.998296+0000","last_unstale":"2024-02-18T10:01:32.022698+0000","last_undegraded":"2024-02-18T10:01:32.022698+0000","last_fullsized":"2024-02-18T10:01:32.022698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:38:07.731801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017791+0000","last_change":"2024-02-18T10:01:32.011821+0000","last_active":"2024-02-18T10:01:32.017791+0000","last_peered":"2024-02-18T10:01:32.017791+0000","last_clean":"2024-02-18T10:01:32.017791+0000","last_became_active":"2024-02-18T10:01:32.011561+0000","last_became_peered":"2024-02-18T10:01:32.011561+0000","last_unstale":"2024-02-18T10:01:32.017791+0000","last_undegraded":"2024-02-18T10:01:32.017791+0000","last_fullsized":"2024-02-18T10:01:32.017791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:39:10.623807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.999519+0000","last_change":"2024-02-18T10:01:30.997943+0000","last_active":"2024-02-18T10:01:31.999519+0000","last_peered":"2024-02-18T10:01:31.999519+0000","last_clean":"2024-02-18T10:01:31.999519+0000","last_became_active":"2024-02-18T10:01:30.997659+0000","last_became_peered":"2024-02-18T10:01:30.997659+0000","last_unstale":"2024-02-18T10:01:31.999519+0000","last_undegraded":"2024-02-18T10:01:31.999519+0000","last_fullsized":"2024-02-18T10:01:31.999519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T11:38:07.731801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.017764+0000","last_change":"2024-02-18T10:01:32.011845+0000","last_active":"2024-02-18T10:01:32.017764+0000","last_peered":"2024-02-18T10:01:32.017764+0000","last_clean":"2024-02-18T10:01:32.017764+0000","last_became_active":"2024-02-18T10:01:32.011602+0000","last_became_peered":"2024-02-18T10:01:32.011602+0000","last_unstale":"2024-02-18T10:01:32.017764+0000","last_undegraded":"2024-02-18T10:01:32.017764+0000","last_fullsized":"2024-02-18T10:01:32.017764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T19:29:02.126849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.997697+0000","last_change":"2024-02-18T10:01:31.000493+0000","last_active":"2024-02-18T10:01:31.997697+0000","last_peered":"2024-02-18T10:01:31.997697+0000","last_clean":"2024-02-18T10:01:31.997697+0000","last_became_active":"2024-02-18T10:01:30.999565+0000","last_became_peered":"2024-02-18T10:01:30.999565+0000","last_unstale":"2024-02-18T10:01:31.997697+0000","last_undegraded":"2024-02-18T10:01:31.997697+0000","last_fullsized":"2024-02-18T10:01:31.997697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:41:30.442929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.019499+0000","last_change":"2024-02-18T10:01:32.016656+0000","last_active":"2024-02-18T10:01:32.019499+0000","last_peered":"2024-02-18T10:01:32.019499+0000","last_clean":"2024-02-18T10:01:32.019499+0000","last_became_active":"2024-02-18T10:01:32.016396+0000","last_became_peered":"2024-02-18T10:01:32.016396+0000","last_unstale":"2024-02-18T10:01:32.019499+0000","last_undegraded":"2024-02-18T10:01:32.019499+0000","last_fullsized":"2024-02-18T10:01:32.019499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T16:52:21.646552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.004054+0000","last_change":"2024-02-18T10:01:31.001682+0000","last_active":"2024-02-18T10:01:32.004054+0000","last_peered":"2024-02-18T10:01:32.004054+0000","last_clean":"2024-02-18T10:01:32.004054+0000","last_became_active":"2024-02-18T10:01:31.001415+0000","last_became_peered":"2024-02-18T10:01:31.001415+0000","last_unstale":"2024-02-18T10:01:32.004054+0000","last_undegraded":"2024-02-18T10:01:32.004054+0000","last_fullsized":"2024-02-18T10:01:32.004054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:29.924961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.021364+0000","last_change":"2024-02-18T10:01:32.014521+0000","last_active":"2024-02-18T10:01:32.021364+0000","last_peered":"2024-02-18T10:01:32.021364+0000","last_clean":"2024-02-18T10:01:32.021364+0000","last_became_active":"2024-02-18T10:01:32.014265+0000","last_became_peered":"2024-02-18T10:01:32.014265+0000","last_unstale":"2024-02-18T10:01:32.021364+0000","last_undegraded":"2024-02-18T10:01:32.021364+0000","last_fullsized":"2024-02-18T10:01:32.021364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:41:31.446955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.024676+0000","last_change":"2024-02-18T10:01:31.001439+0000","last_active":"2024-02-18T10:01:32.024676+0000","last_peered":"2024-02-18T10:01:32.024676+0000","last_clean":"2024-02-18T10:01:32.024676+0000","last_became_active":"2024-02-18T10:01:31.000801+0000","last_became_peered":"2024-02-18T10:01:31.000801+0000","last_unstale":"2024-02-18T10:01:32.024676+0000","last_undegraded":"2024-02-18T10:01:32.024676+0000","last_fullsized":"2024-02-18T10:01:32.024676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:59:29.924961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022639+0000","last_change":"2024-02-18T10:01:32.019730+0000","last_active":"2024-02-18T10:01:32.022639+0000","last_peered":"2024-02-18T10:01:32.022639+0000","last_clean":"2024-02-18T10:01:32.022639+0000","last_became_active":"2024-02-18T10:01:32.018877+0000","last_became_peered":"2024-02-18T10:01:32.018877+0000","last_unstale":"2024-02-18T10:01:32.022639+0000","last_undegraded":"2024-02-18T10:01:32.022639+0000","last_fullsized":"2024-02-18T10:01:32.022639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:56:51.707365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.995748+0000","last_change":"2024-02-18T10:01:30.996979+0000","last_active":"2024-02-18T10:01:31.995748+0000","last_peered":"2024-02-18T10:01:31.995748+0000","last_clean":"2024-02-18T10:01:31.995748+0000","last_became_active":"2024-02-18T10:01:30.996713+0000","last_became_peered":"2024-02-18T10:01:30.996713+0000","last_unstale":"2024-02-18T10:01:31.995748+0000","last_undegraded":"2024-02-18T10:01:31.995748+0000","last_fullsized":"2024-02-18T10:01:31.995748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:38.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.020186+0000","last_change":"2024-02-18T10:01:32.018388+0000","last_active":"2024-02-18T10:01:32.020186+0000","last_peered":"2024-02-18T10:01:32.020186+0000","last_clean":"2024-02-18T10:01:32.020186+0000","last_became_active":"2024-02-18T10:01:32.018150+0000","last_became_peered":"2024-02-18T10:01:32.018150+0000","last_unstale":"2024-02-18T10:01:32.020186+0000","last_undegraded":"2024-02-18T10:01:32.020186+0000","last_fullsized":"2024-02-18T10:01:32.020186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:51.684584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.007315+0000","last_change":"2024-02-18T10:01:30.999711+0000","last_active":"2024-02-18T10:01:32.007315+0000","last_peered":"2024-02-18T10:01:32.007315+0000","last_clean":"2024-02-18T10:01:32.007315+0000","last_became_active":"2024-02-18T10:01:30.999466+0000","last_became_peered":"2024-02-18T10:01:30.999466+0000","last_unstale":"2024-02-18T10:01:32.007315+0000","last_undegraded":"2024-02-18T10:01:32.007315+0000","last_fullsized":"2024-02-18T10:01:32.007315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:35:38.714802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.002967+0000","last_change":"2024-02-18T10:01:32.001245+0000","last_active":"2024-02-18T10:01:32.002967+0000","last_peered":"2024-02-18T10:01:32.002967+0000","last_clean":"2024-02-18T10:01:32.002967+0000","last_became_active":"2024-02-18T10:01:32.000963+0000","last_became_peered":"2024-02-18T10:01:32.000963+0000","last_unstale":"2024-02-18T10:01:32.002967+0000","last_undegraded":"2024-02-18T10:01:32.002967+0000","last_fullsized":"2024-02-18T10:01:32.002967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:24.086527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.995628+0000","last_change":"2024-02-18T10:01:30.999143+0000","last_active":"2024-02-18T10:01:31.995628+0000","last_peered":"2024-02-18T10:01:31.995628+0000","last_clean":"2024-02-18T10:01:31.995628+0000","last_became_active":"2024-02-18T10:01:30.998871+0000","last_became_peered":"2024-02-18T10:01:30.998871+0000","last_unstale":"2024-02-18T10:01:31.995628+0000","last_undegraded":"2024-02-18T10:01:31.995628+0000","last_fullsized":"2024-02-18T10:01:31.995628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T15:45:23.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.006558+0000","last_change":"2024-02-18T10:01:32.002618+0000","last_active":"2024-02-18T10:01:32.006558+0000","last_peered":"2024-02-18T10:01:32.006558+0000","last_clean":"2024-02-18T10:01:32.006558+0000","last_became_active":"2024-02-18T10:01:32.002360+0000","last_became_peered":"2024-02-18T10:01:32.002360+0000","last_unstale":"2024-02-18T10:01:32.006558+0000","last_undegraded":"2024-02-18T10:01:32.006558+0000","last_fullsized":"2024-02-18T10:01:32.006558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T17:05:50.522189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.006740+0000","last_change":"2024-02-18T10:01:31.001025+0000","last_active":"2024-02-18T10:01:32.006740+0000","last_peered":"2024-02-18T10:01:32.006740+0000","last_clean":"2024-02-18T10:01:32.006740+0000","last_became_active":"2024-02-18T10:01:31.000773+0000","last_became_peered":"2024-02-18T10:01:31.000773+0000","last_unstale":"2024-02-18T10:01:32.006740+0000","last_undegraded":"2024-02-18T10:01:32.006740+0000","last_fullsized":"2024-02-18T10:01:32.006740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:33.115058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013815+0000","last_change":"2024-02-18T10:01:32.008812+0000","last_active":"2024-02-18T10:01:32.013815+0000","last_peered":"2024-02-18T10:01:32.013815+0000","last_clean":"2024-02-18T10:01:32.013815+0000","last_became_active":"2024-02-18T10:01:32.008015+0000","last_became_peered":"2024-02-18T10:01:32.008015+0000","last_unstale":"2024-02-18T10:01:32.013815+0000","last_undegraded":"2024-02-18T10:01:32.013815+0000","last_fullsized":"2024-02-18T10:01:32.013815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:13:02.147073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.998255+0000","last_change":"2024-02-18T10:01:31.001802+0000","last_active":"2024-02-18T10:01:31.998255+0000","last_peered":"2024-02-18T10:01:31.998255+0000","last_clean":"2024-02-18T10:01:31.998255+0000","last_became_active":"2024-02-18T10:01:31.000880+0000","last_became_peered":"2024-02-18T10:01:31.000880+0000","last_unstale":"2024-02-18T10:01:31.998255+0000","last_undegraded":"2024-02-18T10:01:31.998255+0000","last_fullsized":"2024-02-18T10:01:31.998255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T18:09:19.686715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.013881+0000","last_change":"2024-02-18T10:01:32.007909+0000","last_active":"2024-02-18T10:01:32.013881+0000","last_peered":"2024-02-18T10:01:32.013881+0000","last_clean":"2024-02-18T10:01:32.013881+0000","last_became_active":"2024-02-18T10:01:32.007621+0000","last_became_peered":"2024-02-18T10:01:32.007621+0000","last_unstale":"2024-02-18T10:01:32.013881+0000","last_undegraded":"2024-02-18T10:01:32.013881+0000","last_fullsized":"2024-02-18T10:01:32.013881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T10:04:34.119085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.003496+0000","last_change":"2024-02-18T10:01:31.002715+0000","last_active":"2024-02-18T10:01:32.003496+0000","last_peered":"2024-02-18T10:01:32.003496+0000","last_clean":"2024-02-18T10:01:32.003496+0000","last_became_active":"2024-02-18T10:01:31.002463+0000","last_became_peered":"2024-02-18T10:01:31.002463+0000","last_unstale":"2024-02-18T10:01:32.003496+0000","last_undegraded":"2024-02-18T10:01:32.003496+0000","last_fullsized":"2024-02-18T10:01:32.003496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:24:50.680558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.022539+0000","last_change":"2024-02-18T10:01:32.021461+0000","last_active":"2024-02-18T10:01:32.022539+0000","last_peered":"2024-02-18T10:01:32.022539+0000","last_clean":"2024-02-18T10:01:32.022539+0000","last_became_active":"2024-02-18T10:01:32.021132+0000","last_became_peered":"2024-02-18T10:01:32.021132+0000","last_unstale":"2024-02-18T10:01:32.022539+0000","last_undegraded":"2024-02-18T10:01:32.022539+0000","last_fullsized":"2024-02-18T10:01:32.022539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:30.981152+0000","last_clean_scrub_stamp":"2024-02-18T10:01:30.981152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:13:02.147073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:31.998216+0000","last_change":"2024-02-18T10:01:30.998749+0000","last_active":"2024-02-18T10:01:31.998216+0000","last_peered":"2024-02-18T10:01:31.998216+0000","last_clean":"2024-02-18T10:01:31.998216+0000","last_became_active":"2024-02-18T10:01:30.998449+0000","last_became_peered":"2024-02-18T10:01:30.998449+0000","last_unstale":"2024-02-18T10:01:31.998216+0000","last_undegraded":"2024-02-18T10:01:31.998216+0000","last_fullsized":"2024-02-18T10:01:31.998216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:01:29.977126+0000","last_clean_scrub_stamp":"2024-02-18T10:01:29.977126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T13:06:08.144301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-18T10:01:32.007286+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T10:01:32.007286+0000","last_peered":"2024-02-18T10:01:32.007286+0000","last_clean":"2024-02-18T10:01:32.007286+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T10:01:32.007286+0000","last_undegraded":"2024-02-18T10:01:32.007286+0000","last_fullsized":"2024-02-18T10:01:32.007286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T10:01:35.295 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-18T10:01:35.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 Processor -- start 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 -- start start 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 0x7f6de40717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6de40725c0 0x7f6de406d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6de406deb0 0x7f6de406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de4146370 con 0x7f6de40725c0 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de406e560 con 0x7f6de406deb0 2024-02-18T10:01:35.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6dea548640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40b5360 con 0x7f6de40b9bc0 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6de37fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6de40725c0 0x7f6de406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6de37fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6de40725c0 0x7f6de406d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55204/0 (socket says 172.21.15.118:55204) 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.437+0000 7f6de37fe640 1 -- 172.21.15.118:0/2263652603 learned_addr learned my addr 172.21.15.118:0/2263652603 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.438+0000 7f6de37fe640 1 -- 172.21.15.118:0/2263652603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 msgr2=0x7f6de40717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.438+0000 7f6de37fe640 1 --2- 172.21.15.118:0/2263652603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 0x7f6de40717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.438+0000 7f6de37fe640 1 -- 172.21.15.118:0/2263652603 >> v2:172.21.15.164:3300/0 conn(0x7f6de406deb0 msgr2=0x7f6de406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.438+0000 7f6de37fe640 1 --2- 172.21.15.118:0/2263652603 >> v2:172.21.15.164:3300/0 conn(0x7f6de406deb0 0x7f6de406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.438+0000 7f6de37fe640 1 -- 172.21.15.118:0/2263652603 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4071dc0 con 0x7f6de40725c0 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.438+0000 7f6de37fe640 1 --2- 172.21.15.118:0/2263652603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de406d970 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6de406f3b0 tx=0x7f6dd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab6f863ba011117 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.438+0000 7f6de2ffd640 1 -- 172.21.15.118:0/2263652603 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8031870 con 0x7f6de40725c0 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6de2ffd640 1 -- 172.21.15.118:0/2263652603 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd80319d0 con 0x7f6de40725c0 2024-02-18T10:01:35.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6de2ffd640 1 -- 172.21.15.118:0/2263652603 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8031d60 con 0x7f6de40725c0 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 -- 172.21.15.118:0/2263652603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 msgr2=0x7f6de406d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 --2- 172.21.15.118:0/2263652603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de406d970 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6de406f3b0 tx=0x7f6dd802b910 comp rx=0 tx=0).stop 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 -- 172.21.15.118:0/2263652603 shutdown_connections 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 --2- 172.21.15.118:0/2263652603 >> v2:172.21.15.164:3300/0 conn(0x7f6de406deb0 0x7f6de406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 --2- 172.21.15.118:0/2263652603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de406d970 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 --2- 172.21.15.118:0/2263652603 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 0x7f6de40717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 -- 172.21.15.118:0/2263652603 >> 172.21.15.118:0/2263652603 conn(0x7f6de406bed0 msgr2=0x7f6de406c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 -- 172.21.15.118:0/2263652603 shutdown_connections 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.439+0000 7f6dea548640 1 -- 172.21.15.118:0/2263652603 wait complete. 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.440+0000 7f6dea548640 1 Processor -- start 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.440+0000 7f6dea548640 1 -- start start 2024-02-18T10:01:35.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6dea548640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de406deb0 0x7f6de41403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6dea548640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de40a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6dea548640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 0x7f6de413f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6dea548640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de4140930 con 0x7f6de40725c0 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6dea548640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de41d4ee0 con 0x7f6de406deb0 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6dea548640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de41d51c0 con 0x7f6de40b9bc0 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de40a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de40a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55216/0 (socket says 172.21.15.118:55216) 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 -- 172.21.15.118:0/200490805 learned_addr learned my addr 172.21.15.118:0/200490805 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de3fff640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de406deb0 0x7f6de41403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de8ae5640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 0x7f6de413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 -- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 msgr2=0x7f6de413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 0x7f6de413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 -- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de406deb0 msgr2=0x7f6de41403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de406deb0 0x7f6de41403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 -- 172.21.15.118:0/200490805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80094d0 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de37fe640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de40a02e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000c00 tx=0x7f6dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de0ff9640 1 -- 172.21.15.118:0/200490805 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8031840 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.441+0000 7f6de0ff9640 1 -- 172.21.15.118:0/200490805 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd80443f0 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.442+0000 7f6de0ff9640 1 -- 172.21.15.118:0/200490805 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80447a0 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.442+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de40a0cf0 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.442+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de409f8c0 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.442+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de4075150 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.443+0000 7f6de0ff9640 1 -- 172.21.15.118:0/200490805 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f6dd804d450 con 0x7f6de40725c0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.443+0000 7f6de0ff9640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dd006bca0 0x7f6dd006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.443+0000 7f6de3fff640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dd006bca0 0x7f6dd006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.443+0000 7f6de0ff9640 1 -- 172.21.15.118:0/200490805 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dd802d040 con 0x7f6de40725c0 2024-02-18T10:01:35.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.444+0000 7f6de3fff640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dd006bca0 0x7f6dd006e160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b810 tx=0x7f6dd4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.447+0000 7f6de0ff9640 1 -- 172.21.15.118:0/200490805 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6dd8077740 con 0x7f6de40725c0 2024-02-18T10:01:35.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.684+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6de40a0e80 con 0x7f6de40725c0 2024-02-18T10:01:35.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.686+0000 7f6de0ff9640 1 -- 172.21.15.118:0/200490805 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6dd80350e0 con 0x7f6de40725c0 2024-02-18T10:01:35.689 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-02-18T10:01:35.689 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAg1dFl2zJ1FBAAQcxOcwyOcAlkdfSHOaIsTw== 2024-02-18T10:01:35.689 INFO:teuthology.orchestra.run.smithi118.stdout: caps mds = "allow" 2024-02-18T10:01:35.689 INFO:teuthology.orchestra.run.smithi118.stdout: caps mon = "allow r" 2024-02-18T10:01:35.689 INFO:teuthology.orchestra.run.smithi118.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-18T10:01:35.689 INFO:teuthology.orchestra.run.smithi118.stderr:updated caps for client.0 2024-02-18T10:01:35.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dd006bca0 msgr2=0x7f6dd006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dd006bca0 0x7f6dd006e160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b810 tx=0x7f6dd4008040 comp rx=0 tx=0).stop 2024-02-18T10:01:35.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 msgr2=0x7f6de40a02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de40a02e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000c00 tx=0x7f6dd80046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 shutdown_connections 2024-02-18T10:01:35.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6dd006bca0 0x7f6dd006e160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6de40b9bc0 0x7f6de413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6de40725c0 0x7f6de40a02e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 --2- 172.21.15.118:0/200490805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6de406deb0 0x7f6de41403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 >> 172.21.15.118:0/200490805 conn(0x7f6de406bed0 msgr2=0x7f6de406b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:35.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 shutdown_connections 2024-02-18T10:01:35.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.688+0000 7f6dea548640 1 -- 172.21.15.118:0/200490805 wait complete. 2024-02-18T10:01:35.702 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T10:01:35.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.798+0000 7f3b63ec3640 1 Processor -- start 2024-02-18T10:01:35.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.798+0000 7f3b63ec3640 1 -- start start 2024-02-18T10:01:35.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b63ec3640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3b5c06fda0 0x7f3b5c0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b63ec3640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3b5c14a0d0 0x7f3b5c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b63ec3640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c149c40 con 0x7f3b5c0bc0a0 2024-02-18T10:01:35.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b63ec3640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0b5b60 con 0x7f3b5c14a0d0 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b63ec3640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c0b5e40 con 0x7f3b5c06fda0 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b62460640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3b5c14a0d0 0x7f3b5c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b61c5f640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3b5c0bc0a0 0x7f3b5c143b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48556/0 (socket says 172.21.15.118:48556) 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b62460640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3b5c14a0d0 0x7f3b5c14a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55222/0 (socket says 172.21.15.118:55222) 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b61c5f640 1 -- 172.21.15.118:0/3024840976 learned_addr learned my addr 172.21.15.118:0/3024840976 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.799+0000 7f3b6145e640 1 --2- 172.21.15.118:0/3024840976 >> v2:172.21.15.164:3300/0 conn(0x7f3b5c06fda0 0x7f3b5c0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b62460640 1 -- 172.21.15.118:0/3024840976 >> v2:172.21.15.164:3300/0 conn(0x7f3b5c06fda0 msgr2=0x7f3b5c0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b62460640 1 --2- 172.21.15.118:0/3024840976 >> v2:172.21.15.164:3300/0 conn(0x7f3b5c06fda0 0x7f3b5c0b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b62460640 1 -- 172.21.15.118:0/3024840976 >> v1:172.21.15.118:6789/0 conn(0x7f3b5c0bc0a0 legacy=0x7f3b5c143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b60c5d640 1 -- 172.21.15.118:0/3024840976 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450883144 0 0) 0x7f3b5c149c40 con 0x7f3b5c0bc0a0 2024-02-18T10:01:35.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b62460640 1 -- 172.21.15.118:0/3024840976 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0b6120 con 0x7f3b5c14a0d0 2024-02-18T10:01:35.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b62460640 1 --2- 172.21.15.118:0/3024840976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c14a0d0 0x7f3b5c14a4e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0bcef0 tx=0x7f3b5402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44827ad992961c3e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b60c5d640 1 -- 172.21.15.118:0/3024840976 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54030610 con 0x7f3b5c14a0d0 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b60c5d640 1 -- 172.21.15.118:0/3024840976 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54030770 con 0x7f3b5c14a0d0 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.800+0000 7f3b60c5d640 1 -- 172.21.15.118:0/3024840976 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54030b00 con 0x7f3b5c14a0d0 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 -- 172.21.15.118:0/3024840976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c14a0d0 msgr2=0x7f3b5c14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/3024840976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c14a0d0 0x7f3b5c14a4e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0bcef0 tx=0x7f3b5402b960 comp rx=0 tx=0).stop 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 -- 172.21.15.118:0/3024840976 shutdown_connections 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/3024840976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c14a0d0 0x7f3b5c14a4e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/3024840976 >> v2:172.21.15.164:3300/0 conn(0x7f3b5c06fda0 0x7f3b5c0b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 -- 172.21.15.118:0/3024840976 >> 172.21.15.118:0/3024840976 conn(0x7f3b5c0bf330 msgr2=0x7f3b5c0bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 -- 172.21.15.118:0/3024840976 shutdown_connections 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.801+0000 7f3b63ec3640 1 -- 172.21.15.118:0/3024840976 wait complete. 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.802+0000 7f3b63ec3640 1 Processor -- start 2024-02-18T10:01:35.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.802+0000 7f3b63ec3640 1 -- start start 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c06fda0 0x7f3b5c13f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b5c0bc0a0 0x7f3b5c0b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b5c14a0d0 0x7f3b5c0b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0b97c0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0b7110 con 0x7f3b5c14a0d0 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c1421e0 con 0x7f3b5c0bc0a0 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c06fda0 0x7f3b5c13f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c06fda0 0x7f3b5c13f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55224/0 (socket says 172.21.15.118:55224) 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 -- 172.21.15.118:0/1558185876 learned_addr learned my addr 172.21.15.118:0/1558185876 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b6145e640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b5c0bc0a0 0x7f3b5c0b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b62460640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b5c14a0d0 0x7f3b5c0b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 -- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b5c0bc0a0 msgr2=0x7f3b5c0b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b5c0bc0a0 0x7f3b5c0b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 -- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b5c14a0d0 msgr2=0x7f3b5c0b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b5c14a0d0 0x7f3b5c0b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 -- 172.21.15.118:0/1558185876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54009400 con 0x7f3b5c06fda0 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b61c5f640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c06fda0 0x7f3b5c13f970 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800c890 tx=0x7f3b5800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b527fc640 1 -- 172.21.15.118:0/1558185876 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800a640 con 0x7f3b5c06fda0 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b527fc640 1 -- 172.21.15.118:0/1558185876 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5800a7c0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c1429f0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b527fc640 1 -- 172.21.15.118:0/1558185876 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800ab70 con 0x7f3b5c06fda0 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.803+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c1431d0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.804+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c074af0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.805+0000 7f3b527fc640 1 -- 172.21.15.118:0/1558185876 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f3b5800acd0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.805+0000 7f3b527fc640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3b4006bc70 0x7f3b4006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:35.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.805+0000 7f3b6145e640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3b4006bc70 0x7f3b4006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:35.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.805+0000 7f3b527fc640 1 -- 172.21.15.118:0/1558185876 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b58089fc0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.805+0000 7f3b6145e640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3b4006bc70 0x7f3b4006e130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c1408e0 tx=0x7f3b4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:35.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:35.809+0000 7f3b527fc640 1 -- 172.21.15.118:0/1558185876 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b580bd8c0 con 0x7f3b5c06fda0 2024-02-18T10:01:35.883 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-02-18T10:01:35.880+0000 7fd717ef7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-18T10:01:36.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.016+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b5c1427d0 con 0x7f3b5c06fda0 2024-02-18T10:01:36.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.017+0000 7f3b527fc640 1 -- 172.21.15.118:0/1558185876 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4156 (secure 0 0 0) 0x7f3b58018020 con 0x7f3b5c06fda0 2024-02-18T10:01:36.020 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:01:36.020 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4732,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1586932009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1586932009},{"type":"v1","addr":"172.21.15.164:6833","nonce":1586932009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/1218312757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1218312757},{"type":"v1","addr":"172.21.15.118:6836","nonce":1218312757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:01:31.339623+0000","modified":"2024-02-18T10:01:33.344937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6837/2626574740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":2626574740},{"type":"v1","addr":"172.21.15.118:6837","nonce":2626574740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-18T10:01:36.020 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 13 2024-02-18T10:01:36.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3b4006bc70 msgr2=0x7f3b4006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3b4006bc70 0x7f3b4006e130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c1408e0 tx=0x7f3b4c008040 comp rx=0 tx=0).stop 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c06fda0 msgr2=0x7f3b5c13f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c06fda0 0x7f3b5c13f970 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800c890 tx=0x7f3b5800cd50 comp rx=0 tx=0).stop 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 shutdown_connections 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3b4006bc70 0x7f3b4006e130 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b5c14a0d0 0x7f3b5c0b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b5c0bc0a0 0x7f3b5c0b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 --2- 172.21.15.118:0/1558185876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3b5c06fda0 0x7f3b5c13f970 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 >> 172.21.15.118:0/1558185876 conn(0x7f3b5c0bf330 msgr2=0x7f3b5c0ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 shutdown_connections 2024-02-18T10:01:36.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.019+0000 7f3b63ec3640 1 -- 172.21.15.118:0/1558185876 wait complete. 2024-02-18T10:01:36.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-18T10:01:31.339623+0000', 'modified': '2024-02-18T10:01:33.344937+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4998}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4998': {'gid': 4998, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6837/2626574740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6835', 'nonce': 2626574740}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 2626574740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-18T10:01:36.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-18T10:01:36.334 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-18T10:01:36.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.433+0000 7f5f1c1e2640 1 Processor -- start 2024-02-18T10:01:36.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.433+0000 7f5f1c1e2640 1 -- start start 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1c1e2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f14147100 0x7f5f14070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1c1e2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5f140b9490 0x7f5f1406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1c1e2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f14071840 con 0x7f5f140b98d0 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1c1e2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f14071c30 con 0x7f5f140b9490 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1c1e2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f14070ee0 con 0x7f5f14147100 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1977d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5f140b9490 0x7f5f1406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1977d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5f140b9490 0x7f5f1406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55226/0 (socket says 172.21.15.118:55226) 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1977d640 1 -- 172.21.15.118:0/260445811 learned_addr learned my addr 172.21.15.118:0/260445811 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1977d640 1 -- 172.21.15.118:0/260445811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f14147100 msgr2=0x7f5f14070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1977d640 1 --2- 172.21.15.118:0/260445811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f14147100 0x7f5f14070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1977d640 1 -- 172.21.15.118:0/260445811 >> v1:172.21.15.164:6789/0 conn(0x7f5f140b98d0 legacy=0x7f5f140b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.434+0000 7f5f1977d640 1 -- 172.21.15.118:0/260445811 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1414d020 con 0x7f5f140b9490 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.435+0000 7f5f1977d640 1 --2- 172.21.15.118:0/260445811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1406db80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33934900c6ef557e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.435+0000 7f5f18f7c640 1 -- 172.21.15.118:0/260445811 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04031640 con 0x7f5f140b9490 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.435+0000 7f5f18f7c640 1 -- 172.21.15.118:0/260445811 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f040317a0 con 0x7f5f140b9490 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.435+0000 7f5f18f7c640 1 -- 172.21.15.118:0/260445811 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04031b30 con 0x7f5f140b9490 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/260445811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 msgr2=0x7f5f1406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/260445811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1406db80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0402b8f0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/260445811 shutdown_connections 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/260445811 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1406db80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/260445811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f14147100 0x7f5f14070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/260445811 >> 172.21.15.118:0/260445811 conn(0x7f5f1406abe0 msgr2=0x7f5f1406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/260445811 shutdown_connections 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.436+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/260445811 wait complete. 2024-02-18T10:01:36.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 Processor -- start 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 -- start start 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1414c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f140b98d0 0x7f5f140a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f14147100 0x7f5f1413b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1414ca60 con 0x7f5f140b9490 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140a0c50 con 0x7f5f14147100 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f1c1e2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1414abe0 con 0x7f5f140b98d0 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.437+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1414c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1414c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55234/0 (socket says 172.21.15.118:55234) 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 -- 172.21.15.118:0/385250863 learned_addr learned my addr 172.21.15.118:0/385250863 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 -- 172.21.15.118:0/385250863 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f140b98d0 msgr2=0x7f5f140a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f140b98d0 0x7f5f140a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 -- 172.21.15.118:0/385250863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f14147100 msgr2=0x7f5f1413b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f14147100 0x7f5f1413b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 -- 172.21.15.118:0/385250863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040094d0 con 0x7f5f140b9490 2024-02-18T10:01:36.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1414c520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000b4a0 tx=0x7f5f1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f0a7fc640 1 -- 172.21.15.118:0/385250863 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10010610 con 0x7f5f140b9490 2024-02-18T10:01:36.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f0a7fc640 1 -- 172.21.15.118:0/385250863 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10010770 con 0x7f5f140b9490 2024-02-18T10:01:36.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f140a06d0 con 0x7f5f140b9490 2024-02-18T10:01:36.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f0a7fc640 1 -- 172.21.15.118:0/385250863 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10010b20 con 0x7f5f140b9490 2024-02-18T10:01:36.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.438+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f140a3020 con 0x7f5f140b9490 2024-02-18T10:01:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.440+0000 7f5f0a7fc640 1 -- 172.21.15.118:0/385250863 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f5f10010c80 con 0x7f5f140b9490 2024-02-18T10:01:36.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.440+0000 7f5f0a7fc640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5ef806bca0 0x7f5ef806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.440+0000 7f5f0a7fc640 1 -- 172.21.15.118:0/385250863 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f1008a370 con 0x7f5f140b9490 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.440+0000 7f5f1977d640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5ef806bca0 0x7f5ef806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.441+0000 7f5f1977d640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5ef806bca0 0x7f5ef806e160 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5f04036000 tx=0x7f5f04030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.441+0000 7f5f1edb9740 1 Processor -- start 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.441+0000 7f5f1edb9740 1 -- start start 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd28fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd28fbca0 0x555fd292c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd292ce70 0x555fd292d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd28bbdc0 con 0x555fd28fbca0 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd286ef20 con 0x555fd292ce70 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fd286c450 con 0x555fd2937590 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd28fbca0 0x555fd292c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd28fbca0 0x555fd292c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55238/0 (socket says 172.21.15.118:55238) 2024-02-18T10:01:36.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 -- 172.21.15.118:0/4168053391 learned_addr learned my addr 172.21.15.118:0/4168053391 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd28fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1a77f640 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd292ce70 0x555fd292d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 -- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 msgr2=0x555fd28fb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd28fb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 -- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd292ce70 msgr2=0x555fd292d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd292ce70 0x555fd292d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 -- 172.21.15.118:0/4168053391 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fd281cf20 con 0x555fd28fbca0 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5f1977d640 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd28fbca0 0x555fd292c930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5f0402b930 tx=0x7f5f04031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7093b8942228d280 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5ef77fe640 1 -- 172.21.15.118:0/4168053391 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0403a760 con 0x555fd28fbca0 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5ef77fe640 1 -- 172.21.15.118:0/4168053391 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04049070 con 0x555fd28fbca0 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.442+0000 7f5ef77fe640 1 -- 172.21.15.118:0/4168053391 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0403aac0 con 0x555fd28fbca0 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 -- 172.21.15.118:0/4168053391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd28fbca0 msgr2=0x555fd292c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd28fbca0 0x555fd292c930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5f0402b930 tx=0x7f5f04031000 comp rx=0 tx=0).stop 2024-02-18T10:01:36.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 -- 172.21.15.118:0/4168053391 shutdown_connections 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd292ce70 0x555fd292d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd28fbca0 0x555fd292c930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/4168053391 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd28fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 -- 172.21.15.118:0/4168053391 >> 172.21.15.118:0/4168053391 conn(0x555fd28fd0f0 msgr2=0x555fd2936c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 -- 172.21.15.118:0/4168053391 shutdown_connections 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.443+0000 7f5f1edb9740 1 -- 172.21.15.118:0/4168053391 wait complete. 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 -- start start 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 Processor -- start 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd292ce70 0x555fd2929590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd2943910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2927480 0x555fd2923d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd2867c30 con 0x555fd292ce70 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd280cd30 con 0x555fd2927480 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fd253b310 con 0x555fd2937590 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f1edb9740 10 client.0 _ll_register_callbacks cb 0x555fd2814d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.444+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd292ce70 0x555fd2929590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd292ce70 0x555fd2929590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55250/0 (socket says 172.21.15.118:55250) 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 -- 172.21.15.118:0/2980306225 learned_addr learned my addr 172.21.15.118:0/2980306225 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1a77f640 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2927480 0x555fd2923d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1977d640 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd2943910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 -- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 msgr2=0x555fd2943910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd2943910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 -- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2927480 msgr2=0x555fd2923d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2927480 0x555fd2923d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 -- 172.21.15.118:0/2980306225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f04040070 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd292ce70 0x555fd2929590 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5f10058640 tx=0x7f5f1005cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993da86459008348 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5ef4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/2980306225 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10056d00 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/2980306225 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f10057d90 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fd25676c0 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/2980306225 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f10057f50 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1edb9740 10 client.5172 fetch_fsmap learned FSMap version 13 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x555fd28662b0 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/2980306225 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10074070 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/2980306225 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 13) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f5f10070180 con 0x555fd292ce70 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1edb9740 10 client.5172 fetch_fsmap finished waiting for FSMap version 13 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1edb9740 10 client.5172 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-18T10:01:36.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1edb9740 20 client.5172 populate_metadata read hostname 'smithi118' 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.445+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2947510 0x555fd29524a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5f1edb9740 4 client.5172 mds_command: new command op to 4998 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 --> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fd25b8270 con 0x555fd2947510 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5f1977d640 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2947510 0x555fd29524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5ef4ff9640 10 client.5172 ms_handle_connect on v2:172.21.15.118:6835/2626574740 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5f1977d640 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2947510 0x555fd29524a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7475e79e02eb93 server_cookie=1f42f6814d7fe7a7 in_seq=0 out_seq=0 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/2980306225 <== mds.0 v2:172.21.15.118:6835/2626574740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555fd25b8270 con 0x555fd2947510 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5ef4ff9640 10 client.5172 handle_command_reply: tid=0 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.446+0000 7f5f1edb9740 1 client.5172 shutdown 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd292ce70 msgr2=0x555fd2929590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd292ce70 0x555fd2929590 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5f10058640 tx=0x7f5f1005cb50 comp rx=0 tx=0).stop 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 shutdown_connections 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2947510 0x555fd29524a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2927480 0x555fd2923d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd2937590 0x555fd2943910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/2980306225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd292ce70 0x555fd2929590 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5ef4ff9640 0 client.5172 ms_handle_reset on v2:172.21.15.118:6835/2626574740 2024-02-18T10:01:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 >> 172.21.15.118:0/2980306225 conn(0x555fd28fbca0 msgr2=0x555fd2928750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 shutdown_connections 2024-02-18T10:01:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 1 -- 172.21.15.118:0/2980306225 wait complete. 2024-02-18T10:01:36.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.447+0000 7f5f1edb9740 20 client.5172 trim_cache size 0 max 16384 2024-02-18T10:01:36.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.462+0000 7f5f1edb9740 1 Processor -- start 2024-02-18T10:01:36.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.462+0000 7f5f1edb9740 1 -- start start 2024-02-18T10:01:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd29004c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 0x555fd29367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 0x555fd2936d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd27ed490 con 0x555fd2927480 2024-02-18T10:01:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd2946c90 con 0x555fd2937590 2024-02-18T10:01:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fd2937250 con 0x555fd292ce70 2024-02-18T10:01:36.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd29004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd29004c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55260/0 (socket says 172.21.15.118:55260) 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 -- 172.21.15.118:0/673717866 learned_addr learned my addr 172.21.15.118:0/673717866 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 -- 172.21.15.118:0/673717866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 msgr2=0x555fd29367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/673717866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 0x555fd29367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 -- 172.21.15.118:0/673717866 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 msgr2=0x555fd2936d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/673717866 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 0x555fd2936d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 -- 172.21.15.118:0/673717866 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fd2802a20 con 0x555fd2927480 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/673717866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd29004c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5f10058410 tx=0x7f5f1001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d91d2e3cb135a8b server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.463+0000 7f5ef6ffd640 1 -- 172.21.15.118:0/673717866 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10058480 con 0x555fd2927480 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5ef6ffd640 1 -- 172.21.15.118:0/673717866 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10074070 con 0x555fd2927480 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5ef6ffd640 1 -- 172.21.15.118:0/673717866 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10056d00 con 0x555fd2927480 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 -- 172.21.15.118:0/673717866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 msgr2=0x555fd29004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/673717866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd29004c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5f10058410 tx=0x7f5f1001b000 comp rx=0 tx=0).stop 2024-02-18T10:01:36.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 -- 172.21.15.118:0/673717866 shutdown_connections 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/673717866 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 0x555fd2936d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/673717866 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 0x555fd29367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/673717866 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd29004c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 -- 172.21.15.118:0/673717866 >> 172.21.15.118:0/673717866 conn(0x555fd28fbca0 msgr2=0x555fd28fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 -- 172.21.15.118:0/673717866 shutdown_connections 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.464+0000 7f5f1edb9740 1 -- 172.21.15.118:0/673717866 wait complete. 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 -- start start 2024-02-18T10:01:36.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 Processor -- start 2024-02-18T10:01:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd2930420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 0x555fd29568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 0x555fd2928140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd29a1f80 con 0x555fd2927480 2024-02-18T10:01:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fd292ff90 con 0x555fd2937590 2024-02-18T10:01:36.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.465+0000 7f5f1edb9740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x555fd2956e00 con 0x555fd292ce70 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 10 client.0 _ll_register_callbacks cb 0x7f5f040096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd2930420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd2930420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55276/0 (socket says 172.21.15.118:55276) 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 -- 172.21.15.118:0/1007463772 learned_addr learned my addr 172.21.15.118:0/1007463772 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1977d640 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 0x555fd29568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 -- 172.21.15.118:0/1007463772 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 msgr2=0x555fd29568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 0x555fd29568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 -- 172.21.15.118:0/1007463772 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 msgr2=0x555fd2928140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 0x555fd2928140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 -- 172.21.15.118:0/1007463772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555fd28662b0 con 0x555fd2927480 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f19f7e640 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd2930420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f10054da0 tx=0x7f5f10088800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8abe451d788c052 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5ef4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/1007463772 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10061050 con 0x555fd2927480 2024-02-18T10:01:36.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/1007463772 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f10054fb0 con 0x555fd2927480 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f04049070 con 0x555fd2927480 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/1007463772 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f10055190 con 0x555fd2927480 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 10 client.5178 fetch_fsmap learned FSMap version 13 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x555fd2828780 con 0x555fd2927480 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/1007463772 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04049070 con 0x555fd2927480 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/1007463772 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 13) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f5f10077350 con 0x555fd2927480 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 10 client.5178 fetch_fsmap finished waiting for FSMap version 13 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 10 client.5178 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 20 client.5178 populate_metadata read hostname 'smithi118' 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2940580 0x555fd2940960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 4 client.5178 mds_command: new command op to 4998 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.466+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 --> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555fd25a4610 con 0x555fd2940580 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1977d640 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2940580 0x555fd2940960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5ef4ff9640 10 client.5178 ms_handle_connect on v2:172.21.15.118:6835/2626574740 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1977d640 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2940580 0x555fd2940960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0fc37c839774123 server_cookie=4bef610471d8ad4a in_seq=0 out_seq=0 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5ef4ff9640 1 -- 172.21.15.118:0/1007463772 <== mds.0 v2:172.21.15.118:6835/2626574740 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555fd25a4610 con 0x555fd2940580 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5ef4ff9640 10 client.5178 handle_command_reply: tid=0 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 client.5178 shutdown 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 msgr2=0x555fd2930420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd2930420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f10054da0 tx=0x7f5f10088800 comp rx=0 tx=0).stop 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 shutdown_connections 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:6835/2626574740,v1:172.21.15.118:6837/2626574740] conn(0x555fd2940580 0x555fd2940960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555fd2937590 0x555fd2928140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x555fd292ce70 0x555fd29568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5ef4ff9640 0 client.5178 ms_handle_reset on v2:172.21.15.118:6835/2626574740 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 --2- 172.21.15.118:0/1007463772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555fd2927480 0x555fd2930420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 >> 172.21.15.118:0/1007463772 conn(0x555fd28fbca0 msgr2=0x555fd29004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 shutdown_connections 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 1 -- 172.21.15.118:0/1007463772 wait complete. 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.467+0000 7f5f1edb9740 20 client.5178 trim_cache size 0 max 16384 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "96fc967a-d47f-4a89-a97a-6d7920f41e97", 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4998, 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 4.4749140079999998, 2024-02-18T10:01:36.477 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 13, 2024-02-18T10:01:36.478 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 31, 2024-02-18T10:01:36.478 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 31, 2024-02-18T10:01:36.478 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 11.452979632 2024-02-18T10:01:36.478 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5ef806bca0 msgr2=0x7f5ef806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5ef806bca0 0x7f5ef806e160 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5f04036000 tx=0x7f5f04030000 comp rx=0 tx=0).stop 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 msgr2=0x7f5f1414c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1414c520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000b4a0 tx=0x7f5f1000b960 comp rx=0 tx=0).stop 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 shutdown_connections 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f5ef806bca0 0x7f5ef806e160 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f14147100 0x7f5f1413b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f140b98d0 0x7f5f140a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 --2- 172.21.15.118:0/385250863 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5f140b9490 0x7f5f1414c520 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 >> 172.21.15.118:0/385250863 conn(0x7f5f1406abe0 msgr2=0x7f5f1406dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 shutdown_connections 2024-02-18T10:01:36.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.468+0000 7f5f1c1e2640 1 -- 172.21.15.118:0/385250863 wait complete. 2024-02-18T10:01:36.481 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-18T10:01:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.578+0000 7f85923eb640 1 Processor -- start 2024-02-18T10:01:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.578+0000 7f85923eb640 1 -- start start 2024-02-18T10:01:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.578+0000 7f85923eb640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f858c145f80 0x7f858c06eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.578+0000 7f85923eb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0bab60 0x7f858c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f85923eb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c14f240 con 0x7f858c0baf80 2024-02-18T10:01:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f85923eb640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c06f080 con 0x7f858c145f80 2024-02-18T10:01:36.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f85923eb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c06f260 con 0x7f858c0bab60 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858b7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0bab60 0x7f858c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858bfff640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f858c145f80 0x7f858c06eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858b7fe640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0bab60 0x7f858c14f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:45028/0 (socket says 172.21.15.118:45028) 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858b7fe640 1 -- 172.21.15.118:0/1922535186 learned_addr learned my addr 172.21.15.118:0/1922535186 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858bfff640 1 -- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0bab60 msgr2=0x7f858c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858bfff640 1 --2- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0bab60 0x7f858c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858bfff640 1 -- 172.21.15.118:0/1922535186 >> v1:172.21.15.164:6789/0 conn(0x7f858c0baf80 legacy=0x7f858c072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858bfff640 1 -- 172.21.15.118:0/1922535186 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c06f540 con 0x7f858c145f80 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858affd640 1 -- 172.21.15.118:0/1922535186 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548318786 0 0) 0x7f858c14f240 con 0x7f858c0baf80 2024-02-18T10:01:36.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.579+0000 7f858b7fe640 1 --2- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0bab60 0x7f858c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.580+0000 7f858bfff640 1 --2- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 0x7f858c06eb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f85740097a0 tx=0x7f857402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba13efff7d95ea6a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.580+0000 7f858affd640 1 -- 172.21.15.118:0/1922535186 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8574031830 con 0x7f858c145f80 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.580+0000 7f858affd640 1 -- 172.21.15.118:0/1922535186 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8574031990 con 0x7f858c145f80 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.580+0000 7f858affd640 1 -- 172.21.15.118:0/1922535186 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8574031d20 con 0x7f858c145f80 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 -- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 msgr2=0x7f858c06eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 --2- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 0x7f858c06eb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f85740097a0 tx=0x7f857402b8d0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 -- 172.21.15.118:0/1922535186 shutdown_connections 2024-02-18T10:01:36.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 --2- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0bab60 0x7f858c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 --2- 172.21.15.118:0/1922535186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 0x7f858c06eb40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 -- 172.21.15.118:0/1922535186 >> 172.21.15.118:0/1922535186 conn(0x7f858c0a11c0 msgr2=0x7f858c0a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 -- 172.21.15.118:0/1922535186 shutdown_connections 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.581+0000 7f85923eb640 1 -- 172.21.15.118:0/1922535186 wait complete. 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.582+0000 7f85923eb640 1 Processor -- start 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.582+0000 7f85923eb640 1 -- start start 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f858c0bab60 0x7f858c072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0baf80 0x7f858c09df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 0x7f858c09e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c072b80 con 0x7f858c0bab60 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c14d3e0 con 0x7f858c145f80 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c14ee40 con 0x7f858c0baf80 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f858c0bab60 0x7f858c072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f858c0bab60 0x7f858c072640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55286/0 (socket says 172.21.15.118:55286) 2024-02-18T10:01:36.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 -- 172.21.15.118:0/3599842923 learned_addr learned my addr 172.21.15.118:0/3599842923 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858b7fe640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0baf80 0x7f858c09df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f8590988640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 0x7f858c09e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 -- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0baf80 msgr2=0x7f858c09df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0baf80 0x7f858c09df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 -- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 msgr2=0x7f858c09e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 0x7f858c09e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 -- 172.21.15.118:0/3599842923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0094d0 con 0x7f858c0bab60 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f858bfff640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f858c0bab60 0x7f858c072640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f85740097a0 tx=0x7f85740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f8588ff9640 1 -- 172.21.15.118:0/3599842923 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8574004230 con 0x7f858c0bab60 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f8588ff9640 1 -- 172.21.15.118:0/3599842923 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8574004390 con 0x7f858c0bab60 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8574009400 con 0x7f858c0bab60 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f8588ff9640 1 -- 172.21.15.118:0/3599842923 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857403a870 con 0x7f858c0bab60 2024-02-18T10:01:36.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.583+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c14d930 con 0x7f858c0bab60 2024-02-18T10:01:36.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.584+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c0a0630 con 0x7f858c0bab60 2024-02-18T10:01:36.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.585+0000 7f8588ff9640 1 -- 172.21.15.118:0/3599842923 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f857403a9d0 con 0x7f858c0bab60 2024-02-18T10:01:36.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.585+0000 7f8588ff9640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f856c06bc70 0x7f856c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:01:36.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.585+0000 7f8588ff9640 1 -- 172.21.15.118:0/3599842923 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85740ac750 con 0x7f858c0bab60 2024-02-18T10:01:36.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.585+0000 7f858b7fe640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f856c06bc70 0x7f856c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:01:36.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.586+0000 7f858b7fe640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f856c06bc70 0x7f856c06e130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f858c14d310 tx=0x7f857c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:01:36.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.590+0000 7f8588ff9640 1 -- 172.21.15.118:0/3599842923 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f858c0a0630 con 0x7f858c0bab60 2024-02-18T10:01:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.800+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f858c0a0630 con 0x7f858c0bab60 2024-02-18T10:01:36.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.800+0000 7f8588ff9640 1 -- 172.21.15.118:0/3599842923 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8574035060 con 0x7f858c0bab60 2024-02-18T10:01:36.803 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-18T10:01:36.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f856c06bc70 msgr2=0x7f856c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f856c06bc70 0x7f856c06e130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f858c14d310 tx=0x7f857c009240 comp rx=0 tx=0).stop 2024-02-18T10:01:36.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f858c0bab60 msgr2=0x7f858c072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:01:36.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f858c0bab60 0x7f858c072640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f85740097a0 tx=0x7f85740046c0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 shutdown_connections 2024-02-18T10:01:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f856c06bc70 0x7f856c06e130 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f858c145f80 0x7f858c09e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f858c0baf80 0x7f858c09df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 --2- 172.21.15.118:0/3599842923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f858c0bab60 0x7f858c072640 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:01:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 >> 172.21.15.118:0/3599842923 conn(0x7f858c0a11c0 msgr2=0x7f858c06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:01:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 shutdown_connections 2024-02-18T10:01:36.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:01:36.802+0000 7f85923eb640 1 -- 172.21.15.118:0/3599842923 wait complete. 2024-02-18T10:01:36.815 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-18T10:01:36.816 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-18T10:01:36.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:36.816 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2024-02-18T10:01:36.875 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-18T10:01:36.875 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-18T10:01:36.875 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2024-02-18T10:01:36.876 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:36.876 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2024-02-18T10:01:36.876 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:36.876 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-18T10:01:36.876 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:36.876 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42608sec preferred_lft 42608sec 2024-02-18T10:01:36.877 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link proto kernel_ll 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 32:0a:b9:47:62:44 brd ff:ff:ff:ff:ff:ff 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::408a:c9ff:fec3:93b0/64 scope link proto kernel_ll 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 32:0a:b9:47:62:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-18T10:01:36.878 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::300a:b9ff:fe47:6244/64 scope link proto kernel_ll 2024-02-18T10:01:36.879 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2024-02-18T10:01:36.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:36.879 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-18T10:01:36.964 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-02-18T10:01:36.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:36.969 DEBUG:teuthology.orchestra.run.smithi204:> route 2024-02-18T10:01:37.020 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2024-02-18T10:01:37.020 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-18T10:01:37.020 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-18T10:01:37.020 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-18T10:01:37.020 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-18T10:01:37.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.021 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2024-02-18T10:01:37.021 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2024-02-18T10:01:37.021 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-18T10:01:37.021 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-18T10:01:37.022 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-18T10:01:37.022 DEBUG:teuthology.orchestra.run.smithi204:> ') 2024-02-18T10:01:37.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.204 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-02-18T10:01:37.256 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-18T10:01:37.256 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-18T10:01:37.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.256 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2024-02-18T10:01:37.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-18T10:01:37.348 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:37.402 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-18T10:01:37.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-18T10:01:37.402 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:37.452 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-02-18T10:01:37.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.453 DEBUG:teuthology.orchestra.run.smithi204:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-18T10:01:37.589 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-18T10:01:37.589 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-18T10:01:37.619 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-18T10:01:37.619 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-18T10:01:37.619 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.164:3300,172.21.15.164:3301" 2024-02-18T10:01:37.619 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: trying mount with new device syntax: 0@96fc967a-d47f-4a89-a97a-6d7920f41e97.cephfs=/ 2024-02-18T10:01:37.619 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.118:3300/172.21.15.164:3300/172.21.15.164:3301" will pass to kernel 2024-02-18T10:01:37.622 INFO:teuthology.orchestra.run.smithi204.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-18T10:01:37.622 INFO:teuthology.orchestra.run.smithi204.stdout: You just mounted a file system that supports labels which does not 2024-02-18T10:01:37.622 INFO:teuthology.orchestra.run.smithi204.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-18T10:01:37.622 INFO:teuthology.orchestra.run.smithi204.stdout: applications will generate AVC messages and not be allowed access to 2024-02-18T10:01:37.622 INFO:teuthology.orchestra.run.smithi204.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-18T10:01:37.625 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-18T10:01:37.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.625 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-18T10:01:37.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.708 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-18T10:01:37.773 INFO:teuthology.orchestra.run.smithi204.stdout:client4697 2024-02-18T10:01:37.773 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:01:37.773 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T10:01:37.827 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=xfstests-dev 2024-02-18T10:01:37.881 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.pjmFjSgc0uxfstests-dev 2024-02-18T10:01:37.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.881 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.pjmFjSgc0uxfstests-dev) 2024-02-18T10:01:37.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:37.974 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.pjmFjSgc0uxfstests-dev) 2024-02-18T10:01:38.027 INFO:teuthology.orchestra.run.smithi204.stderr:Cloning into '/tmp/tmp.pjmFjSgc0uxfstests-dev'... 2024-02-18T10:01:39.072 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=xfsprogs-dev 2024-02-18T10:01:39.124 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.qNdAS3jX7mxfsprogs-dev 2024-02-18T10:01:39.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:39.125 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.qNdAS3jX7mxfsprogs-dev) 2024-02-18T10:01:39.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:39.224 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.qNdAS3jX7mxfsprogs-dev) 2024-02-18T10:01:39.277 INFO:teuthology.orchestra.run.smithi204.stderr:Cloning into '/tmp/tmp.qNdAS3jX7mxfsprogs-dev'... 2024-02-18T10:01:39.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:39.928 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-02-18T10:01:39.989 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=test 2024-02-18T10:01:40.036 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.QUduP9NKsItest 2024-02-18T10:01:40.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T10:01:40.036 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-02-18T10:01:40.136 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=scratch 2024-02-18T10:01:40.187 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.w8GvOpYWfNscratch 2024-02-18T10:01:40.187 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-02-18T10:01:40.187 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel 2024-02-18T10:01:41.041 INFO:teuthology.orchestra.run.smithi204.stdout:Last metadata expiration check: 0:03:29 ago on Sun 18 Feb 2024 09:58:12 AM UTC. 2024-02-18T10:01:41.164 INFO:teuthology.orchestra.run.smithi204.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-02-18T10:01:41.165 INFO:teuthology.orchestra.run.smithi204.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-02-18T10:01:41.166 INFO:teuthology.orchestra.run.smithi204.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-02-18T10:01:41.167 INFO:teuthology.orchestra.run.smithi204.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-02-18T10:01:41.168 INFO:teuthology.orchestra.run.smithi204.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-02-18T10:01:41.170 INFO:teuthology.orchestra.run.smithi204.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-02-18T10:01:41.172 INFO:teuthology.orchestra.run.smithi204.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-02-18T10:01:41.173 INFO:teuthology.orchestra.run.smithi204.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-02-18T10:01:41.175 INFO:teuthology.orchestra.run.smithi204.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-02-18T10:01:41.178 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-02-18T10:01:41.179 INFO:teuthology.orchestra.run.smithi204.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-02-18T10:01:41.181 INFO:teuthology.orchestra.run.smithi204.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-02-18T10:01:41.182 INFO:teuthology.orchestra.run.smithi204.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-02-18T10:01:41.183 INFO:teuthology.orchestra.run.smithi204.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-02-18T10:01:41.184 INFO:teuthology.orchestra.run.smithi204.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-02-18T10:01:41.185 INFO:teuthology.orchestra.run.smithi204.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-02-18T10:01:41.186 INFO:teuthology.orchestra.run.smithi204.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-02-18T10:01:41.187 INFO:teuthology.orchestra.run.smithi204.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-02-18T10:01:41.188 INFO:teuthology.orchestra.run.smithi204.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-02-18T10:01:41.191 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-02-18T10:01:41.195 INFO:teuthology.orchestra.run.smithi204.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2024-02-18T10:01:41.197 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-18T10:01:41.274 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-02-18T10:01:41.279 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-02-18T10:01:41.279 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-02-18T10:01:41.279 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-02-18T10:01:41.279 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-02-18T10:01:41.279 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-devel x86_64 9:1.02.197-2.el9 crb 43 k 2024-02-18T10:01:41.279 INFO:teuthology.orchestra.run.smithi204.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-02-18T10:01:41.279 INFO:teuthology.orchestra.run.smithi204.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: inih-devel x86_64 49-6.el9 crb 11 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-devel x86_64 5.14.0-421.el9 CentOS-AppStream 22 M 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 17 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: libedit-devel x86_64 3.1-38.20210216cvs.el9 CentOS-AppStream 39 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: libicu-devel x86_64 67.1-9.el9 CentOS-AppStream 830 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout: userspace-rcu-devel x86_64 0.12.1-6.el9 crb 120 k 2024-02-18T10:01:41.280 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: cpp x86_64 11.4.1-3.el9 CentOS-AppStream 11 M 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper x86_64 9:1.02.197-2.el9 CentOS-BaseOS 139 k 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 CentOS-BaseOS 33 k 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 CentOS-BaseOS 31 k 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 CentOS-BaseOS 178 k 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: e2fsprogs x86_64 1.46.5-5.el9 CentOS-BaseOS 1.0 M 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 CentOS-BaseOS 221 k 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: gcc x86_64 11.4.1-3.el9 CentOS-AppStream 32 M 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: gcc-c++ x86_64 11.4.1-3.el9 CentOS-AppStream 13 M 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 CentOS-AppStream 46 k 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: git x86_64 2.43.0-1.el9 CentOS-AppStream 50 k 2024-02-18T10:01:41.281 INFO:teuthology.orchestra.run.smithi204.stdout: git-core x86_64 2.43.0-1.el9 CentOS-AppStream 4.4 M 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: git-core-doc noarch 2.43.0-1.el9 CentOS-AppStream 2.6 M 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: libcom_err x86_64 1.46.5-5.el9 CentOS-BaseOS 25 k 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: libgcc x86_64 11.4.1-3.el9 CentOS-BaseOS 91 k 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: libgomp x86_64 11.4.1-3.el9 CentOS-BaseOS 267 k 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: libss x86_64 1.46.5-5.el9 CentOS-BaseOS 31 k 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: libstdc++ x86_64 11.4.1-3.el9 CentOS-BaseOS 739 k 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: libstdc++-devel x86_64 11.4.1-3.el9 CentOS-AppStream 2.2 M 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: lvm2 x86_64 9:2.03.23-2.el9 CentOS-BaseOS 1.5 M 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 CentOS-BaseOS 1.0 M 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: make x86_64 1:4.3-8.el9 CentOS-BaseOS 529 k 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: perl-Git noarch 2.43.0-1.el9 CentOS-AppStream 37 k 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: python-unversioned-command 2024-02-18T10:01:41.282 INFO:teuthology.orchestra.run.smithi204.stdout: noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: systemd x86_64 252-26.el9 CentOS-BaseOS 4.0 M 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-libs x86_64 252-26.el9 CentOS-BaseOS 658 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-pam x86_64 252-26.el9 CentOS-BaseOS 266 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-rpm-macros noarch 252-26.el9 CentOS-BaseOS 54 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-udev x86_64 252-26.el9 CentOS-BaseOS 1.8 M 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-02-18T10:01:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: libnbd x86_64 1.18.1-3.el9 CentOS-AppStream 165 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: libselinux-devel x86_64 3.5-1.el9 appstream 160 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: libsepol-devel x86_64 3.5-1.el9 appstream 48 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-devel x86_64 10.40-2.el9 appstream 515 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf16 x86_64 10.40-2.el9 appstream 217 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf32 x86_64 10.40-2.el9 appstream 206 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-devel x86_64 252-26.el9 CentOS-AppStream 487 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-02-18T10:01:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout:Install 29 Packages 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 33 Packages 2024-02-18T10:01:41.285 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T10:01:41.286 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 118 M 2024-02-18T10:01:41.286 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-02-18T10:01:42.076 INFO:teuthology.orchestra.run.smithi204.stdout:(1/62): fio-engine-http-3.35-1.el9.x86_64.rpm 77 kB/s | 17 kB 00:00 2024-02-18T10:01:42.092 INFO:teuthology.orchestra.run.smithi204.stdout:(2/62): fio-engine-libaio-3.35-1.el9.x86_64.rpm 61 kB/s | 14 kB 00:00 2024-02-18T10:01:42.218 INFO:teuthology.orchestra.run.smithi204.stdout:(3/62): fio-engine-nbd-3.35-1.el9.x86_64.rpm 96 kB/s | 13 kB 00:00 2024-02-18T10:01:42.234 INFO:teuthology.orchestra.run.smithi204.stdout:(4/62): fio-engine-rados-3.35-1.el9.x86_64.rpm 103 kB/s | 15 kB 00:00 2024-02-18T10:01:42.360 INFO:teuthology.orchestra.run.smithi204.stdout:(5/62): fio-engine-rbd-3.35-1.el9.x86_64.rpm 107 kB/s | 15 kB 00:00 2024-02-18T10:01:42.385 INFO:teuthology.orchestra.run.smithi204.stdout:(6/62): fio-engine-rdma-3.35-1.el9.x86_64.rpm 135 kB/s | 20 kB 00:00 2024-02-18T10:01:42.535 INFO:teuthology.orchestra.run.smithi204.stdout:(7/62): fio-3.35-1.el9.x86_64.rpm 9.2 MB/s | 6.2 MB 00:00 2024-02-18T10:01:42.627 INFO:teuthology.orchestra.run.smithi204.stdout:(8/62): libblkid-devel-2.37.4-18.el9.x86_64.rpm 70 kB/s | 17 kB 00:00 2024-02-18T10:01:42.686 INFO:teuthology.orchestra.run.smithi204.stdout:(9/62): libcap-devel-2.48-9.el9.x86_64.rpm 241 kB/s | 33 kB 00:00 2024-02-18T10:01:42.978 INFO:teuthology.orchestra.run.smithi204.stdout:(10/62): kernel-devel-5.14.0-421.el9.x86_64.rpm 35 MB/s | 22 MB 00:00 2024-02-18T10:01:43.012 INFO:teuthology.orchestra.run.smithi204.stdout:(11/62): libicu-devel-67.1-9.el9.x86_64.rpm 2.5 MB/s | 830 kB 00:00 2024-02-18T10:01:43.037 INFO:teuthology.orchestra.run.smithi204.stdout:(12/62): libedit-devel-3.1-38.20210216cvs.el9.x 95 kB/s | 39 kB 00:00 2024-02-18T10:01:43.070 INFO:teuthology.orchestra.run.smithi204.stdout:(13/62): libnbd-1.18.1-3.el9.x86_64.rpm 2.8 MB/s | 165 kB 00:00 2024-02-18T10:01:43.112 INFO:teuthology.orchestra.run.smithi204.stdout:(14/62): sqlite-3.34.1-7.el9.x86_64.rpm 7.4 MB/s | 747 kB 00:00 2024-02-18T10:01:43.146 INFO:teuthology.orchestra.run.smithi204.stdout:(15/62): systemd-devel-252-26.el9.x86_64.rpm 4.7 MB/s | 487 kB 00:00 2024-02-18T10:01:43.180 INFO:teuthology.orchestra.run.smithi204.stdout:(16/62): udftools-2.2-5.el9.x86_64.rpm 2.3 MB/s | 144 kB 00:00 2024-02-18T10:01:43.205 INFO:teuthology.orchestra.run.smithi204.stdout:(17/62): rmt-1.6-6.el9.x86_64.rpm 525 kB/s | 45 kB 00:00 2024-02-18T10:01:43.564 INFO:teuthology.orchestra.run.smithi204.stdout:(18/62): libsepol-devel-3.5-1.el9.x86_64.rpm 134 kB/s | 48 kB 00:00 2024-02-18T10:01:43.714 INFO:teuthology.orchestra.run.smithi204.stdout:(19/62): libselinux-devel-3.5-1.el9.x86_64.rpm 283 kB/s | 160 kB 00:00 2024-02-18T10:01:43.839 INFO:teuthology.orchestra.run.smithi204.stdout:(20/62): pcre2-utf16-10.40-2.el9.x86_64.rpm 789 kB/s | 217 kB 00:00 2024-02-18T10:01:43.881 INFO:teuthology.orchestra.run.smithi204.stdout:(21/62): pcre2-devel-10.40-2.el9.x86_64.rpm 763 kB/s | 515 kB 00:00 2024-02-18T10:01:43.907 INFO:teuthology.orchestra.run.smithi204.stdout:(22/62): pcre2-utf32-10.40-2.el9.x86_64.rpm 1.0 MB/s | 206 kB 00:00 2024-02-18T10:01:43.957 INFO:teuthology.orchestra.run.smithi204.stdout:(23/62): device-mapper-devel-1.02.197-2.el9.x86 370 kB/s | 43 kB 00:00 2024-02-18T10:01:44.157 INFO:teuthology.orchestra.run.smithi204.stdout:(24/62): gdbm-devel-1.19-4.el9.x86_64.rpm 235 kB/s | 59 kB 00:00 2024-02-18T10:01:44.182 INFO:teuthology.orchestra.run.smithi204.stdout:(25/62): gdbm-1.19-4.el9.x86_64.rpm 441 kB/s | 132 kB 00:00 2024-02-18T10:01:44.207 INFO:teuthology.orchestra.run.smithi204.stdout:(26/62): inih-devel-49-6.el9.x86_64.rpm 43 kB/s | 11 kB 00:00 2024-02-18T10:01:44.232 INFO:teuthology.orchestra.run.smithi204.stdout:(27/62): userspace-rcu-devel-0.12.1-6.el9.x86_6 1.6 MB/s | 120 kB 00:00 2024-02-18T10:01:44.450 INFO:teuthology.orchestra.run.smithi204.stdout:(28/62): cpp-11.4.1-3.el9.x86_64.rpm 49 MB/s | 11 MB 00:00 2024-02-18T10:01:45.050 INFO:teuthology.orchestra.run.smithi204.stdout:(29/62): gcc-11.4.1-3.el9.x86_64.rpm 66 MB/s | 32 MB 00:00 2024-02-18T10:01:45.317 INFO:teuthology.orchestra.run.smithi204.stdout:(30/62): gcc-c++-11.4.1-3.el9.x86_64.rpm 49 MB/s | 13 MB 00:00 2024-02-18T10:01:45.350 INFO:teuthology.orchestra.run.smithi204.stdout:(31/62): gcc-plugin-annobin-11.4.1-3.el9.x86_64 1.4 MB/s | 46 kB 00:00 2024-02-18T10:01:45.384 INFO:teuthology.orchestra.run.smithi204.stdout:(32/62): git-2.43.0-1.el9.x86_64.rpm 1.5 MB/s | 50 kB 00:00 2024-02-18T10:01:45.526 INFO:teuthology.orchestra.run.smithi204.stdout:(33/62): git-core-2.43.0-1.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-02-18T10:01:45.635 INFO:teuthology.orchestra.run.smithi204.stdout:(34/62): git-core-doc-2.43.0-1.el9.noarch.rpm 25 MB/s | 2.6 MB 00:00 2024-02-18T10:01:45.660 INFO:teuthology.orchestra.run.smithi204.stdout:(35/62): dump-0.4-0.51.b47.el9.x86_64.rpm 61 kB/s | 88 kB 00:01 2024-02-18T10:01:45.735 INFO:teuthology.orchestra.run.smithi204.stdout:(36/62): libstdc++-devel-11.4.1-3.el9.x86_64.rp 22 MB/s | 2.2 MB 00:00 2024-02-18T10:01:45.760 INFO:teuthology.orchestra.run.smithi204.stdout:(37/62): perl-Git-2.43.0-1.el9.noarch.rpm 419 kB/s | 37 kB 00:00 2024-02-18T10:01:45.785 INFO:teuthology.orchestra.run.smithi204.stdout:(38/62): python-unversioned-command-3.9.18-3.el 169 kB/s | 8.3 kB 00:00 2024-02-18T10:01:45.819 INFO:teuthology.orchestra.run.smithi204.stdout:(39/62): python3-devel-3.9.18-3.el9.x86_64.rpm 3.5 MB/s | 204 kB 00:00 2024-02-18T10:01:45.844 INFO:teuthology.orchestra.run.smithi204.stdout:(40/62): device-mapper-1.02.197-2.el9.x86_64.rp 2.4 MB/s | 139 kB 00:00 2024-02-18T10:01:45.863 INFO:teuthology.orchestra.run.smithi204.stdout:(41/62): device-mapper-event-1.02.197-2.el9.x86 831 kB/s | 33 kB 00:00 2024-02-18T10:01:45.878 INFO:teuthology.orchestra.run.smithi204.stdout:(42/62): device-mapper-event-libs-1.02.197-2.el 959 kB/s | 31 kB 00:00 2024-02-18T10:01:45.912 INFO:teuthology.orchestra.run.smithi204.stdout:(43/62): device-mapper-libs-1.02.197-2.el9.x86_ 3.5 MB/s | 178 kB 00:00 2024-02-18T10:01:45.971 INFO:teuthology.orchestra.run.smithi204.stdout:(44/62): e2fsprogs-1.46.5-5.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-02-18T10:01:46.004 INFO:teuthology.orchestra.run.smithi204.stdout:(45/62): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-02-18T10:01:46.021 INFO:teuthology.orchestra.run.smithi204.stdout:(46/62): libcom_err-1.46.5-5.el9.x86_64.rpm 532 kB/s | 25 kB 00:00 2024-02-18T10:01:46.055 INFO:teuthology.orchestra.run.smithi204.stdout:(47/62): libgcc-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 91 kB 00:00 2024-02-18T10:01:46.089 INFO:teuthology.orchestra.run.smithi204.stdout:(48/62): libgomp-11.4.1-3.el9.x86_64.rpm 4.0 MB/s | 267 kB 00:00 2024-02-18T10:01:46.114 INFO:teuthology.orchestra.run.smithi204.stdout:(49/62): indent-2.2.13-5.el9.x86_64.rpm 94 kB/s | 179 kB 00:01 2024-02-18T10:01:46.139 INFO:teuthology.orchestra.run.smithi204.stdout:(50/62): libss-1.46.5-5.el9.x86_64.rpm 381 kB/s | 31 kB 00:00 2024-02-18T10:01:46.181 INFO:teuthology.orchestra.run.smithi204.stdout:(51/62): libstdc++-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 739 kB 00:00 2024-02-18T10:01:46.240 INFO:teuthology.orchestra.run.smithi204.stdout:(52/62): lvm2-libs-2.03.23-2.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-02-18T10:01:46.298 INFO:teuthology.orchestra.run.smithi204.stdout:(53/62): lvm2-2.03.23-2.el9.x86_64.rpm 9.9 MB/s | 1.5 MB 00:00 2024-02-18T10:01:46.340 INFO:teuthology.orchestra.run.smithi204.stdout:(54/62): make-4.3-8.el9.x86_64.rpm 3.3 MB/s | 529 kB 00:00 2024-02-18T10:01:46.365 INFO:teuthology.orchestra.run.smithi204.stdout:(55/62): python3-3.9.18-3.el9.x86_64.rpm 219 kB/s | 25 kB 00:00 2024-02-18T10:01:46.424 INFO:teuthology.orchestra.run.smithi204.stdout:(56/62): sqlite-libs-3.34.1-7.el9.x86_64.rpm 7.4 MB/s | 619 kB 00:00 2024-02-18T10:01:46.583 INFO:teuthology.orchestra.run.smithi204.stdout:(57/62): python3-libs-3.9.18-3.el9.x86_64.rpm 30 MB/s | 7.3 MB 00:00 2024-02-18T10:01:46.691 INFO:teuthology.orchestra.run.smithi204.stdout:(58/62): systemd-252-26.el9.x86_64.rpm 12 MB/s | 4.0 MB 00:00 2024-02-18T10:01:46.725 INFO:teuthology.orchestra.run.smithi204.stdout:(59/62): systemd-libs-252-26.el9.x86_64.rpm 2.2 MB/s | 658 kB 00:00 2024-02-18T10:01:46.750 INFO:teuthology.orchestra.run.smithi204.stdout:(60/62): systemd-pam-252-26.el9.x86_64.rpm 1.7 MB/s | 266 kB 00:00 2024-02-18T10:01:46.809 INFO:teuthology.orchestra.run.smithi204.stdout:(61/62): systemd-rpm-macros-252-26.el9.noarch.r 940 kB/s | 54 kB 00:00 2024-02-18T10:01:46.859 INFO:teuthology.orchestra.run.smithi204.stdout:(62/62): systemd-udev-252-26.el9.x86_64.rpm 17 MB/s | 1.8 MB 00:00 2024-02-18T10:01:46.869 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-02-18T10:01:46.869 INFO:teuthology.orchestra.run.smithi204.stdout:Total 21 MB/s | 118 MB 00:05 2024-02-18T10:01:47.235 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-02-18T10:01:47.752 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-02-18T10:01:47.753 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-02-18T10:01:49.363 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-02-18T10:01:49.364 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-02-18T10:01:52.958 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-02-18T10:01:53.027 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/95 2024-02-18T10:01:53.141 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/95 2024-02-18T10:01:53.203 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : systemd-libs-252-26.el9.x86_64 2/95 2024-02-18T10:01:53.358 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: systemd-libs-252-26.el9.x86_64 2/95 2024-02-18T10:01:53.466 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 3/95 2024-02-18T10:01:53.555 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 4/95 2024-02-18T10:01:53.634 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 5/95 2024-02-18T10:01:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 6/95 2024-02-18T10:01:55.399 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 7/95 2024-02-18T10:01:55.434 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 8/95 2024-02-18T10:01:55.529 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 9/95 2024-02-18T10:01:55.907 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : make-1:4.3-8.el9.x86_64 10/95 2024-02-18T10:01:56.963 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 11/95 2024-02-18T10:01:57.136 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 12/95 2024-02-18T10:01:57.183 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 13/95 2024-02-18T10:01:57.458 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:01:57.461 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:01:57.464 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:01:57.940 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : git-2.43.0-1.el9.x86_64 14/95 2024-02-18T10:01:58.058 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 15/95 2024-02-18T10:01:58.095 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 16/95 2024-02-18T10:01:58.135 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : systemd-rpm-macros-252-26.el9.noarch 17/95 2024-02-18T10:01:58.739 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: systemd-252-26.el9.x86_64 18/95 2024-02-18T10:01:58.834 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : systemd-252-26.el9.x86_64 18/95 2024-02-18T10:01:59.275 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: systemd-252-26.el9.x86_64 18/95 2024-02-18T10:01:59.337 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : systemd-pam-252-26.el9.x86_64 19/95 2024-02-18T10:01:59.421 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 20/95 2024-02-18T10:01:59.476 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 21/95 2024-02-18T10:01:59.529 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 22/95 2024-02-18T10:01:59.570 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 23/95 2024-02-18T10:01:59.929 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 23/95 2024-02-18T10:02:00.433 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 24/95 2024-02-18T10:02:00.764 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : systemd-devel-252-26.el9.x86_64 25/95 2024-02-18T10:02:00.848 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : systemd-udev-252-26.el9.x86_64 26/95 2024-02-18T10:02:01.438 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: systemd-udev-252-26.el9.x86_64 26/95 2024-02-18T10:02:01.764 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 27/95 2024-02-18T10:02:03.084 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 28/95 2024-02-18T10:02:03.304 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 29/95 2024-02-18T10:02:03.391 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 29/95 2024-02-18T10:02:03.429 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 30/95 2024-02-18T10:02:03.467 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-utf32-10.40-2.el9.x86_64 31/95 2024-02-18T10:02:03.665 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-utf16-10.40-2.el9.x86_64 32/95 2024-02-18T10:02:03.728 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-devel-10.40-2.el9.x86_64 33/95 2024-02-18T10:02:03.885 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libsepol-devel-3.5-1.el9.x86_64 34/95 2024-02-18T10:02:03.925 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libselinux-devel-3.5-1.el9.x86_64 35/95 2024-02-18T10:02:03.965 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rmt-2:1.6-6.el9.x86_64 36/95 2024-02-18T10:02:04.029 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 37/95 2024-02-18T10:02:04.058 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 38/95 2024-02-18T10:02:04.093 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 39/95 2024-02-18T10:02:04.127 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 40/95 2024-02-18T10:02:04.161 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 41/95 2024-02-18T10:02:04.195 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 42/95 2024-02-18T10:02:04.453 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 43/95 2024-02-18T10:02:04.494 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fio-3.35-1.el9.x86_64 44/95 2024-02-18T10:02:04.521 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 45/95 2024-02-18T10:02:04.551 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : device-mapper-devel-9:1.02.197-2.el9.x86_64 46/95 2024-02-18T10:02:15.849 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 47/95 2024-02-18T10:02:16.609 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-devel-5.14.0-421.el9.x86_64 48/95 2024-02-18T10:02:27.644 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:02:27.648 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:02:27.651 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:02:57.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:02:57.778 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:02:57.781 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:03:02.305 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-devel-5.14.0-421.el9.x86_64 48/95 2024-02-18T10:03:02.461 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 49/95 2024-02-18T10:03:02.492 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 50/95 2024-02-18T10:03:02.579 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 50/95 2024-02-18T10:03:02.800 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : udftools-2.2-5.el9.x86_64 51/95 2024-02-18T10:03:02.800 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 52/95 2024-02-18T10:03:02.800 INFO:teuthology.orchestra.run.smithi204.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-02-18T10:03:02.800 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T10:03:03.275 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 52/95 2024-02-18T10:03:03.563 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 53/95 2024-02-18T10:03:03.612 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 54/95 2024-02-18T10:03:03.682 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 55/95 2024-02-18T10:03:03.822 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : indent-2.2.13-5.el9.x86_64 56/95 2024-02-18T10:03:03.855 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : userspace-rcu-devel-0.12.1-6.el9.x86_64 57/95 2024-02-18T10:03:04.153 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : inih-devel-49-6.el9.x86_64 58/95 2024-02-18T10:03:04.211 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libicu-devel-67.1-9.el9.x86_64 59/95 2024-02-18T10:03:04.264 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libedit-devel-3.1-38.20210216cvs.el9.x86_64 60/95 2024-02-18T10:03:04.296 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 61/95 2024-02-18T10:03:04.328 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libblkid-devel-2.37.4-18.el9.x86_64 62/95 2024-02-18T10:03:04.354 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : git-2.39.3-1.el9.x86_64 63/95 2024-02-18T10:03:04.391 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 64/95 2024-02-18T10:03:04.391 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 64/95 2024-02-18T10:03:04.477 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 64/95 2024-02-18T10:03:04.514 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 65/95 2024-02-18T10:03:04.541 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 66/95 2024-02-18T10:03:04.584 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 66/95 2024-02-18T10:03:04.639 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: systemd-udev-252-18.el9.x86_64 67/95 2024-02-18T10:03:04.639 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : systemd-udev-252-18.el9.x86_64 67/95 2024-02-18T10:03:04.762 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: systemd-udev-252-18.el9.x86_64 67/95 2024-02-18T10:03:04.805 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 68/95 2024-02-18T10:03:04.861 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 69/95 2024-02-18T10:03:04.902 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 70/95 2024-02-18T10:03:04.934 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 71/95 2024-02-18T10:03:04.960 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 72/95 2024-02-18T10:03:04.994 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 73/95 2024-02-18T10:03:05.029 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 74/95 2024-02-18T10:03:05.121 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 75/95 2024-02-18T10:03:05.122 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : systemd-252-18.el9.x86_64 76/95 2024-02-18T10:03:05.345 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: systemd-252-18.el9.x86_64 76/95 2024-02-18T10:03:05.382 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : systemd-libs-252-18.el9.x86_64 77/95 2024-02-18T10:03:05.416 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : systemd-pam-252-18.el9.x86_64 78/95 2024-02-18T10:03:05.417 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 79/95 2024-02-18T10:03:05.527 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 79/95 2024-02-18T10:03:05.599 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 80/95 2024-02-18T10:03:05.649 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 81/95 2024-02-18T10:03:05.674 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : systemd-rpm-macros-252-18.el9.noarch 82/95 2024-02-18T10:03:05.731 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 83/95 2024-02-18T10:03:05.786 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 84/95 2024-02-18T10:03:05.819 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 85/95 2024-02-18T10:03:05.852 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 86/95 2024-02-18T10:03:05.981 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 87/95 2024-02-18T10:03:06.047 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 88/95 2024-02-18T10:03:06.079 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 89/95 2024-02-18T10:03:06.105 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 90/95 2024-02-18T10:03:06.106 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 91/95 2024-02-18T10:03:06.237 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 91/95 2024-02-18T10:03:06.275 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 92/95 2024-02-18T10:03:06.310 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 93/95 2024-02-18T10:03:06.363 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : make-1:4.3-7.el9.x86_64 94/95 2024-02-18T10:03:06.497 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 95/95 2024-02-18T10:03:07.574 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: git-core-2.39.3-1.el9.x86_64 95/95 2024-02-18T10:03:07.574 INFO:teuthology.orchestra.run.smithi204.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-18T10:03:07.575 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T10:03:09.650 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fio-3.35-1.el9.x86_64 1/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-devel-5.14.0-421.el9.x86_64 8/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-devel-2.37.4-18.el9.x86_64 9/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libedit-devel-3.1-38.20210216cvs.el9.x86_64 11/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libicu-devel-67.1-9.el9.x86_64 12/95 2024-02-18T10:03:09.651 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 14/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-devel-252-26.el9.x86_64 15/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : udftools-2.2-5.el9.x86_64 16/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 17/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libselinux-devel-3.5-1.el9.x86_64 18/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsepol-devel-3.5-1.el9.x86_64 19/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-devel-10.40-2.el9.x86_64 20/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-utf16-10.40-2.el9.x86_64 21/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-utf32-10.40-2.el9.x86_64 22/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-devel-9:1.02.197-2.el9.x86_64 23/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 24/95 2024-02-18T10:03:09.652 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 25/95 2024-02-18T10:03:09.653 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : inih-devel-49-6.el9.x86_64 26/95 2024-02-18T10:03:09.653 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : userspace-rcu-devel-0.12.1-6.el9.x86_64 27/95 2024-02-18T10:03:09.653 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 28/95 2024-02-18T10:03:09.653 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : indent-2.2.13-5.el9.x86_64 29/95 2024-02-18T10:03:09.660 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 30/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 31/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 32/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 33/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 34/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 35/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 36/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 37/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : git-2.43.0-1.el9.x86_64 38/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : git-2.39.3-1.el9.x86_64 39/95 2024-02-18T10:03:09.661 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 40/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 41/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 42/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 43/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 44/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 45/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 46/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 47/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 48/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 49/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 50/95 2024-02-18T10:03:09.662 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 51/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 52/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 53/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 54/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 55/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 56/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 57/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 58/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 59/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 60/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 61/95 2024-02-18T10:03:09.663 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 62/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 63/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 64/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 65/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 66/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 67/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 68/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 69/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libss-1.46.5-5.el9.x86_64 70/95 2024-02-18T10:03:09.664 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libss-1.46.5-3.el9.x86_64 71/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 72/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 73/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 74/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 75/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 76/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 77/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : make-1:4.3-8.el9.x86_64 78/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : make-1:4.3-7.el9.x86_64 79/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-3.9.18-3.el9.x86_64 80/95 2024-02-18T10:03:09.665 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-3.9.17-2.el9.x86_64 81/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 82/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 83/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 84/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 85/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-252-26.el9.x86_64 86/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-252-18.el9.x86_64 87/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-libs-252-26.el9.x86_64 88/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-libs-252-18.el9.x86_64 89/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-pam-252-26.el9.x86_64 90/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-pam-252-18.el9.x86_64 91/95 2024-02-18T10:03:09.666 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-rpm-macros-252-26.el9.noarch 92/95 2024-02-18T10:03:09.667 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-rpm-macros-252-18.el9.noarch 93/95 2024-02-18T10:03:09.667 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-udev-252-26.el9.x86_64 94/95 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : systemd-udev-252-18.el9.x86_64 95/95 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: cpp-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-02-18T10:03:10.846 INFO:teuthology.orchestra.run.smithi204.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: gcc-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: git-2.43.0-1.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: git-core-2.43.0-1.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: libgcc-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: libgomp-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: libss-1.46.5-5.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-02-18T10:03:10.847 INFO:teuthology.orchestra.run.smithi204.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: make-1:4.3-8.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: perl-Git-2.43.0-1.el9.noarch 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: python3-3.9.18-3.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-252-26.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-libs-252-26.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-pam-252-26.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-rpm-macros-252-26.el9.noarch 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-udev-252-26.el9.x86_64 2024-02-18T10:03:10.848 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: device-mapper-devel-9:1.02.197-2.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: dump-1:0.4-0.51.b47.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: fio-3.35-1.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-http-3.35-1.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-libaio-3.35-1.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-nbd-3.35-1.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-rados-3.35-1.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-rbd-3.35-1.el9.x86_64 2024-02-18T10:03:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: gdbm-1:1.19-4.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: gdbm-devel-1:1.19-4.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: indent-2.2.13-5.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: inih-devel-49-6.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-devel-5.14.0-421.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid-devel-2.37.4-18.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: libcap-devel-2.48-9.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: libedit-devel-3.1-38.20210216cvs.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: libicu-devel-67.1-9.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: libnbd-1.18.1-3.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: libselinux-devel-3.5-1.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: libsepol-devel-3.5-1.el9.x86_64 2024-02-18T10:03:10.850 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-devel-10.40-2.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf16-10.40-2.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf32-10.40-2.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: rmt-2:1.6-6.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: sqlite-3.34.1-7.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: systemd-devel-252-26.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: udftools-2.2-5.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: userspace-rcu-devel-0.12.1-6.el9.x86_64 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T10:03:10.851 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-02-18T10:03:11.550 DEBUG:teuthology.orchestra.run.smithi204:> sudo useradd -m fsgqa 2024-02-18T10:03:11.617 INFO:teuthology.orchestra.run.smithi204.stderr:useradd: user 'fsgqa' already exists 2024-02-18T10:03:11.620 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-18T10:03:11.621 DEBUG:teuthology.orchestra.run.smithi204:> sudo groupadd fsgqa 2024-02-18T10:03:11.686 INFO:teuthology.orchestra.run.smithi204.stderr:groupadd: group 'fsgqa' already exists 2024-02-18T10:03:11.689 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-02-18T10:03:11.689 DEBUG:teuthology.orchestra.run.smithi204:> sudo useradd fsgqa2 2024-02-18T10:03:12.317 DEBUG:teuthology.orchestra.run.smithi204:> sudo useradd 123456-fsgqa 2024-02-18T10:03:13.053 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-02-18T10:03:13.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.162+0000 7f6e0c702640 1 Processor -- start 2024-02-18T10:03:13.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.162+0000 7f6e0c702640 1 -- start start 2024-02-18T10:03:13.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.162+0000 7f6e0c702640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e040b9cf0 0x7f6e040bd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.162+0000 7f6e0c702640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e04073210 con 0x7f6e04072dc0 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.162+0000 7f6e0c702640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e041463f0 con 0x7f6e0414fe70 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.162+0000 7f6e0c702640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e040bd730 con 0x7f6e040b9cf0 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.163+0000 7f6e0a49e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e040b9cf0 0x7f6e040bd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.163+0000 7f6e0ac9f640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6e04072dc0 0x7f6e040bb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:46020/0 (socket says 172.21.15.118:46020) 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.163+0000 7f6e0a49e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6e040b9cf0 0x7f6e040bd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37084/0 (socket says 172.21.15.118:37084) 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.163+0000 7f6e0a49e640 1 -- 172.21.15.118:0/2838544579 learned_addr learned my addr 172.21.15.118:0/2838544579 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.163+0000 7f6e0a49e640 1 -- 172.21.15.118:0/2838544579 >> v1:172.21.15.164:6789/0 conn(0x7f6e0414fe70 legacy=0x7f6e04145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.163+0000 7f6e0a49e640 1 -- 172.21.15.118:0/2838544579 >> v1:172.21.15.118:6789/0 conn(0x7f6e04072dc0 legacy=0x7f6e040bb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.163+0000 7f6e0a49e640 1 -- 172.21.15.118:0/2838544579 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0414f390 con 0x7f6e040b9cf0 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0a49e640 1 --2- 172.21.15.118:0/2838544579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e040bd060 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009870 tx=0x7f6df802bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876a6552969dde7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0949c640 1 -- 172.21.15.118:0/2838544579 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df802d870 con 0x7f6e040b9cf0 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0949c640 1 -- 172.21.15.118:0/2838544579 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df802d9d0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0949c640 1 -- 172.21.15.118:0/2838544579 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df802dd60 con 0x7f6e040b9cf0 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0c702640 1 -- 172.21.15.118:0/2838544579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 msgr2=0x7f6e040bd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0c702640 1 --2- 172.21.15.118:0/2838544579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e040bd060 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009870 tx=0x7f6df802bab0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0c702640 1 -- 172.21.15.118:0/2838544579 shutdown_connections 2024-02-18T10:03:13.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0c702640 1 --2- 172.21.15.118:0/2838544579 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e040bd060 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0c702640 1 -- 172.21.15.118:0/2838544579 >> 172.21.15.118:0/2838544579 conn(0x7f6e040ba3c0 msgr2=0x7f6e040ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:03:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0c702640 1 -- 172.21.15.118:0/2838544579 shutdown_connections 2024-02-18T10:03:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.164+0000 7f6e0c702640 1 -- 172.21.15.118:0/2838544579 wait complete. 2024-02-18T10:03:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.165+0000 7f6e0c702640 1 Processor -- start 2024-02-18T10:03:13.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.165+0000 7f6e0c702640 1 -- start start 2024-02-18T10:03:13.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0c702640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e04072dc0 0x7f6e0409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0c702640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e041e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0c702640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e0414fe70 0x7f6e040a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0c702640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0409b020 con 0x7f6e040b9cf0 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0c702640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0414d5c0 con 0x7f6e04072dc0 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0c702640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04099ca0 con 0x7f6e0414fe70 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e041e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e041e1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37086/0 (socket says 172.21.15.118:37086) 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 -- 172.21.15.118:0/3789619982 learned_addr learned my addr 172.21.15.118:0/3789619982 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0a49e640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e04072dc0 0x7f6e0409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 -- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e0414fe70 msgr2=0x7f6e040a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e0414fe70 0x7f6e040a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 -- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e04072dc0 msgr2=0x7f6e0409aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e04072dc0 0x7f6e0409aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e09c9d640 1 -- 172.21.15.118:0/3789619982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80094d0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.166+0000 7f6e0a49e640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e04072dc0 0x7f6e0409aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.167+0000 7f6e09c9d640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e041e1f00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000c3c0 tx=0x7f6e0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.167+0000 7f6df6ffd640 1 -- 172.21.15.118:0/3789619982 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000052d0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.167+0000 7f6df6ffd640 1 -- 172.21.15.118:0/3789619982 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00005450 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.167+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0409c3e0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.167+0000 7f6df6ffd640 1 -- 172.21.15.118:0/3789619982 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00007260 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.167+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e041e19e0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.168+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e040bbd50 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.168+0000 7f6df6ffd640 1 -- 172.21.15.118:0/3789619982 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f6e000073c0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.168+0000 7f6df6ffd640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6de806bc70 0x7f6de806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.169+0000 7f6df6ffd640 1 -- 172.21.15.118:0/3789619982 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e00089a80 con 0x7f6e040b9cf0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.169+0000 7f6e0a49e640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6de806bc70 0x7f6de806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.169+0000 7f6e0a49e640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6de806bc70 0x7f6de806e130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6df8036000 tx=0x7f6df8039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:03:13.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.174+0000 7f6df6ffd640 1 -- 172.21.15.118:0/3789619982 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e000542f0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.410+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6e04074af0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.410+0000 7f6df6ffd640 1 -- 172.21.15.118:0/3789619982 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1289 (secure 0 0 0) 0x7f6e000579b0 con 0x7f6e040b9cf0 2024-02-18T10:03:13.413 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:03:13.413 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":1,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","modified":"2024-02-18T09:59:58.838685Z","created":"2024-02-18T09:59:58.838685Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3301","nonce":0},{"type":"v1","addr":"172.21.15.164:6790","nonce":0}]},"addr":"172.21.15.164:6790/0","public_addr":"172.21.15.164:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-18T10:03:13.414 INFO:teuthology.orchestra.run.smithi118.stderr:dumped monmap epoch 1 2024-02-18T10:03:13.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6de806bc70 msgr2=0x7f6de806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6de806bc70 0x7f6de806e130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6df8036000 tx=0x7f6df8039040 comp rx=0 tx=0).stop 2024-02-18T10:03:13.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 msgr2=0x7f6e041e1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e041e1f00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000c3c0 tx=0x7f6e0000c880 comp rx=0 tx=0).stop 2024-02-18T10:03:13.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 shutdown_connections 2024-02-18T10:03:13.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6de806bc70 0x7f6de806e130 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6e0414fe70 0x7f6e040a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e040b9cf0 0x7f6e041e1f00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 --2- 172.21.15.118:0/3789619982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e04072dc0 0x7f6e0409aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 >> 172.21.15.118:0/3789619982 conn(0x7f6e040ba3c0 msgr2=0x7f6e0406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:03:13.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 shutdown_connections 2024-02-18T10:03:13.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.412+0000 7f6e0c702640 1 -- 172.21.15.118:0/3789619982 wait complete. 2024-02-18T10:03:13.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-02-18T10:03:13.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.524+0000 7f2d1f0c0640 1 Processor -- start 2024-02-18T10:03:13.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.524+0000 7f2d1f0c0640 1 -- start start 2024-02-18T10:03:13.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1f0c0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d180b51d0 0x7f2d180b9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1f0c0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2d180ba800 0x7f2d180b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1f0c0640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d18146330 con 0x7f2d18145f50 2024-02-18T10:03:13.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1f0c0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180721a0 con 0x7f2d180ba800 2024-02-18T10:03:13.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1f0c0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180ba090 con 0x7f2d180b51d0 2024-02-18T10:03:13.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d180b51d0 0x7f2d180b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1d65d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2d180ba800 0x7f2d180b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1d65d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2d180ba800 0x7f2d180b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.118:54040/0 (socket says 172.21.15.118:54040) 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d180b51d0 0x7f2d180b9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.118:45298/0 (socket says 172.21.15.118:45298) 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1d65d640 1 -- 172.21.15.118:0/1662388727 learned_addr learned my addr 172.21.15.118:0/1662388727 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.525+0000 7f2d1ce5c640 1 --1- 172.21.15.118:0/1662388727 >> v1:172.21.15.164:6789/0 conn(0x7f2d18145f50 0x7f2d1806abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:48654/0 (socket says 172.21.15.118:48654) 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.526+0000 7f2d1d65d640 1 -- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d180b51d0 msgr2=0x7f2d180b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.526+0000 7f2d1d65d640 1 --2- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d180b51d0 0x7f2d180b9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.526+0000 7f2d1d65d640 1 -- 172.21.15.118:0/1662388727 >> v1:172.21.15.164:6789/0 conn(0x7f2d18145f50 legacy=0x7f2d1806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.526+0000 7f2d1d65d640 1 -- 172.21.15.118:0/1662388727 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1806b2f0 con 0x7f2d180ba800 2024-02-18T10:03:13.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.526+0000 7f2d17fff640 1 --2- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d180b51d0 0x7f2d180b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.526+0000 7f2d1d65d640 1 --2- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180ba800 0x7f2d180b9b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009e50 tx=0x7f2d1002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=add4f151b70d358e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d177fe640 1 -- 172.21.15.118:0/1662388727 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1002cb00 con 0x7f2d180ba800 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d177fe640 1 -- 172.21.15.118:0/1662388727 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1002cc60 con 0x7f2d180ba800 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d177fe640 1 -- 172.21.15.118:0/1662388727 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100343f0 con 0x7f2d180ba800 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180ba800 msgr2=0x7f2d180b9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180ba800 0x7f2d180b9b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009e50 tx=0x7f2d1002bf60 comp rx=0 tx=0).stop 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1662388727 shutdown_connections 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180ba800 0x7f2d180b9b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1662388727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d180b51d0 0x7f2d180b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1662388727 >> 172.21.15.118:0/1662388727 conn(0x7f2d180be630 msgr2=0x7f2d180bea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:03:13.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1662388727 shutdown_connections 2024-02-18T10:03:13.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.527+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1662388727 wait complete. 2024-02-18T10:03:13.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.528+0000 7f2d1f0c0640 1 Processor -- start 2024-02-18T10:03:13.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.528+0000 7f2d1f0c0640 1 -- start start 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1f0c0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180b51d0 0x7f2d1809e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1f0c0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d180ba800 0x7f2d181e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1f0c0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d18145f50 0x7f2d1809efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1f0c0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180b7f20 con 0x7f2d180ba800 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1f0c0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1809e8c0 con 0x7f2d180b51d0 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1f0c0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d181e4f30 con 0x7f2d18145f50 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d180ba800 0x7f2d181e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d180ba800 0x7f2d181e46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37090/0 (socket says 172.21.15.118:37090) 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d17fff640 1 -- 172.21.15.118:0/1564405661 learned_addr learned my addr 172.21.15.118:0/1564405661 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1d65d640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d18145f50 0x7f2d1809efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.529+0000 7f2d1ce5c640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180b51d0 0x7f2d1809e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d17fff640 1 -- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d18145f50 msgr2=0x7f2d1809efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d17fff640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d18145f50 0x7f2d1809efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d17fff640 1 -- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180b51d0 msgr2=0x7f2d1809e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d17fff640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180b51d0 0x7f2d1809e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d17fff640 1 -- 172.21.15.118:0/1564405661 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c009400 con 0x7f2d180ba800 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d1ce5c640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180b51d0 0x7f2d1809e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d1d65d640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d18145f50 0x7f2d1809efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d17fff640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d180ba800 0x7f2d181e46a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00e900 tx=0x7f2d0c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d157fa640 1 -- 172.21.15.118:0/1564405661 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c009660 con 0x7f2d180ba800 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d157fa640 1 -- 172.21.15.118:0/1564405661 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c00ca00 con 0x7f2d180ba800 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d10009b30 con 0x7f2d180ba800 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d157fa640 1 -- 172.21.15.118:0/1564405661 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00cdb0 con 0x7f2d180ba800 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.530+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1809eb90 con 0x7f2d180ba800 2024-02-18T10:03:13.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.531+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d18074af0 con 0x7f2d180ba800 2024-02-18T10:03:13.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.531+0000 7f2d157fa640 1 -- 172.21.15.118:0/1564405661 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f2d0c013470 con 0x7f2d180ba800 2024-02-18T10:03:13.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.532+0000 7f2d157fa640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d0406bc70 0x7f2d0406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:03:13.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.532+0000 7f2d1ce5c640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d0406bc70 0x7f2d0406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:03:13.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.532+0000 7f2d157fa640 1 -- 172.21.15.118:0/1564405661 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d0c08a690 con 0x7f2d180ba800 2024-02-18T10:03:13.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.532+0000 7f2d1ce5c640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d0406bc70 0x7f2d0406e130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d08000f60 tx=0x7f2d08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:03:13.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.536+0000 7f2d157fa640 1 -- 172.21.15.118:0/1564405661 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d0c054e80 con 0x7f2d180ba800 2024-02-18T10:03:13.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.770+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f2d181e4c40 con 0x7f2d180ba800 2024-02-18T10:03:13.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.770+0000 7f2d157fa640 1 -- 172.21.15.118:0/1564405661 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f2d0c058540 con 0x7f2d180ba800 2024-02-18T10:03:13.772 INFO:teuthology.orchestra.run.smithi118.stdout:[client.admin] 2024-02-18T10:03:13.772 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAf1dFlF/iuDBAAjtOPYBhtZeQTg1evA2AL/Q== 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d0406bc70 msgr2=0x7f2d0406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d0406bc70 0x7f2d0406e130 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d08000f60 tx=0x7f2d08009040 comp rx=0 tx=0).stop 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d180ba800 msgr2=0x7f2d181e46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d180ba800 0x7f2d181e46a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00e900 tx=0x7f2d0c00edc0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 shutdown_connections 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2d0406bc70 0x7f2d0406e130 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2d18145f50 0x7f2d1809efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2d180ba800 0x7f2d181e46a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 --2- 172.21.15.118:0/1564405661 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d180b51d0 0x7f2d1809e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:03:13.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 >> 172.21.15.118:0/1564405661 conn(0x7f2d180be630 msgr2=0x7f2d1806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:03:13.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 shutdown_connections 2024-02-18T10:03:13.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:03:13.772+0000 7f2d1f0c0640 1 -- 172.21.15.118:0/1564405661 wait complete. 2024-02-18T10:03:13.785 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:03:13.785 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/tmp/tmp.pjmFjSgc0uxfstests-dev/local.config 2024-02-18T10:03:13.859 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.118:6789:/test export TEST_DIR=/tmp/tmp.QUduP9NKsItest export SCRATCH_DEV=172.21.15.118:6789:/scratch export SCRATCH_MNT=/tmp/tmp.w8GvOpYWfNscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAf1dFlF/iuDBAAjtOPYBhtZeQTg1evA2AL/Q==" 2024-02-18T10:03:13.859 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:03:13.859 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/tmp/tmp.pjmFjSgc0uxfstests-dev/ceph.exclude 2024-02-18T10:03:13.967 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.pjmFjSgc0uxfstests-dev && exec sudo make) 2024-02-18T10:03:14.083 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize -cfi 2024-02-18T10:03:14.699 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting auxiliary files in '.'. 2024-02-18T10:03:14.699 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.guess' 2024-02-18T10:03:14.708 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.sub' 2024-02-18T10:03:14.718 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './install-sh' 2024-02-18T10:03:14.728 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './ltmain.sh' 2024-02-18T10:03:14.790 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-02-18T10:03:14.791 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-02-18T10:03:14.804 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-02-18T10:03:14.816 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-02-18T10:03:14.830 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-02-18T10:03:14.842 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-02-18T10:03:14.860 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-02-18T10:03:14.863 INFO:teuthology.orchestra.run.smithi204.stdout:cp include/install-sh . 2024-02-18T10:03:14.866 INFO:teuthology.orchestra.run.smithi204.stdout:aclocal -I m4 2024-02-18T10:03:16.126 INFO:teuthology.orchestra.run.smithi204.stdout:autoheader 2024-02-18T10:03:16.499 INFO:teuthology.orchestra.run.smithi204.stdout:autoconf 2024-02-18T10:03:16.760 INFO:teuthology.orchestra.run.smithi204.stdout:./configure \ 2024-02-18T10:03:16.761 INFO:teuthology.orchestra.run.smithi204.stdout: --libexecdir=/usr/lib \ 2024-02-18T10:03:16.761 INFO:teuthology.orchestra.run.smithi204.stdout: --exec_prefix=/var/lib 2024-02-18T10:03:17.090 INFO:teuthology.orchestra.run.smithi204.stdout:checking build system type... x86_64-pc-linux-gnu 2024-02-18T10:03:17.090 INFO:teuthology.orchestra.run.smithi204.stdout:checking host system type... x86_64-pc-linux-gnu 2024-02-18T10:03:17.093 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to print strings... printf 2024-02-18T10:03:17.093 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... gcc 2024-02-18T10:03:17.244 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the C compiler works... yes 2024-02-18T10:03:17.245 INFO:teuthology.orchestra.run.smithi204.stdout:checking for C compiler default output file name... a.out 2024-02-18T10:03:17.311 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of executables... 2024-02-18T10:03:17.404 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are cross compiling... no 2024-02-18T10:03:17.443 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of object files... o 2024-02-18T10:03:17.481 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are using the GNU C compiler... yes 2024-02-18T10:03:17.520 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... yes 2024-02-18T10:03:17.571 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to accept ISO C89... none needed 2024-02-18T10:03:17.578 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a sed that does not truncate output... /bin/sed 2024-02-18T10:03:17.583 INFO:teuthology.orchestra.run.smithi204.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-02-18T10:03:17.586 INFO:teuthology.orchestra.run.smithi204.stdout:checking for egrep... /bin/grep -E 2024-02-18T10:03:17.589 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fgrep... /bin/grep -F 2024-02-18T10:03:17.598 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ld used by gcc... /bin/ld 2024-02-18T10:03:17.602 INFO:teuthology.orchestra.run.smithi204.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-02-18T10:03:17.607 INFO:teuthology.orchestra.run.smithi204.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-02-18T10:03:18.728 INFO:teuthology.orchestra.run.smithi204.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-02-18T10:03:18.728 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2024-02-18T10:03:18.751 INFO:teuthology.orchestra.run.smithi204.stdout:checking the maximum length of command line arguments... 1572864 2024-02-18T10:03:18.758 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-02-18T10:03:18.758 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-02-18T10:03:18.758 INFO:teuthology.orchestra.run.smithi204.stdout:checking for /bin/ld option to reload object files... -r 2024-02-18T10:03:18.758 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdump... objdump 2024-02-18T10:03:18.759 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to recognize dependent libraries... pass_all 2024-02-18T10:03:18.759 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlltool... no 2024-02-18T10:03:18.759 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-02-18T10:03:18.759 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ar... ar 2024-02-18T10:03:18.849 INFO:teuthology.orchestra.run.smithi204.stdout:checking for archiver @FILE support... @ 2024-02-18T10:03:18.849 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strip... strip 2024-02-18T10:03:18.849 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ranlib... ranlib 2024-02-18T10:03:18.849 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gawk... gawk 2024-02-18T10:03:18.990 INFO:teuthology.orchestra.run.smithi204.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-02-18T10:03:18.993 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sysroot... no 2024-02-18T10:03:19.001 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a working dd... /bin/dd 2024-02-18T10:03:19.008 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-02-18T10:03:19.039 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mt... no 2024-02-18T10:03:19.045 INFO:teuthology.orchestra.run.smithi204.stdout:checking if : is a manifest tool... no 2024-02-18T10:03:19.125 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to run the C preprocessor... gcc -E 2024-02-18T10:03:19.648 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ANSI C header files... yes 2024-02-18T10:03:19.707 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/types.h... yes 2024-02-18T10:03:19.793 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/stat.h... yes 2024-02-18T10:03:19.855 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdlib.h... yes 2024-02-18T10:03:19.924 INFO:teuthology.orchestra.run.smithi204.stdout:checking for string.h... yes 2024-02-18T10:03:20.014 INFO:teuthology.orchestra.run.smithi204.stdout:checking for memory.h... yes 2024-02-18T10:03:20.085 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strings.h... yes 2024-02-18T10:03:20.199 INFO:teuthology.orchestra.run.smithi204.stdout:checking for inttypes.h... yes 2024-02-18T10:03:20.271 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdint.h... yes 2024-02-18T10:03:20.391 INFO:teuthology.orchestra.run.smithi204.stdout:checking for unistd.h... yes 2024-02-18T10:03:20.470 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlfcn.h... yes 2024-02-18T10:03:20.481 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdir... .libs 2024-02-18T10:03:20.651 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-02-18T10:03:20.651 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-02-18T10:03:20.705 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-02-18T10:03:20.756 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc static flag -static works... no 2024-02-18T10:03:20.829 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... yes 2024-02-18T10:03:20.829 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-02-18T10:03:20.850 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-02-18T10:03:20.915 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether -lc should be explicitly linked in... no 2024-02-18T10:03:21.057 INFO:teuthology.orchestra.run.smithi204.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-02-18T10:03:21.057 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to hardcode library paths into programs... immediate 2024-02-18T10:03:21.062 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether stripping libraries is possible... yes 2024-02-18T10:03:21.062 INFO:teuthology.orchestra.run.smithi204.stdout:checking if libtool supports shared libraries... yes 2024-02-18T10:03:21.062 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build shared libraries... yes 2024-02-18T10:03:21.062 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build static libraries... yes 2024-02-18T10:03:21.079 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2024-02-18T10:03:21.127 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-02-18T10:03:21.127 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-18T10:03:21.128 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-02-18T10:03:21.128 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gmake... /usr/bin/gmake 2024-02-18T10:03:21.128 INFO:teuthology.orchestra.run.smithi204.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2024-02-18T10:03:21.129 INFO:teuthology.orchestra.run.smithi204.stdout:checking for tar... /bin/tar 2024-02-18T10:03:21.129 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gzip... /bin/gzip 2024-02-18T10:03:21.153 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc -MM is supported... yes 2024-02-18T10:03:21.153 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sort... /bin/sort 2024-02-18T10:03:21.153 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2024-02-18T10:03:21.154 INFO:teuthology.orchestra.run.smithi204.stdout:checking for rpm... /bin/rpm 2024-02-18T10:03:21.163 INFO:teuthology.orchestra.run.smithi204.stdout:checking for rpmbuild... no 2024-02-18T10:03:21.220 INFO:teuthology.orchestra.run.smithi204.stdout:checking assert.h usability... yes 2024-02-18T10:03:21.246 INFO:teuthology.orchestra.run.smithi204.stdout:checking assert.h presence... yes 2024-02-18T10:03:21.246 INFO:teuthology.orchestra.run.smithi204.stdout:checking for assert.h... yes 2024-02-18T10:03:21.342 INFO:teuthology.orchestra.run.smithi204.stdout:checking bstring.h usability... no 2024-02-18T10:03:21.384 INFO:teuthology.orchestra.run.smithi204.stdout:checking bstring.h presence... no 2024-02-18T10:03:21.384 INFO:teuthology.orchestra.run.smithi204.stdout:checking for bstring.h... no 2024-02-18T10:03:21.453 INFO:teuthology.orchestra.run.smithi204.stdout:checking libgen.h usability... yes 2024-02-18T10:03:21.480 INFO:teuthology.orchestra.run.smithi204.stdout:checking libgen.h presence... yes 2024-02-18T10:03:21.481 INFO:teuthology.orchestra.run.smithi204.stdout:checking for libgen.h... yes 2024-02-18T10:03:21.571 INFO:teuthology.orchestra.run.smithi204.stdout:checking dirent.h usability... yes 2024-02-18T10:03:21.598 INFO:teuthology.orchestra.run.smithi204.stdout:checking dirent.h presence... yes 2024-02-18T10:03:21.598 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dirent.h... yes 2024-02-18T10:03:21.699 INFO:teuthology.orchestra.run.smithi204.stdout:checking errno.h usability... yes 2024-02-18T10:03:21.728 INFO:teuthology.orchestra.run.smithi204.stdout:checking errno.h presence... yes 2024-02-18T10:03:21.728 INFO:teuthology.orchestra.run.smithi204.stdout:checking for errno.h... yes 2024-02-18T10:03:21.816 INFO:teuthology.orchestra.run.smithi204.stdout:checking malloc.h usability... yes 2024-02-18T10:03:21.847 INFO:teuthology.orchestra.run.smithi204.stdout:checking malloc.h presence... yes 2024-02-18T10:03:21.847 INFO:teuthology.orchestra.run.smithi204.stdout:checking for malloc.h... yes 2024-02-18T10:03:21.925 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid.h usability... no 2024-02-18T10:03:21.961 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid.h presence... no 2024-02-18T10:03:21.961 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid.h... no 2024-02-18T10:03:22.043 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid/uuid.h usability... yes 2024-02-18T10:03:22.074 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid/uuid.h presence... yes 2024-02-18T10:03:22.074 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid/uuid.h... yes 2024-02-18T10:03:22.149 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/uuid.h usability... no 2024-02-18T10:03:22.183 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/uuid.h presence... no 2024-02-18T10:03:22.183 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/uuid.h... no 2024-02-18T10:03:22.251 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/file.h usability... yes 2024-02-18T10:03:22.279 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/file.h presence... yes 2024-02-18T10:03:22.280 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/file.h... yes 2024-02-18T10:03:22.364 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/fcntl.h usability... yes 2024-02-18T10:03:22.392 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/fcntl.h presence... yes 2024-02-18T10:03:22.392 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/fcntl.h... yes 2024-02-18T10:03:22.469 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/syssgi.h usability... no 2024-02-18T10:03:22.511 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/syssgi.h presence... no 2024-02-18T10:03:22.511 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/syssgi.h... no 2024-02-18T10:03:22.602 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/param.h usability... yes 2024-02-18T10:03:22.637 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/param.h presence... yes 2024-02-18T10:03:22.637 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/param.h... yes 2024-02-18T10:03:22.659 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/stat.h... (cached) yes 2024-02-18T10:03:22.742 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/statvfs.h usability... yes 2024-02-18T10:03:22.769 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/statvfs.h presence... yes 2024-02-18T10:03:22.770 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/statvfs.h... yes 2024-02-18T10:03:22.847 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/time.h usability... yes 2024-02-18T10:03:22.874 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/time.h presence... yes 2024-02-18T10:03:22.874 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/time.h... yes 2024-02-18T10:03:22.966 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/ioctl.h usability... yes 2024-02-18T10:03:22.995 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/ioctl.h presence... yes 2024-02-18T10:03:22.995 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/ioctl.h... yes 2024-02-18T10:03:23.076 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/wait.h usability... yes 2024-02-18T10:03:23.103 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/wait.h presence... yes 2024-02-18T10:03:23.103 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/wait.h... yes 2024-02-18T10:03:23.120 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/types.h... (cached) yes 2024-02-18T10:03:23.135 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strings.h... (cached) yes 2024-02-18T10:03:23.209 INFO:teuthology.orchestra.run.smithi204.stdout:checking err.h usability... yes 2024-02-18T10:03:23.236 INFO:teuthology.orchestra.run.smithi204.stdout:checking err.h presence... yes 2024-02-18T10:03:23.236 INFO:teuthology.orchestra.run.smithi204.stdout:checking for err.h... yes 2024-02-18T10:03:23.320 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/falloc.h usability... yes 2024-02-18T10:03:23.344 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/falloc.h presence... yes 2024-02-18T10:03:23.345 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/falloc.h... yes 2024-02-18T10:03:23.422 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-02-18T10:03:23.464 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-02-18T10:03:23.464 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/fs/xfs_fsops.h... no 2024-02-18T10:03:23.536 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/fs/xfs_itable.h usability... no 2024-02-18T10:03:23.577 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/fs/xfs_itable.h presence... no 2024-02-18T10:03:23.577 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/fs/xfs_itable.h... no 2024-02-18T10:03:23.640 INFO:teuthology.orchestra.run.smithi204.stdout:checking xfs/platform_defs.h usability... no 2024-02-18T10:03:23.678 INFO:teuthology.orchestra.run.smithi204.stdout:checking xfs/platform_defs.h presence... no 2024-02-18T10:03:23.678 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/platform_defs.h... no 2024-02-18T10:03:23.743 INFO:teuthology.orchestra.run.smithi204.stdout:checking btrfs/ioctl.h usability... no 2024-02-18T10:03:23.778 INFO:teuthology.orchestra.run.smithi204.stdout:checking btrfs/ioctl.h presence... no 2024-02-18T10:03:23.778 INFO:teuthology.orchestra.run.smithi204.stdout:checking for btrfs/ioctl.h... no 2024-02-18T10:03:23.836 INFO:teuthology.orchestra.run.smithi204.stdout:checking cifs/ioctl.h usability... no 2024-02-18T10:03:23.871 INFO:teuthology.orchestra.run.smithi204.stdout:checking cifs/ioctl.h presence... no 2024-02-18T10:03:23.871 INFO:teuthology.orchestra.run.smithi204.stdout:checking for cifs/ioctl.h... no 2024-02-18T10:03:23.940 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/mman.h usability... yes 2024-02-18T10:03:23.967 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/mman.h presence... yes 2024-02-18T10:03:23.967 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/mman.h... yes 2024-02-18T10:03:24.013 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/xfs_log_format.h... no 2024-02-18T10:03:24.097 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare... no 2024-02-18T10:03:24.173 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare in -luuid... yes 2024-02-18T10:03:24.352 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/xfs.h... yes 2024-02-18T10:03:24.397 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/libxfs.h... no 2024-02-18T10:03:24.453 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether xlog_assign_lsn is declared... no 2024-02-18T10:03:24.528 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/xqm.h... yes 2024-02-18T10:03:24.636 INFO:teuthology.orchestra.run.smithi204.stdout:checking xfsctl from xfs/xfs.h... ok 2024-02-18T10:03:24.698 INFO:teuthology.orchestra.run.smithi204.stdout:checking xfs/handle.h usability... yes 2024-02-18T10:03:24.720 INFO:teuthology.orchestra.run.smithi204.stdout:checking xfs/handle.h presence... yes 2024-02-18T10:03:24.720 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/handle.h... yes 2024-02-18T10:03:24.803 INFO:teuthology.orchestra.run.smithi204.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-02-18T10:03:24.863 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/acl.h usability... yes 2024-02-18T10:03:24.890 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/acl.h presence... yes 2024-02-18T10:03:24.891 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/acl.h... yes 2024-02-18T10:03:24.956 INFO:teuthology.orchestra.run.smithi204.stdout:checking acl/libacl.h usability... yes 2024-02-18T10:03:24.987 INFO:teuthology.orchestra.run.smithi204.stdout:checking acl/libacl.h presence... yes 2024-02-18T10:03:24.987 INFO:teuthology.orchestra.run.smithi204.stdout:checking for acl/libacl.h... yes 2024-02-18T10:03:25.073 INFO:teuthology.orchestra.run.smithi204.stdout:checking for acl_init in -lacl... yes 2024-02-18T10:03:25.137 INFO:teuthology.orchestra.run.smithi204.stdout:checking gdbm-ndbm.h usability... no 2024-02-18T10:03:25.177 INFO:teuthology.orchestra.run.smithi204.stdout:checking gdbm-ndbm.h presence... no 2024-02-18T10:03:25.177 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gdbm-ndbm.h... no 2024-02-18T10:03:25.238 INFO:teuthology.orchestra.run.smithi204.stdout:checking gdbm/ndbm.h usability... yes 2024-02-18T10:03:25.265 INFO:teuthology.orchestra.run.smithi204.stdout:checking gdbm/ndbm.h presence... yes 2024-02-18T10:03:25.265 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gdbm/ndbm.h... yes 2024-02-18T10:03:25.360 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_open in -lgdbm... no 2024-02-18T10:03:25.454 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_fetch in -lgdbm... no 2024-02-18T10:03:25.552 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_store in -lgdbm... no 2024-02-18T10:03:25.642 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_close in -lgdbm... no 2024-02-18T10:03:25.734 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-02-18T10:03:25.814 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-02-18T10:03:25.894 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-02-18T10:03:25.977 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-02-18T10:03:26.036 INFO:teuthology.orchestra.run.smithi204.stdout:checking libaio.h usability... yes 2024-02-18T10:03:26.064 INFO:teuthology.orchestra.run.smithi204.stdout:checking libaio.h presence... yes 2024-02-18T10:03:26.065 INFO:teuthology.orchestra.run.smithi204.stdout:checking for libaio.h... yes 2024-02-18T10:03:26.131 INFO:teuthology.orchestra.run.smithi204.stdout:checking liburing.h usability... no 2024-02-18T10:03:26.173 INFO:teuthology.orchestra.run.smithi204.stdout:checking liburing.h presence... no 2024-02-18T10:03:26.174 INFO:teuthology.orchestra.run.smithi204.stdout:checking for liburing.h... no 2024-02-18T10:03:26.243 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/capability.h usability... yes 2024-02-18T10:03:26.275 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/capability.h presence... yes 2024-02-18T10:03:26.275 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/capability.h... yes 2024-02-18T10:03:26.363 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/fiemap.h usability... yes 2024-02-18T10:03:26.390 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/fiemap.h presence... yes 2024-02-18T10:03:26.390 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/fiemap.h... yes 2024-02-18T10:03:26.474 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fallocate... yes 2024-02-18T10:03:26.558 INFO:teuthology.orchestra.run.smithi204.stdout:checking for open_by_handle_at... yes 2024-02-18T10:03:26.662 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/prctl.h usability... yes 2024-02-18T10:03:26.689 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/prctl.h presence... yes 2024-02-18T10:03:26.689 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/prctl.h... yes 2024-02-18T10:03:26.749 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/fs.h usability... yes 2024-02-18T10:03:26.774 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/fs.h presence... yes 2024-02-18T10:03:26.774 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/fs.h... yes 2024-02-18T10:03:26.833 INFO:teuthology.orchestra.run.smithi204.stdout:checking btrfsutil.h usability... no 2024-02-18T10:03:26.876 INFO:teuthology.orchestra.run.smithi204.stdout:checking btrfsutil.h presence... no 2024-02-18T10:03:26.876 INFO:teuthology.orchestra.run.smithi204.stdout:checking for btrfsutil.h... no 2024-02-18T10:03:26.966 INFO:teuthology.orchestra.run.smithi204.stdout:checking for copy_file_range... yes 2024-02-18T10:03:27.057 INFO:teuthology.orchestra.run.smithi204.stdout:checking for SEEK_DATA... yes 2024-02-18T10:03:27.168 INFO:teuthology.orchestra.run.smithi204.stdout:checking for BMV_OF_SHARED... yes 2024-02-18T10:03:27.260 INFO:teuthology.orchestra.run.smithi204.stdout:checking for nftw... yes 2024-02-18T10:03:27.356 INFO:teuthology.orchestra.run.smithi204.stdout:checking for RLIMIT_NOFILE... yes 2024-02-18T10:03:27.434 INFO:teuthology.orchestra.run.smithi204.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-02-18T10:03:27.519 INFO:teuthology.orchestra.run.smithi204.stdout:checking for FICLONE... yes 2024-02-18T10:03:27.607 INFO:teuthology.orchestra.run.smithi204.stdout:checking for renameat2... yes 2024-02-18T10:03:27.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking for reallocarray... yes 2024-02-18T10:03:27.791 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct mount_attr... yes 2024-02-18T10:03:27.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:03:27.897 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:03:27.898 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_qgroup_limit... yes 2024-02-18T10:03:27.900 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:03:27.986 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-02-18T10:03:28.078 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-02-18T10:03:28.171 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-02-18T10:03:28.259 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-02-18T10:03:28.348 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-02-18T10:03:28.433 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-02-18T10:03:28.495 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/btrfs.h usability... yes 2024-02-18T10:03:28.520 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/btrfs.h presence... yes 2024-02-18T10:03:28.520 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/btrfs.h... yes 2024-02-18T10:03:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/btrfs_tree.h usability... yes 2024-02-18T10:03:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:checking linux/btrfs_tree.h presence... yes 2024-02-18T10:03:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/btrfs_tree.h... yes 2024-02-18T10:03:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-02-18T10:03:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:configure: creating ./config.status 2024-02-18T10:03:29.671 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/builddefs 2024-02-18T10:03:29.702 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/config.h 2024-02-18T10:03:29.727 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: executing libtool commands 2024-02-18T10:03:29.815 INFO:teuthology.orchestra.run.smithi204.stdout:Building include 2024-02-18T10:03:29.825 INFO:teuthology.orchestra.run.smithi204.stdout:Building lib 2024-02-18T10:03:29.834 INFO:teuthology.orchestra.run.smithi204.stdout: [LTDEP] 2024-02-18T10:03:30.143 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dataascii.lo 2024-02-18T10:03:30.402 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] databin.lo 2024-02-18T10:03:30.701 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] datapid.lo 2024-02-18T10:03:30.939 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] file_lock.lo 2024-02-18T10:03:31.243 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] forker.lo 2024-02-18T10:03:31.601 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pattern.lo 2024-02-18T10:03:31.859 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] open_flags.lo 2024-02-18T10:03:32.135 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] random_range.lo 2024-02-18T10:03:32.509 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] string_to_tokens.lo 2024-02-18T10:03:32.748 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] str_to_bytes.lo 2024-02-18T10:03:33.022 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] tlibio.lo 2024-02-18T10:03:33.429 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] write_log.lo 2024-02-18T10:03:33.824 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] random.lo 2024-02-18T10:03:34.069 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] 2024-02-18T10:03:34.282 INFO:teuthology.orchestra.run.smithi204.stdout:Building ltp 2024-02-18T10:03:34.291 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2024-02-18T10:03:34.613 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] doio 2024-02-18T10:03:35.482 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsstress 2024-02-18T10:03:37.063 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsx 2024-02-18T10:03:37.973 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] growfiles 2024-02-18T10:03:38.645 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] iogen 2024-02-18T10:03:39.188 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-stress 2024-02-18T10:03:39.796 INFO:teuthology.orchestra.run.smithi204.stdout:Building src 2024-02-18T10:03:39.809 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2024-02-18T10:03:43.659 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2024-02-18T10:03:43.731 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2024-02-18T10:03:43.753 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2024-02-18T10:03:44.227 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2024-02-18T10:03:44.282 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dirstress 2024-02-18T10:03:44.691 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fill 2024-02-18T10:03:45.021 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fill2 2024-02-18T10:03:45.443 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] getpagesize 2024-02-18T10:03:45.725 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] holes 2024-02-18T10:03:46.087 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] lstat64 2024-02-18T10:03:46.419 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] nametest 2024-02-18T10:03:46.819 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] permname 2024-02-18T10:03:47.198 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] randholes 2024-02-18T10:03:47.656 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] runas 2024-02-18T10:03:48.005 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] truncfile 2024-02-18T10:03:48.347 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] usemem 2024-02-18T10:03:48.679 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmapcat 2024-02-18T10:03:48.998 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] append_reader 2024-02-18T10:03:49.289 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] append_writer 2024-02-18T10:03:49.598 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dirperf 2024-02-18T10:03:49.985 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] metaperf 2024-02-18T10:03:50.424 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] devzero 2024-02-18T10:03:50.748 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] feature 2024-02-18T10:03:51.138 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] alloc 2024-02-18T10:03:51.524 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fault 2024-02-18T10:03:51.874 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fstest 2024-02-18T10:03:52.307 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_access_root 2024-02-18T10:03:52.628 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] godown 2024-02-18T10:03:52.945 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] resvtest 2024-02-18T10:03:53.292 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] writemod 2024-02-18T10:03:53.616 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] writev_on_pagefault 2024-02-18T10:03:53.929 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] makeextents 2024-02-18T10:03:54.293 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] itrash 2024-02-18T10:03:54.626 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rename 2024-02-18T10:03:54.913 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] multi_open_unlink 2024-02-18T10:03:55.258 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] unwritten_sync 2024-02-18T10:03:55.616 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] genhashnames 2024-02-18T10:03:56.003 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_holes 2024-02-18T10:03:56.313 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_writev 2024-02-18T10:03:56.661 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_truncate_cmtime 2024-02-18T10:03:56.993 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dirhash_collide 2024-02-18T10:03:57.333 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_rename_overwrite 2024-02-18T10:03:57.618 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] holetest 2024-02-18T10:03:58.005 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_truncate_self 2024-02-18T10:03:58.031 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:03:58.033 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:03:58.036 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:03:58.268 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] af_unix 2024-02-18T10:03:58.545 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_stale_pmd 2024-02-18T10:03:58.837 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_cow_race 2024-02-18T10:03:59.116 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_fallocate 2024-02-18T10:03:59.376 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsync-err 2024-02-18T10:03:59.669 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_write_ro 2024-02-18T10:03:59.942 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_ext4_dax_journal_corruption 2024-02-18T10:04:00.287 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_ext4_dax_inline_corruption 2024-02-18T10:04:00.589 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_ofd_locks 2024-02-18T10:04:00.970 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_collision 2024-02-18T10:04:01.329 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmap-write-concurrent 2024-02-18T10:04:01.645 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_get_file_time 2024-02-18T10:04:01.959 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_create_short_dirs 2024-02-18T10:04:02.297 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_create_long_dirs 2024-02-18T10:04:02.623 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_enospc 2024-02-18T10:04:02.995 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_writev_overlap 2024-02-18T10:04:03.355 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] checkpoint_journal 2024-02-18T10:04:03.691 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmap-rw-fault 2024-02-18T10:04:04.057 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] allocstale 2024-02-18T10:04:04.413 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_cow_memory_failure 2024-02-18T10:04:04.747 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fake-dump-rootino 2024-02-18T10:04:05.067 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dio-buf-fault 2024-02-18T10:04:05.382 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rewinddir-test 2024-02-18T10:04:05.732 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] readdir-while-renames 2024-02-18T10:04:06.069 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfsctl 2024-02-18T10:04:06.445 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bstat 2024-02-18T10:04:06.814 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mtab 2024-02-18T10:04:07.184 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] getdevicesize 2024-02-18T10:04:07.504 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] preallo_rw_pattern_reader 2024-02-18T10:04:07.851 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] preallo_rw_pattern_writer 2024-02-18T10:04:08.174 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] ftrunc 2024-02-18T10:04:08.505 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] trunc 2024-02-18T10:04:08.845 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fs_perms 2024-02-18T10:04:09.166 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] testx 2024-02-18T10:04:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] looptest 2024-02-18T10:04:09.832 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] locktest 2024-02-18T10:04:10.339 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] unwritten_mmap 2024-02-18T10:04:10.675 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat_unlink_test 2024-02-18T10:04:11.055 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] deduperace 2024-02-18T10:04:11.411 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat_unlink_test_modified 2024-02-18T10:04:11.793 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_dir_offset 2024-02-18T10:04:12.125 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_futimens 2024-02-18T10:04:12.431 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_immutable 2024-02-18T10:04:13.246 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] stale_handle 2024-02-18T10:04:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pwrite_mmap_blocked 2024-02-18T10:04:13.882 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_dir_offset2 2024-02-18T10:04:14.239 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] seek_sanity_test 2024-02-18T10:04:14.883 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] seek_copy_test 2024-02-18T10:04:15.234 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_readdir_1 2024-02-18T10:04:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_readdir_2 2024-02-18T10:04:15.854 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsync-tester 2024-02-18T10:04:16.255 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] nsexec 2024-02-18T10:04:16.594 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] cloner 2024-02-18T10:04:16.987 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] renameat2 2024-02-18T10:04:17.321 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_getcwd 2024-02-18T10:04:17.654 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] e4compact 2024-02-18T10:04:18.018 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] test-nextquota 2024-02-18T10:04:18.365 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] punch-alternating 2024-02-18T10:04:18.723 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr-list-by-handle-cursor-test 2024-02-18T10:04:19.062 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] listxattr 2024-02-18T10:04:19.394 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dio-interleaved 2024-02-18T10:04:19.738 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_dir_type 2024-02-18T10:04:20.054 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dio-invalidate-cache 2024-02-18T10:04:20.450 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] stat_test 2024-02-18T10:04:20.932 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_encrypted_d_revalidate 2024-02-18T10:04:21.266 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr_replace_test 2024-02-18T10:04:21.583 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] swapon 2024-02-18T10:04:21.924 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mkswap 2024-02-18T10:04:22.228 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_attr_corruption 2024-02-18T10:04:22.518 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_open_tmpfiles 2024-02-18T10:04:22.876 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fscrypt-crypt-util 2024-02-18T10:04:23.746 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat_null_ocount 2024-02-18T10:04:24.036 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] splice-test 2024-02-18T10:04:24.378 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] chprojid_fail 2024-02-18T10:04:24.710 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] detached_mounts_propagation 2024-02-18T10:04:25.080 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] ext4_resize 2024-02-18T10:04:25.400 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_readdir_3 2024-02-18T10:04:25.779 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] splice2pipe 2024-02-18T10:04:26.113 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] uuid_ioctl 2024-02-18T10:04:26.423 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_snapshot_deleted_subvolume 2024-02-18T10:04:26.794 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fiemap-tester 2024-02-18T10:04:27.252 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_stripealign 2024-02-18T10:04:27.552 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] open_by_handle 2024-02-18T10:04:27.992 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dbtest 2024-02-18T10:04:28.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:04:28.184 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:04:28.188 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:04:28.408 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_dio 2024-02-18T10:04:28.731 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfsfind 2024-02-18T10:04:29.088 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_reflink_read_race 2024-02-18T10:04:29.434 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fssum 2024-02-18T10:04:30.091 INFO:teuthology.orchestra.run.smithi204.stdout:Building log-writes 2024-02-18T10:04:30.105 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] replay-log 2024-02-18T10:04:30.607 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2024-02-18T10:04:30.620 INFO:teuthology.orchestra.run.smithi204.stdout:Building aio-dio-regress 2024-02-18T10:04:30.633 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aiocp 2024-02-18T10:04:31.035 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-append-write-fallocate-race 2024-02-18T10:04:31.356 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-append-write-read-race 2024-02-18T10:04:31.686 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-cow-race 2024-02-18T10:04:32.000 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-cycle-write 2024-02-18T10:04:32.364 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-eof-race 2024-02-18T10:04:32.714 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-extend-stat 2024-02-18T10:04:33.050 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-fcntl-race 2024-02-18T10:04:33.366 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-hole-filling-race 2024-02-18T10:04:33.690 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-invalidate-failure 2024-02-18T10:04:34.020 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-invalidate-readahead 2024-02-18T10:04:34.384 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aiodio_sparse2 2024-02-18T10:04:34.785 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-subblock-eof-read 2024-02-18T10:04:35.096 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-write-verify 2024-02-18T10:04:35.442 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-02-18T10:04:35.746 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-02-18T10:04:36.022 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-last-ref-held-by-io 2024-02-18T10:04:36.347 INFO:teuthology.orchestra.run.smithi204.stdout:Building vfs 2024-02-18T10:04:36.360 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] vfstest 2024-02-18T10:04:40.217 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mount-idmapped 2024-02-18T10:04:40.769 INFO:teuthology.orchestra.run.smithi204.stdout:Building m4 2024-02-18T10:04:40.780 INFO:teuthology.orchestra.run.smithi204.stdout:Building common 2024-02-18T10:04:40.790 INFO:teuthology.orchestra.run.smithi204.stdout:Building tests 2024-02-18T10:04:40.803 INFO:teuthology.orchestra.run.smithi204.stdout:Building btrfs 2024-02-18T10:04:40.818 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/btrfs/group.list 2024-02-18T10:04:41.029 INFO:teuthology.orchestra.run.smithi204.stdout:Building ceph 2024-02-18T10:04:41.043 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ceph/group.list 2024-02-18T10:04:41.093 INFO:teuthology.orchestra.run.smithi204.stdout:Building cifs 2024-02-18T10:04:41.104 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/cifs/group.list 2024-02-18T10:04:41.147 INFO:teuthology.orchestra.run.smithi204.stdout:Building ext4 2024-02-18T10:04:41.160 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ext4/group.list 2024-02-18T10:04:41.297 INFO:teuthology.orchestra.run.smithi204.stdout:Building f2fs 2024-02-18T10:04:41.311 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/f2fs/group.list 2024-02-18T10:04:41.373 INFO:teuthology.orchestra.run.smithi204.stdout:Building generic 2024-02-18T10:04:41.391 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/generic/group.list 2024-02-18T10:04:41.743 INFO:teuthology.orchestra.run.smithi204.stdout:Building nfs 2024-02-18T10:04:41.757 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/nfs/group.list 2024-02-18T10:04:41.807 INFO:teuthology.orchestra.run.smithi204.stdout:Building ocfs2 2024-02-18T10:04:41.821 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ocfs2/group.list 2024-02-18T10:04:41.867 INFO:teuthology.orchestra.run.smithi204.stdout:Building overlay 2024-02-18T10:04:41.883 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/overlay/group.list 2024-02-18T10:04:42.024 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2024-02-18T10:04:42.036 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/perf/group.list 2024-02-18T10:04:42.076 INFO:teuthology.orchestra.run.smithi204.stdout:Building selftest 2024-02-18T10:04:42.088 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/selftest/group.list 2024-02-18T10:04:42.134 INFO:teuthology.orchestra.run.smithi204.stdout:Building shared 2024-02-18T10:04:42.149 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/shared/group.list 2024-02-18T10:04:42.213 INFO:teuthology.orchestra.run.smithi204.stdout:Building tmpfs 2024-02-18T10:04:42.227 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/tmpfs/group.list 2024-02-18T10:04:42.275 INFO:teuthology.orchestra.run.smithi204.stdout:Building udf 2024-02-18T10:04:42.290 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/udf/group.list 2024-02-18T10:04:42.330 INFO:teuthology.orchestra.run.smithi204.stdout:Building xfs 2024-02-18T10:04:42.347 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/xfs/group.list 2024-02-18T10:04:42.709 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.pjmFjSgc0uxfstests-dev && exec sudo make install) 2024-02-18T10:04:42.831 INFO:teuthology.orchestra.run.smithi204.stdout:Building include 2024-02-18T10:04:42.842 INFO:teuthology.orchestra.run.smithi204.stdout:Building lib 2024-02-18T10:04:42.853 INFO:teuthology.orchestra.run.smithi204.stdout:Building ltp 2024-02-18T10:04:42.863 INFO:teuthology.orchestra.run.smithi204.stdout:Building src 2024-02-18T10:04:42.947 INFO:teuthology.orchestra.run.smithi204.stdout:Building log-writes 2024-02-18T10:04:42.957 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2024-02-18T10:04:42.967 INFO:teuthology.orchestra.run.smithi204.stdout:Building aio-dio-regress 2024-02-18T10:04:42.978 INFO:teuthology.orchestra.run.smithi204.stdout:Building vfs 2024-02-18T10:04:42.989 INFO:teuthology.orchestra.run.smithi204.stdout:Building m4 2024-02-18T10:04:42.999 INFO:teuthology.orchestra.run.smithi204.stdout:Building common 2024-02-18T10:04:43.010 INFO:teuthology.orchestra.run.smithi204.stdout:Building tests 2024-02-18T10:04:43.025 INFO:teuthology.orchestra.run.smithi204.stdout:Building btrfs 2024-02-18T10:04:43.040 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/btrfs/group.list 2024-02-18T10:04:43.241 INFO:teuthology.orchestra.run.smithi204.stdout:Building ceph 2024-02-18T10:04:43.255 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ceph/group.list 2024-02-18T10:04:43.303 INFO:teuthology.orchestra.run.smithi204.stdout:Building cifs 2024-02-18T10:04:43.317 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/cifs/group.list 2024-02-18T10:04:43.361 INFO:teuthology.orchestra.run.smithi204.stdout:Building ext4 2024-02-18T10:04:43.375 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ext4/group.list 2024-02-18T10:04:43.514 INFO:teuthology.orchestra.run.smithi204.stdout:Building f2fs 2024-02-18T10:04:43.527 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/f2fs/group.list 2024-02-18T10:04:43.588 INFO:teuthology.orchestra.run.smithi204.stdout:Building generic 2024-02-18T10:04:43.606 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/generic/group.list 2024-02-18T10:04:43.936 INFO:teuthology.orchestra.run.smithi204.stdout:Building nfs 2024-02-18T10:04:43.950 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/nfs/group.list 2024-02-18T10:04:44.001 INFO:teuthology.orchestra.run.smithi204.stdout:Building ocfs2 2024-02-18T10:04:44.015 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ocfs2/group.list 2024-02-18T10:04:44.064 INFO:teuthology.orchestra.run.smithi204.stdout:Building overlay 2024-02-18T10:04:44.078 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/overlay/group.list 2024-02-18T10:04:44.221 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2024-02-18T10:04:44.235 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/perf/group.list 2024-02-18T10:04:44.275 INFO:teuthology.orchestra.run.smithi204.stdout:Building selftest 2024-02-18T10:04:44.290 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/selftest/group.list 2024-02-18T10:04:44.334 INFO:teuthology.orchestra.run.smithi204.stdout:Building shared 2024-02-18T10:04:44.349 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/shared/group.list 2024-02-18T10:04:44.409 INFO:teuthology.orchestra.run.smithi204.stdout:Building tmpfs 2024-02-18T10:04:44.423 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/tmpfs/group.list 2024-02-18T10:04:44.470 INFO:teuthology.orchestra.run.smithi204.stdout:Building udf 2024-02-18T10:04:44.484 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/udf/group.list 2024-02-18T10:04:44.523 INFO:teuthology.orchestra.run.smithi204.stdout:Building xfs 2024-02-18T10:04:44.540 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/xfs/group.list 2024-02-18T10:04:44.892 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-02-18T10:04:44.896 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-18T10:04:44.896 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-02-18T10:04:44.900 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-18T10:04:44.901 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-02-18T10:04:44.906 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-02-18T10:04:44.938 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-02-18T10:04:45.167 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-02-18T10:04:45.199 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-02-18T10:04:45.244 INFO:teuthology.orchestra.run.smithi204.stdout:Building log-writes 2024-02-18T10:04:45.255 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2024-02-18T10:04:45.265 INFO:teuthology.orchestra.run.smithi204.stdout:Building aio-dio-regress 2024-02-18T10:04:45.276 INFO:teuthology.orchestra.run.smithi204.stdout:Building vfs 2024-02-18T10:04:45.285 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C log-writes install 2024-02-18T10:04:45.288 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-02-18T10:04:45.319 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-02-18T10:04:45.348 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C perf install 2024-02-18T10:04:45.352 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-02-18T10:04:45.381 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-02-18T10:04:45.462 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-02-18T10:04:45.466 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-02-18T10:04:45.497 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-02-18T10:04:45.686 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C vfs install 2024-02-18T10:04:45.692 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-02-18T10:04:45.724 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-02-18T10:04:45.769 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-02-18T10:04:45.801 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-02-18T10:04:50.037 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-02-18T10:04:50.357 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-02-18T10:04:50.422 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-02-18T10:04:50.426 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-18T10:04:50.426 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-02-18T10:04:50.430 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-02-18T10:04:50.459 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-02-18T10:04:50.919 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-02-18T10:04:50.922 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/btrfs/ install 2024-02-18T10:04:50.928 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-02-18T10:04:50.957 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 /var/lib/xfstests/tests/btrfs 2024-02-18T10:04:54.021 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-02-18T10:04:54.054 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out /var/lib/xfstests/tests/btrfs 2024-02-18T10:04:57.166 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ceph/ install 2024-02-18T10:04:57.166 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-02-18T10:04:57.197 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-02-18T10:04:57.263 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-02-18T10:04:57.295 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-02-18T10:04:57.364 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/cifs/ install 2024-02-18T10:04:57.368 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-02-18T10:04:57.399 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-02-18T10:04:57.430 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-02-18T10:04:57.461 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-02-18T10:04:57.493 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ext4/ install 2024-02-18T10:04:57.498 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-02-18T10:04:57.530 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-02-18T10:04:58.207 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-02-18T10:04:58.239 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-02-18T10:04:58.308 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:04:58.311 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:04:58.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:04:58.917 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/f2fs/ install 2024-02-18T10:04:58.920 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-02-18T10:04:58.952 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-02-18T10:04:58.991 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-02-18T10:04:59.022 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-02-18T10:04:59.062 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/generic/ install 2024-02-18T10:04:59.072 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-02-18T10:04:59.104 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-02-18T10:05:06.830 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-02-18T10:05:06.862 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-02-18T10:05:14.690 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/nfs/ install 2024-02-18T10:05:14.694 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-02-18T10:05:14.728 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-02-18T10:05:14.757 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-02-18T10:05:14.785 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-02-18T10:05:14.814 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/ocfs2/ install 2024-02-18T10:05:14.819 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-02-18T10:05:14.846 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-02-18T10:05:14.874 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-02-18T10:05:14.904 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-02-18T10:05:14.935 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/overlay/ install 2024-02-18T10:05:14.940 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-02-18T10:05:14.969 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-02-18T10:05:16.033 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-02-18T10:05:16.065 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-02-18T10:05:17.101 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/perf/ install 2024-02-18T10:05:17.104 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-02-18T10:05:17.135 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-02-18T10:05:17.164 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-02-18T10:05:17.194 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-02-18T10:05:17.225 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/selftest/ install 2024-02-18T10:05:17.230 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-02-18T10:05:17.262 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-02-18T10:05:17.342 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-02-18T10:05:17.374 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-02-18T10:05:17.455 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/shared/ install 2024-02-18T10:05:17.459 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-02-18T10:05:17.492 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-02-18T10:05:17.544 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-02-18T10:05:17.576 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-02-18T10:05:17.620 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/tmpfs/ install 2024-02-18T10:05:17.624 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-02-18T10:05:17.652 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-02-18T10:05:17.683 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-02-18T10:05:17.713 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-02-18T10:05:17.744 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/udf/ install 2024-02-18T10:05:17.749 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-02-18T10:05:17.778 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-02-18T10:05:17.810 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-02-18T10:05:17.843 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-02-18T10:05:17.875 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.pjmFjSgc0uxfstests-dev/tests/xfs/ install 2024-02-18T10:05:17.886 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-02-18T10:05:17.917 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 602 603 604 605 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-02-18T10:05:24.742 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-02-18T10:05:24.773 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 602.out 603.out 604.out 605.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-02-18T10:05:28.432 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:05:28.435 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:05:28.438 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:05:32.011 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-02-18T10:05:32.040 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-02-18T10:05:32.069 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-02-18T10:05:32.101 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-02-18T10:05:32.139 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.qNdAS3jX7mxfsprogs-dev && exec sudo make) 2024-02-18T10:05:32.245 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize -c -i -f 2024-02-18T10:05:32.593 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2024-02-18T10:05:32.593 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.guess' 2024-02-18T10:05:32.607 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.sub' 2024-02-18T10:05:32.624 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './install-sh' 2024-02-18T10:05:32.636 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './ltmain.sh' 2024-02-18T10:05:32.721 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-02-18T10:05:32.721 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-02-18T10:05:32.739 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-02-18T10:05:32.756 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-02-18T10:05:32.774 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-02-18T10:05:32.791 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-02-18T10:05:32.814 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-02-18T10:05:32.819 INFO:teuthology.orchestra.run.smithi204.stdout:cp include/install-sh . 2024-02-18T10:05:32.823 INFO:teuthology.orchestra.run.smithi204.stdout:aclocal -I m4 2024-02-18T10:05:34.229 INFO:teuthology.orchestra.run.smithi204.stdout:autoconf 2024-02-18T10:05:34.706 INFO:teuthology.orchestra.run.smithi204.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2024-02-18T10:05:34.873 INFO:teuthology.orchestra.run.smithi204.stdout:configure: loading site script /usr/share/config.site 2024-02-18T10:05:34.917 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a BSD-compatible install... /bin/install -c 2024-02-18T10:05:35.046 INFO:teuthology.orchestra.run.smithi204.stdout:checking build system type... x86_64-pc-linux-gnu 2024-02-18T10:05:35.046 INFO:teuthology.orchestra.run.smithi204.stdout:checking host system type... x86_64-pc-linux-gnu 2024-02-18T10:05:35.051 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to print strings... printf 2024-02-18T10:05:35.051 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... gcc 2024-02-18T10:05:35.166 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the C compiler works... yes 2024-02-18T10:05:35.166 INFO:teuthology.orchestra.run.smithi204.stdout:checking for C compiler default output file name... a.out 2024-02-18T10:05:35.237 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of executables... 2024-02-18T10:05:35.318 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are cross compiling... no 2024-02-18T10:05:35.370 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of object files... o 2024-02-18T10:05:35.418 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are using the GNU C compiler... yes 2024-02-18T10:05:35.464 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... yes 2024-02-18T10:05:35.529 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to accept ISO C89... none needed 2024-02-18T10:05:35.539 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a sed that does not truncate output... /bin/sed 2024-02-18T10:05:35.548 INFO:teuthology.orchestra.run.smithi204.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-02-18T10:05:35.553 INFO:teuthology.orchestra.run.smithi204.stdout:checking for egrep... /bin/grep -E 2024-02-18T10:05:35.558 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fgrep... /bin/grep -F 2024-02-18T10:05:35.571 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ld used by gcc... /bin/ld 2024-02-18T10:05:35.578 INFO:teuthology.orchestra.run.smithi204.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-02-18T10:05:35.585 INFO:teuthology.orchestra.run.smithi204.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-02-18T10:05:35.670 INFO:teuthology.orchestra.run.smithi204.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-02-18T10:05:35.670 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2024-02-18T10:05:35.683 INFO:teuthology.orchestra.run.smithi204.stdout:checking the maximum length of command line arguments... 1572864 2024-02-18T10:05:35.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-02-18T10:05:35.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-02-18T10:05:35.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking for /bin/ld option to reload object files... -r 2024-02-18T10:05:35.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdump... objdump 2024-02-18T10:05:35.695 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to recognize dependent libraries... pass_all 2024-02-18T10:05:35.695 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlltool... no 2024-02-18T10:05:35.695 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-02-18T10:05:35.696 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ar... ar 2024-02-18T10:05:35.786 INFO:teuthology.orchestra.run.smithi204.stdout:checking for archiver @FILE support... @ 2024-02-18T10:05:35.787 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strip... strip 2024-02-18T10:05:35.787 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ranlib... ranlib 2024-02-18T10:05:35.788 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gawk... gawk 2024-02-18T10:05:35.962 INFO:teuthology.orchestra.run.smithi204.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-02-18T10:05:35.966 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sysroot... no 2024-02-18T10:05:35.979 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a working dd... /bin/dd 2024-02-18T10:05:35.991 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-02-18T10:05:36.033 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mt... no 2024-02-18T10:05:36.043 INFO:teuthology.orchestra.run.smithi204.stdout:checking if : is a manifest tool... no 2024-02-18T10:05:36.115 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to run the C preprocessor... gcc -E 2024-02-18T10:05:36.386 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ANSI C header files... yes 2024-02-18T10:05:36.446 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/types.h... yes 2024-02-18T10:05:36.516 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/stat.h... yes 2024-02-18T10:05:36.583 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdlib.h... yes 2024-02-18T10:05:36.651 INFO:teuthology.orchestra.run.smithi204.stdout:checking for string.h... yes 2024-02-18T10:05:36.724 INFO:teuthology.orchestra.run.smithi204.stdout:checking for memory.h... yes 2024-02-18T10:05:36.797 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strings.h... yes 2024-02-18T10:05:36.871 INFO:teuthology.orchestra.run.smithi204.stdout:checking for inttypes.h... yes 2024-02-18T10:05:36.945 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdint.h... yes 2024-02-18T10:05:37.021 INFO:teuthology.orchestra.run.smithi204.stdout:checking for unistd.h... yes 2024-02-18T10:05:37.087 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlfcn.h... yes 2024-02-18T10:05:37.099 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdir... .libs 2024-02-18T10:05:37.278 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-02-18T10:05:37.278 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-02-18T10:05:37.328 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-02-18T10:05:37.376 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc static flag -static works... no 2024-02-18T10:05:37.454 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... yes 2024-02-18T10:05:37.454 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-02-18T10:05:37.480 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-02-18T10:05:37.552 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether -lc should be explicitly linked in... no 2024-02-18T10:05:37.688 INFO:teuthology.orchestra.run.smithi204.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-02-18T10:05:37.688 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to hardcode library paths into programs... immediate 2024-02-18T10:05:37.693 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether stripping libraries is possible... yes 2024-02-18T10:05:37.693 INFO:teuthology.orchestra.run.smithi204.stdout:checking if libtool supports shared libraries... yes 2024-02-18T10:05:37.693 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build shared libraries... yes 2024-02-18T10:05:37.693 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build static libraries... yes 2024-02-18T10:05:37.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2024-02-18T10:05:37.739 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-02-18T10:05:37.739 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-18T10:05:37.739 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-02-18T10:05:37.756 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2024-02-18T10:05:37.802 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-02-18T10:05:37.802 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-18T10:05:37.802 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-02-18T10:05:37.812 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2024-02-18T10:05:37.864 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-02-18T10:05:37.864 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-18T10:05:37.864 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-02-18T10:05:37.864 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gmake... /bin/gmake 2024-02-18T10:05:37.865 INFO:teuthology.orchestra.run.smithi204.stdout:checking for tar... /bin/tar 2024-02-18T10:05:37.865 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gzip... /bin/gzip 2024-02-18T10:05:37.886 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc -MM is supported... yes 2024-02-18T10:05:37.887 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sort... /bin/sort 2024-02-18T10:05:37.887 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2024-02-18T10:05:37.888 INFO:teuthology.orchestra.run.smithi204.stdout:checking for msgfmt... /bin/msgfmt 2024-02-18T10:05:37.888 INFO:teuthology.orchestra.run.smithi204.stdout:checking for msgmerge... /bin/msgmerge 2024-02-18T10:05:37.888 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xgettext... /bin/xgettext 2024-02-18T10:05:37.889 INFO:teuthology.orchestra.run.smithi204.stdout:checking for rpm... /bin/rpm 2024-02-18T10:05:37.898 INFO:teuthology.orchestra.run.smithi204.stdout:checking for rpmbuild... no 2024-02-18T10:05:37.960 INFO:teuthology.orchestra.run.smithi204.stdout:checking ini.h usability... yes 2024-02-18T10:05:37.989 INFO:teuthology.orchestra.run.smithi204.stdout:checking ini.h presence... yes 2024-02-18T10:05:37.990 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ini.h... yes 2024-02-18T10:05:38.073 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ini_parse in -linih... yes 2024-02-18T10:05:38.143 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid.h usability... no 2024-02-18T10:05:38.181 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid.h presence... no 2024-02-18T10:05:38.181 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid.h... no 2024-02-18T10:05:38.251 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/uuid.h usability... no 2024-02-18T10:05:38.290 INFO:teuthology.orchestra.run.smithi204.stdout:checking sys/uuid.h presence... no 2024-02-18T10:05:38.290 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/uuid.h... no 2024-02-18T10:05:38.361 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid/uuid.h usability... yes 2024-02-18T10:05:38.392 INFO:teuthology.orchestra.run.smithi204.stdout:checking uuid/uuid.h presence... yes 2024-02-18T10:05:38.392 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid/uuid.h... yes 2024-02-18T10:05:38.497 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare... no 2024-02-18T10:05:38.581 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare in -luuid... yes 2024-02-18T10:05:38.646 INFO:teuthology.orchestra.run.smithi204.stdout:checking pthread.h usability... yes 2024-02-18T10:05:38.677 INFO:teuthology.orchestra.run.smithi204.stdout:checking pthread.h presence... yes 2024-02-18T10:05:38.677 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pthread.h... yes 2024-02-18T10:05:38.762 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pthread_mutex_init in -lpthread... yes 2024-02-18T10:05:38.832 INFO:teuthology.orchestra.run.smithi204.stdout:checking urcu.h usability... yes 2024-02-18T10:05:38.873 INFO:teuthology.orchestra.run.smithi204.stdout:checking urcu.h presence... yes 2024-02-18T10:05:38.873 INFO:teuthology.orchestra.run.smithi204.stdout:checking for urcu.h... yes 2024-02-18T10:05:38.943 INFO:teuthology.orchestra.run.smithi204.stdout:checking for liburcu... yes 2024-02-18T10:05:38.996 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fadvise ... yes 2024-02-18T10:05:39.049 INFO:teuthology.orchestra.run.smithi204.stdout:checking for madvise ... yes 2024-02-18T10:05:39.101 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mincore ... yes 2024-02-18T10:05:39.160 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sendfile ... yes 2024-02-18T10:05:39.214 INFO:teuthology.orchestra.run.smithi204.stdout:checking for getmntent ... yes 2024-02-18T10:05:39.301 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fallocate... yes 2024-02-18T10:05:39.385 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fiemap... yes 2024-02-18T10:05:39.468 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pwritev2... yes 2024-02-18T10:05:39.551 INFO:teuthology.orchestra.run.smithi204.stdout:checking for preadv... yes 2024-02-18T10:05:39.636 INFO:teuthology.orchestra.run.smithi204.stdout:checking for copy_file_range... yes 2024-02-18T10:05:39.718 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sync_file_range... yes 2024-02-18T10:05:39.800 INFO:teuthology.orchestra.run.smithi204.stdout:checking for syncfs... yes 2024-02-18T10:05:39.864 INFO:teuthology.orchestra.run.smithi204.stdout:checking mntent.h usability... yes 2024-02-18T10:05:39.892 INFO:teuthology.orchestra.run.smithi204.stdout:checking mntent.h presence... yes 2024-02-18T10:05:39.892 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mntent.h... yes 2024-02-18T10:05:39.960 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether fls is declared... no 2024-02-18T10:05:40.041 INFO:teuthology.orchestra.run.smithi204.stdout:checking for readdir... yes 2024-02-18T10:05:40.107 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether fsetxattr is declared... yes 2024-02-18T10:05:40.173 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether mremap is declared... yes 2024-02-18T10:05:40.272 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fsxattr... yes 2024-02-18T10:05:40.325 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2024-02-18T10:05:40.420 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fscrypt_add_key_arg... yes 2024-02-18T10:05:40.473 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2024-02-18T10:05:40.567 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fscrypt_policy_v2... yes 2024-02-18T10:05:40.667 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fscrypt_policy_v2.log2_data_unit_size... no 2024-02-18T10:05:40.763 INFO:teuthology.orchestra.run.smithi204.stdout:checking for GETFSMAP... yes 2024-02-18T10:05:40.855 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct statfs... yes 2024-02-18T10:05:40.905 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct statfs.f_flags... yes 2024-02-18T10:05:40.951 INFO:teuthology.orchestra.run.smithi204.stdout:checking for MAP_SYNC... yes 2024-02-18T10:05:41.137 INFO:teuthology.orchestra.run.smithi204.stdout:checking for library containing dm_task_create... -ldevmapper 2024-02-18T10:05:41.197 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mallinfo ... yes 2024-02-18T10:05:41.256 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mallinfo2 ... yes 2024-02-18T10:05:41.319 INFO:teuthology.orchestra.run.smithi204.stdout:checking attr/attributes.h usability... yes 2024-02-18T10:05:41.345 INFO:teuthology.orchestra.run.smithi204.stdout:checking attr/attributes.h presence... yes 2024-02-18T10:05:41.345 INFO:teuthology.orchestra.run.smithi204.stdout:checking for attr/attributes.h... yes 2024-02-18T10:05:41.402 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct attrlist_cursor... yes 2024-02-18T10:05:41.405 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pkg-config... /bin/pkg-config 2024-02-18T10:05:41.424 INFO:teuthology.orchestra.run.smithi204.stdout:checking pkg-config is at least version 0.9.0... yes 2024-02-18T10:05:41.505 INFO:teuthology.orchestra.run.smithi204.stdout:checking for libicu... yes 2024-02-18T10:05:41.573 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether openat is declared... yes 2024-02-18T10:05:41.646 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether fstatat is declared... yes 2024-02-18T10:05:41.709 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct sg_io_hdr ... yes 2024-02-18T10:05:41.770 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct hd_geometry ... yes 2024-02-18T10:05:41.857 INFO:teuthology.orchestra.run.smithi204.stdout:checking for systemd... yes 2024-02-18T10:05:41.877 INFO:teuthology.orchestra.run.smithi204.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2024-02-18T10:05:41.878 INFO:teuthology.orchestra.run.smithi204.stdout:checking for system crontab dir... /etc/cron.d 2024-02-18T10:05:41.957 INFO:teuthology.orchestra.run.smithi204.stdout:checking for udev... yes 2024-02-18T10:05:41.976 INFO:teuthology.orchestra.run.smithi204.stdout:checking for udev rule dir... /usr/lib/udev/rules.d 2024-02-18T10:05:42.167 INFO:teuthology.orchestra.run.smithi204.stdout:checking for library containing blkid_probe_all... -lblkid 2024-02-18T10:05:42.255 INFO:teuthology.orchestra.run.smithi204.stdout:checking for blkid_probe_get_topology... yes 2024-02-18T10:05:42.372 INFO:teuthology.orchestra.run.smithi204.stdout:checking size of long... 8 2024-02-18T10:05:42.492 INFO:teuthology.orchestra.run.smithi204.stdout:checking size of char *... 8 2024-02-18T10:05:42.535 INFO:teuthology.orchestra.run.smithi204.stdout:checking for umode_t... no 2024-02-18T10:05:42.648 INFO:teuthology.orchestra.run.smithi204.stdout:checking for atomic64_t support in liburcu... yes 2024-02-18T10:05:42.683 INFO:teuthology.orchestra.run.smithi204.stdout:configure: creating ./config.status 2024-02-18T10:05:43.868 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/builddefs 2024-02-18T10:05:43.905 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/platform_defs.h 2024-02-18T10:05:43.936 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: executing libtool commands 2024-02-18T10:05:44.060 INFO:teuthology.orchestra.run.smithi204.stdout: [HEADERS] include 2024-02-18T10:05:44.084 INFO:teuthology.orchestra.run.smithi204.stdout: [HEADERS] libxfs 2024-02-18T10:05:44.125 INFO:teuthology.orchestra.run.smithi204.stdout:Building include 2024-02-18T10:05:44.139 INFO:teuthology.orchestra.run.smithi204.stdout: [LN] disk 2024-02-18T10:05:44.145 INFO:teuthology.orchestra.run.smithi204.stdout:Building libfrog 2024-02-18T10:05:44.155 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] gen_crc32table 2024-02-18T10:05:44.247 INFO:teuthology.orchestra.run.smithi204.stdout: [GENERATE] crc32table.h 2024-02-18T10:05:44.986 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] avl64.lo 2024-02-18T10:05:45.707 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bitmap.lo 2024-02-18T10:05:46.274 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat.lo 2024-02-18T10:05:46.880 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] convert.lo 2024-02-18T10:05:47.451 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] crc32.lo 2024-02-18T10:05:47.880 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsgeom.lo 2024-02-18T10:05:48.441 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] list_sort.lo 2024-02-18T10:05:48.894 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] linux.lo 2024-02-18T10:05:49.431 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logging.lo 2024-02-18T10:05:49.805 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] paths.lo 2024-02-18T10:05:50.474 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] projects.lo 2024-02-18T10:05:51.018 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] ptvar.lo 2024-02-18T10:05:51.505 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] radix-tree.lo 2024-02-18T10:05:52.284 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] randbytes.lo 2024-02-18T10:05:52.696 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scrub.lo 2024-02-18T10:05:53.112 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.lo 2024-02-18T10:05:53.530 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] workqueue.lo 2024-02-18T10:05:54.021 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libfrog.la 2024-02-18T10:05:54.237 INFO:teuthology.orchestra.run.smithi204.stdout:Building libxfs 2024-02-18T10:05:56.511 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] cache.lo 2024-02-18T10:05:57.290 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] defer_item.lo 2024-02-18T10:05:57.976 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.lo 2024-02-18T10:05:58.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:05:58.563 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:05:58.565 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:05:58.872 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] kmem.lo 2024-02-18T10:05:59.381 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logitem.lo 2024-02-18T10:05:59.947 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rdwr.lo 2024-02-18T10:06:01.095 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] topology.lo 2024-02-18T10:06:01.679 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] trans.lo 2024-02-18T10:06:02.456 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.lo 2024-02-18T10:06:03.267 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ag.lo 2024-02-18T10:06:04.369 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ag_resv.lo 2024-02-18T10:06:04.976 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_alloc.lo 2024-02-18T10:06:06.771 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_alloc_btree.lo 2024-02-18T10:06:07.509 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_attr.lo 2024-02-18T10:06:08.392 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_attr_leaf.lo 2024-02-18T10:06:10.065 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_attr_remote.lo 2024-02-18T10:06:10.836 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_bit.lo 2024-02-18T10:06:11.352 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_bmap.lo 2024-02-18T10:06:14.457 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_bmap_btree.lo 2024-02-18T10:06:15.285 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_btree.lo 2024-02-18T10:06:17.795 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_btree_staging.lo 2024-02-18T10:06:18.515 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_da_btree.lo 2024-02-18T10:06:20.109 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_defer.lo 2024-02-18T10:06:20.851 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2.lo 2024-02-18T10:06:21.601 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_block.lo 2024-02-18T10:06:22.737 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_data.lo 2024-02-18T10:06:23.771 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_leaf.lo 2024-02-18T10:06:24.972 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_node.lo 2024-02-18T10:06:26.304 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_sf.lo 2024-02-18T10:06:27.357 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dquot_buf.lo 2024-02-18T10:06:28.003 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ialloc.lo 2024-02-18T10:06:28.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:06:28.704 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:06:28.707 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:06:29.648 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_iext_tree.lo 2024-02-18T10:06:30.653 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_inode_buf.lo 2024-02-18T10:06:31.567 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_inode_fork.lo 2024-02-18T10:06:32.445 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ialloc_btree.lo 2024-02-18T10:06:33.271 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_log_rlimit.lo 2024-02-18T10:06:33.833 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_refcount.lo 2024-02-18T10:06:34.939 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_refcount_btree.lo 2024-02-18T10:06:35.633 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rmap.lo 2024-02-18T10:06:37.145 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rmap_btree.lo 2024-02-18T10:06:37.944 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rtbitmap.lo 2024-02-18T10:06:38.820 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_sb.lo 2024-02-18T10:06:39.886 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_symlink_remote.lo 2024-02-18T10:06:40.449 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_trans_inode.lo 2024-02-18T10:06:40.998 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_trans_resv.lo 2024-02-18T10:06:41.847 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_types.lo 2024-02-18T10:06:42.486 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libxfs.la 2024-02-18T10:06:42.813 INFO:teuthology.orchestra.run.smithi204.stdout:Building libxlog 2024-02-18T10:06:42.943 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_log_recover.lo 2024-02-18T10:06:44.055 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.lo 2024-02-18T10:06:44.661 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libxlog.la 2024-02-18T10:06:44.851 INFO:teuthology.orchestra.run.smithi204.stdout:Building libxcmd 2024-02-18T10:06:45.046 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] command.lo 2024-02-18T10:06:45.638 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] input.lo 2024-02-18T10:06:46.147 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] help.lo 2024-02-18T10:06:46.628 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quit.lo 2024-02-18T10:06:47.079 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libxcmd.la 2024-02-18T10:06:47.260 INFO:teuthology.orchestra.run.smithi204.stdout:Building libhandle 2024-02-18T10:06:47.372 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] handle.lo 2024-02-18T10:06:48.021 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] jdm.lo 2024-02-18T10:06:48.523 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libhandle.la 2024-02-18T10:06:48.786 INFO:teuthology.orchestra.run.smithi204.stdout:Building copy 2024-02-18T10:06:48.866 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_copy.o 2024-02-18T10:06:49.374 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_copy 2024-02-18T10:06:49.633 INFO:teuthology.orchestra.run.smithi204.stdout:Building db 2024-02-18T10:06:52.413 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] addr.o 2024-02-18T10:06:52.566 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agf.o 2024-02-18T10:06:52.709 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agfl.o 2024-02-18T10:06:52.852 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agi.o 2024-02-18T10:06:52.997 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr.o 2024-02-18T10:06:53.252 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attrshort.o 2024-02-18T10:06:53.416 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bit.o 2024-02-18T10:06:53.585 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] block.o 2024-02-18T10:06:53.778 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmap.o 2024-02-18T10:06:54.031 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btblock.o 2024-02-18T10:06:54.208 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmroot.o 2024-02-18T10:06:54.419 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] check.o 2024-02-18T10:06:56.338 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] command.o 2024-02-18T10:06:56.491 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] crc.o 2024-02-18T10:06:56.648 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] debug.o 2024-02-18T10:06:56.777 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dir2.o 2024-02-18T10:06:57.131 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dir2sf.o 2024-02-18T10:06:57.319 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dquot.o 2024-02-18T10:06:57.477 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] echo.o 2024-02-18T10:06:57.608 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] faddr.o 2024-02-18T10:06:57.835 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] field.o 2024-02-18T10:06:57.992 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] flist.o 2024-02-18T10:06:58.279 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fprint.o 2024-02-18T10:06:58.489 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] frag.o 2024-02-18T10:06:58.785 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] freesp.o 2024-02-18T10:06:58.844 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:06:58.847 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:06:58.850 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:06:59.037 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] hash.o 2024-02-18T10:06:59.248 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] help.o 2024-02-18T10:06:59.384 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2024-02-18T10:06:59.553 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] inode.o 2024-02-18T10:06:59.892 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] input.o 2024-02-18T10:07:00.062 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] io.o 2024-02-18T10:07:00.314 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logformat.o 2024-02-18T10:07:00.475 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] malloc.o 2024-02-18T10:07:00.610 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] metadump.o 2024-02-18T10:07:01.515 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] output.o 2024-02-18T10:07:01.647 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] print.o 2024-02-18T10:07:01.834 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quit.o 2024-02-18T10:07:01.956 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sb.o 2024-02-18T10:07:02.263 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sig.o 2024-02-18T10:07:02.390 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] strvec.o 2024-02-18T10:07:02.531 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] text.o 2024-02-18T10:07:02.668 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] type.o 2024-02-18T10:07:02.833 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] write.o 2024-02-18T10:07:03.099 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attrset.o 2024-02-18T10:07:03.265 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] symlink.o 2024-02-18T10:07:03.401 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsmap.o 2024-02-18T10:07:03.552 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fuzz.o 2024-02-18T10:07:03.765 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] obfuscate.o 2024-02-18T10:07:03.948 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btdump.o 2024-02-18T10:07:04.174 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btheight.o 2024-02-18T10:07:04.378 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] convert.o 2024-02-18T10:07:04.557 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] info.o 2024-02-18T10:07:04.699 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] iunlink.o 2024-02-18T10:07:04.925 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] namei.o 2024-02-18T10:07:05.186 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] timelimit.o 2024-02-18T10:07:05.337 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_db 2024-02-18T10:07:05.659 INFO:teuthology.orchestra.run.smithi204.stdout:Building estimate 2024-02-18T10:07:05.733 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_estimate.o 2024-02-18T10:07:05.911 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_estimate 2024-02-18T10:07:06.035 INFO:teuthology.orchestra.run.smithi204.stdout:Building fsck 2024-02-18T10:07:06.045 INFO:teuthology.orchestra.run.smithi204.stdout:Building fsr 2024-02-18T10:07:06.127 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_fsr.o 2024-02-18T10:07:06.612 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_fsr 2024-02-18T10:07:06.777 INFO:teuthology.orchestra.run.smithi204.stdout:Building growfs 2024-02-18T10:07:06.854 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_growfs.o 2024-02-18T10:07:07.079 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_growfs 2024-02-18T10:07:07.327 INFO:teuthology.orchestra.run.smithi204.stdout:Building io 2024-02-18T10:07:09.228 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2024-02-18T10:07:09.370 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr.o 2024-02-18T10:07:09.542 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmap.o 2024-02-18T10:07:09.751 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat.o 2024-02-18T10:07:09.946 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] crc32cselftest.o 2024-02-18T10:07:10.052 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] cowextsize.o 2024-02-18T10:07:10.188 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] encrypt.o 2024-02-18T10:07:10.446 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] file.o 2024-02-18T10:07:10.575 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] freeze.o 2024-02-18T10:07:10.682 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsuuid.o 2024-02-18T10:07:10.814 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsync.o 2024-02-18T10:07:10.912 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] getrusage.o 2024-02-18T10:07:11.027 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] imap.o 2024-02-18T10:07:11.136 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] inject.o 2024-02-18T10:07:11.256 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] label.o 2024-02-18T10:07:11.395 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] link.o 2024-02-18T10:07:11.497 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmap.o 2024-02-18T10:07:11.738 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] open.o 2024-02-18T10:07:12.062 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] parent.o 2024-02-18T10:07:12.243 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pread.o 2024-02-18T10:07:12.451 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] prealloc.o 2024-02-18T10:07:12.620 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pwrite.o 2024-02-18T10:07:12.811 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] reflink.o 2024-02-18T10:07:12.966 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] resblks.o 2024-02-18T10:07:13.068 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scrub.o 2024-02-18T10:07:13.222 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] seek.o 2024-02-18T10:07:13.354 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] shutdown.o 2024-02-18T10:07:13.454 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] stat.o 2024-02-18T10:07:13.684 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] swapext.o 2024-02-18T10:07:13.792 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sync.o 2024-02-18T10:07:13.891 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] truncate.o 2024-02-18T10:07:13.988 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] utimes.o 2024-02-18T10:07:14.091 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fadvise.o 2024-02-18T10:07:14.199 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] madvise.o 2024-02-18T10:07:14.312 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mincore.o 2024-02-18T10:07:14.425 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sendfile.o 2024-02-18T10:07:14.549 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fiemap.o 2024-02-18T10:07:14.727 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] copy_file_range.o 2024-02-18T10:07:14.852 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sync_file_range.o 2024-02-18T10:07:14.962 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] readdir.o 2024-02-18T10:07:15.087 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_writes.o 2024-02-18T10:07:15.196 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsmap.o 2024-02-18T10:07:15.462 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_io 2024-02-18T10:07:15.721 INFO:teuthology.orchestra.run.smithi204.stdout:Building logprint 2024-02-18T10:07:16.100 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logprint.o 2024-02-18T10:07:16.267 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_copy.o 2024-02-18T10:07:16.407 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_dump.o 2024-02-18T10:07:16.557 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_misc.o 2024-02-18T10:07:17.113 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_print_all.o 2024-02-18T10:07:17.401 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_print_trans.o 2024-02-18T10:07:17.548 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_redo.o 2024-02-18T10:07:17.850 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_logprint 2024-02-18T10:07:18.104 INFO:teuthology.orchestra.run.smithi204.stdout:Building mkfs 2024-02-18T10:07:18.231 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] proto.o 2024-02-18T10:07:18.556 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_mkfs.o 2024-02-18T10:07:19.298 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] mkfs.xfs 2024-02-18T10:07:19.551 INFO:teuthology.orchestra.run.smithi204.stdout:Building quota 2024-02-18T10:07:20.047 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2024-02-18T10:07:20.176 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.o 2024-02-18T10:07:20.371 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] edit.o 2024-02-18T10:07:20.602 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] free.o 2024-02-18T10:07:20.778 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] linux.o 2024-02-18T10:07:20.876 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] path.o 2024-02-18T10:07:21.009 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] project.o 2024-02-18T10:07:21.172 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quot.o 2024-02-18T10:07:21.350 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quota.o 2024-02-18T10:07:21.549 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] report.o 2024-02-18T10:07:21.814 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] state.o 2024-02-18T10:07:22.023 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_quota 2024-02-18T10:07:22.208 INFO:teuthology.orchestra.run.smithi204.stdout:Building mdrestore 2024-02-18T10:07:22.282 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_mdrestore.o 2024-02-18T10:07:22.538 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_mdrestore 2024-02-18T10:07:22.753 INFO:teuthology.orchestra.run.smithi204.stdout:Building repair 2024-02-18T10:07:24.537 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agheader.o 2024-02-18T10:07:24.796 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agbtree.o 2024-02-18T10:07:25.083 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr_repair.o 2024-02-18T10:07:25.488 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] avl.o 2024-02-18T10:07:25.743 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkload.o 2024-02-18T10:07:25.884 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmap.o 2024-02-18T10:07:26.058 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btree.o 2024-02-18T10:07:26.453 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] da_util.o 2024-02-18T10:07:26.697 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dino_chunks.o 2024-02-18T10:07:27.097 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dinode.o 2024-02-18T10:07:27.863 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dir2.o 2024-02-18T10:07:28.336 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] globals.o 2024-02-18T10:07:28.448 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore_bmc.o 2024-02-18T10:07:28.573 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore.o 2024-02-18T10:07:28.747 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore_ext.o 2024-02-18T10:07:28.986 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:07:28.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:07:28.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:07:29.009 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore_ino.o 2024-02-18T10:07:29.303 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2024-02-18T10:07:29.468 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase1.o 2024-02-18T10:07:29.623 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase2.o 2024-02-18T10:07:29.841 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase3.o 2024-02-18T10:07:30.012 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase4.o 2024-02-18T10:07:30.235 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase5.o 2024-02-18T10:07:30.538 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase6.o 2024-02-18T10:07:31.452 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase7.o 2024-02-18T10:07:31.605 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] prefetch.o 2024-02-18T10:07:31.974 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] progress.o 2024-02-18T10:07:32.204 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quotacheck.o 2024-02-18T10:07:32.440 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rmap.o 2024-02-18T10:07:32.888 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rt.o 2024-02-18T10:07:33.069 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sb.o 2024-02-18T10:07:33.334 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scan.o 2024-02-18T10:07:34.139 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] slab.o 2024-02-18T10:07:34.324 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] threads.o 2024-02-18T10:07:34.461 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] versions.o 2024-02-18T10:07:34.614 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_repair.o 2024-02-18T10:07:34.973 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_repair 2024-02-18T10:07:35.307 INFO:teuthology.orchestra.run.smithi204.stdout:Building rtcp 2024-02-18T10:07:35.380 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rtcp.o 2024-02-18T10:07:35.585 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_rtcp 2024-02-18T10:07:35.729 INFO:teuthology.orchestra.run.smithi204.stdout:Building m4 2024-02-18T10:07:35.739 INFO:teuthology.orchestra.run.smithi204.stdout:Building man 2024-02-18T10:07:35.753 INFO:teuthology.orchestra.run.smithi204.stdout:Building man2 2024-02-18T10:07:35.770 INFO:teuthology.orchestra.run.smithi204.stdout:Building man3 2024-02-18T10:07:35.784 INFO:teuthology.orchestra.run.smithi204.stdout:Building man5 2024-02-18T10:07:35.799 INFO:teuthology.orchestra.run.smithi204.stdout:Building man8 2024-02-18T10:07:35.828 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] mkfs.xfs.8 2024-02-18T10:07:35.839 INFO:teuthology.orchestra.run.smithi204.stdout:Building doc 2024-02-18T10:07:35.854 INFO:teuthology.orchestra.run.smithi204.stdout: [ZIP] CHANGES.gz 2024-02-18T10:07:35.874 INFO:teuthology.orchestra.run.smithi204.stdout:Building debian 2024-02-18T10:07:35.884 INFO:teuthology.orchestra.run.smithi204.stdout:Building spaceman 2024-02-18T10:07:36.255 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] info.o 2024-02-18T10:07:36.389 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2024-02-18T10:07:36.540 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] file.o 2024-02-18T10:07:36.692 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] health.o 2024-02-18T10:07:36.889 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] prealloc.o 2024-02-18T10:07:37.035 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] trim.o 2024-02-18T10:07:37.187 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] freesp.o 2024-02-18T10:07:37.406 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_spaceman 2024-02-18T10:07:37.591 INFO:teuthology.orchestra.run.smithi204.stdout:Building scrub 2024-02-18T10:07:38.568 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] common.o 2024-02-18T10:07:38.739 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] counter.o 2024-02-18T10:07:38.829 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] descr.o 2024-02-18T10:07:38.934 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] disk.o 2024-02-18T10:07:39.082 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] filemap.o 2024-02-18T10:07:39.201 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fscounters.o 2024-02-18T10:07:39.328 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] inodes.o 2024-02-18T10:07:39.506 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase1.o 2024-02-18T10:07:39.649 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase2.o 2024-02-18T10:07:39.780 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase3.o 2024-02-18T10:07:39.927 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase4.o 2024-02-18T10:07:40.055 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase5.o 2024-02-18T10:07:40.229 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase6.o 2024-02-18T10:07:40.452 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase7.o 2024-02-18T10:07:40.599 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] progress.o 2024-02-18T10:07:40.734 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] read_verify.o 2024-02-18T10:07:40.889 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] repair.o 2024-02-18T10:07:41.047 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scrub.o 2024-02-18T10:07:41.297 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] spacemap.o 2024-02-18T10:07:41.443 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] vfs.o 2024-02-18T10:07:41.593 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_scrub.o 2024-02-18T10:07:41.824 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] unicrash.o 2024-02-18T10:07:42.039 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_scrub 2024-02-18T10:07:42.388 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_all 2024-02-18T10:07:42.401 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_fail 2024-02-18T10:07:42.414 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub@.service 2024-02-18T10:07:42.425 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_all.service 2024-02-18T10:07:42.437 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_fail@.service 2024-02-18T10:07:42.448 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_all.cron 2024-02-18T10:07:42.459 INFO:teuthology.orchestra.run.smithi204.stdout:Building po 2024-02-18T10:07:42.502 INFO:teuthology.orchestra.run.smithi204.stdout: [GETTXT] xfsprogs.pot 2024-02-18T10:07:42.763 INFO:teuthology.orchestra.run.smithi204.stdout: [MSGFMT] de.mo 2024-02-18T10:07:42.808 INFO:teuthology.orchestra.run.smithi204.stderr:2345 translated messages. 2024-02-18T10:07:42.811 INFO:teuthology.orchestra.run.smithi204.stdout: [MSGFMT] pl.mo 2024-02-18T10:07:42.862 INFO:teuthology.orchestra.run.smithi204.stderr:3139 translated messages. 2024-02-18T10:07:42.864 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[2]: Nothing to be done for 'include'. 2024-02-18T10:07:42.870 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.qNdAS3jX7mxfsprogs-dev && exec sudo make install) 2024-02-18T10:07:42.981 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libfrog-install 2024-02-18T10:07:43.597 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libxfs-install 2024-02-18T10:07:45.860 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2024-02-18T10:07:45.895 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libxlog-install 2024-02-18T10:07:46.009 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libxcmd-install 2024-02-18T10:07:46.185 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libhandle-install 2024-02-18T10:07:46.281 INFO:teuthology.orchestra.run.smithi204.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2024-02-18T10:07:46.392 INFO:teuthology.orchestra.run.smithi204.stdout:Installing copy-install 2024-02-18T10:07:46.462 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:46.491 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2024-02-18T10:07:46.564 INFO:teuthology.orchestra.run.smithi204.stdout:Installing db-install 2024-02-18T10:07:49.343 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:49.374 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2024-02-18T10:07:49.453 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2024-02-18T10:07:49.483 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2024-02-18T10:07:49.516 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2024-02-18T10:07:49.550 INFO:teuthology.orchestra.run.smithi204.stdout:Installing estimate-install 2024-02-18T10:07:49.621 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:49.652 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2024-02-18T10:07:49.722 INFO:teuthology.orchestra.run.smithi204.stdout:Installing fsck-install 2024-02-18T10:07:49.725 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-02-18T10:07:49.757 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2024-02-18T10:07:49.793 INFO:teuthology.orchestra.run.smithi204.stdout:Installing fsr-install 2024-02-18T10:07:49.865 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:49.896 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2024-02-18T10:07:49.966 INFO:teuthology.orchestra.run.smithi204.stdout:Installing growfs-install 2024-02-18T10:07:50.036 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:50.067 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2024-02-18T10:07:50.144 INFO:teuthology.orchestra.run.smithi204.stdout:Installing io-install 2024-02-18T10:07:52.001 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:52.032 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2024-02-18T10:07:52.104 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2024-02-18T10:07:52.164 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2024-02-18T10:07:52.227 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2024-02-18T10:07:52.291 INFO:teuthology.orchestra.run.smithi204.stdout:Installing logprint-install 2024-02-18T10:07:52.666 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:52.700 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2024-02-18T10:07:52.778 INFO:teuthology.orchestra.run.smithi204.stdout:Installing mkfs-install 2024-02-18T10:07:52.901 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-02-18T10:07:52.934 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2024-02-18T10:07:53.009 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2024-02-18T10:07:53.040 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2024-02-18T10:07:53.132 INFO:teuthology.orchestra.run.smithi204.stdout:Installing quota-install 2024-02-18T10:07:53.638 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:53.670 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2024-02-18T10:07:53.742 INFO:teuthology.orchestra.run.smithi204.stdout:Installing mdrestore-install 2024-02-18T10:07:53.813 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:53.844 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2024-02-18T10:07:53.921 INFO:teuthology.orchestra.run.smithi204.stdout:Installing repair-install 2024-02-18T10:07:55.721 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /sbin 2024-02-18T10:07:55.752 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2024-02-18T10:07:55.840 INFO:teuthology.orchestra.run.smithi204.stdout:Installing rtcp-install 2024-02-18T10:07:55.910 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:55.942 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2024-02-18T10:07:56.013 INFO:teuthology.orchestra.run.smithi204.stdout:Installing m4-install 2024-02-18T10:07:56.017 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-18T10:07:56.020 INFO:teuthology.orchestra.run.smithi204.stdout:Installing man-install 2024-02-18T10:07:56.032 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[2]: Nothing to be done for 'install'. 2024-02-18T10:07:56.039 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[2]: Nothing to be done for 'install'. 2024-02-18T10:07:56.051 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2024-02-18T10:07:56.091 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2024-02-18T10:07:56.128 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2024-02-18T10:07:56.165 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2024-02-18T10:07:56.211 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2024-02-18T10:07:56.251 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2024-02-18T10:07:56.282 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2024-02-18T10:07:56.316 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2024-02-18T10:07:56.353 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2024-02-18T10:07:56.391 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2024-02-18T10:07:56.430 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2024-02-18T10:07:56.470 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2024-02-18T10:07:56.509 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2024-02-18T10:07:56.549 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2024-02-18T10:07:56.589 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2024-02-18T10:07:56.629 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2024-02-18T10:07:56.669 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2024-02-18T10:07:56.710 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2024-02-18T10:07:56.750 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2024-02-18T10:07:56.789 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2024-02-18T10:07:56.830 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2024-02-18T10:07:56.868 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2024-02-18T10:07:56.908 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2024-02-18T10:07:56.948 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2024-02-18T10:07:56.986 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2024-02-18T10:07:57.025 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2024-02-18T10:07:57.065 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2024-02-18T10:07:57.104 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2024-02-18T10:07:57.143 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2024-02-18T10:07:57.177 INFO:teuthology.orchestra.run.smithi204.stdout:Installing doc-install 2024-02-18T10:07:57.183 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2024-02-18T10:07:57.213 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2024-02-18T10:07:57.255 INFO:teuthology.orchestra.run.smithi204.stdout:Installing debian-install 2024-02-18T10:07:57.259 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2024-02-18T10:07:57.262 INFO:teuthology.orchestra.run.smithi204.stdout:Installing spaceman-install 2024-02-18T10:07:57.629 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:57.661 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2024-02-18T10:07:57.732 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2024-02-18T10:07:57.767 INFO:teuthology.orchestra.run.smithi204.stdout:Installing scrub-install 2024-02-18T10:07:58.739 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2024-02-18T10:07:58.772 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2024-02-18T10:07:58.845 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2024-02-18T10:07:58.877 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2024-02-18T10:07:58.907 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2024-02-18T10:07:58.967 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/libexec/xfsprogs 2024-02-18T10:07:58.999 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/libexec/xfsprogs 2024-02-18T10:07:59.032 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs 2024-02-18T10:07:59.063 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/share/xfsprogs 2024-02-18T10:07:59.095 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/udev/rules.d 2024-02-18T10:07:59.126 INFO:teuthology.orchestra.run.smithi204.stdout:for i in xfs.rules; do \ 2024-02-18T10:07:59.127 INFO:teuthology.orchestra.run.smithi204.stdout: ../install-sh -o root -g root -m 644 $i /usr/lib/udev/rules.d/64-$i; \ 2024-02-18T10:07:59.127 INFO:teuthology.orchestra.run.smithi204.stdout:done 2024-02-18T10:07:59.133 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:07:59.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:07:59.139 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:07:59.167 INFO:teuthology.orchestra.run.smithi204.stdout:Installing po-install 2024-02-18T10:07:59.302 INFO:teuthology.orchestra.run.smithi204.stdout:Installing include-install 2024-02-18T10:07:59.306 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2024-02-18T10:07:59.338 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2024-02-18T10:07:59.369 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2024-02-18T10:07:59.407 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-02-18T10:07:59.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.514+0000 7fa3551f4640 1 Processor -- start 2024-02-18T10:07:59.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.514+0000 7fa3551f4640 1 -- start start 2024-02-18T10:07:59.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.514+0000 7fa3551f4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa3500bb6c0 0x7fa3500728a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.514+0000 7fa3551f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bc740 0x7fa350072de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.514+0000 7fa3551f4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3500b9c90 con 0x7fa3500bd1d0 2024-02-18T10:07:59.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.514+0000 7fa3551f4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3500b8880 con 0x7fa3500bb6c0 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.514+0000 7fa3551f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35014c510 con 0x7fa3500bc740 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34f59e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bc740 0x7fa350072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34e59c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa3500bb6c0 0x7fa3500728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34ed9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa3500bd1d0 0x7fa35014be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:59938/0 (socket says 172.21.15.118:59938) 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34ed9d640 1 -- 172.21.15.118:0/2896102341 learned_addr learned my addr 172.21.15.118:0/2896102341 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34f59e640 1 -- 172.21.15.118:0/2896102341 >> v2:172.21.15.164:3300/0 conn(0x7fa3500bb6c0 msgr2=0x7fa3500728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34f59e640 1 --2- 172.21.15.118:0/2896102341 >> v2:172.21.15.164:3300/0 conn(0x7fa3500bb6c0 0x7fa3500728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34f59e640 1 -- 172.21.15.118:0/2896102341 >> v1:172.21.15.164:6789/0 conn(0x7fa3500bd1d0 legacy=0x7fa35014be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34f59e640 1 -- 172.21.15.118:0/2896102341 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35009ce50 con 0x7fa3500bc740 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.515+0000 7fa34e59c640 1 --2- 172.21.15.118:0/2896102341 >> v2:172.21.15.164:3300/0 conn(0x7fa3500bb6c0 0x7fa3500728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa34f59e640 1 --2- 172.21.15.118:0/2896102341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bc740 0x7fa350072de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa340009d90 tx=0x7fa34002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f52250996b334ac server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:07:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa34dd9b640 1 -- 172.21.15.118:0/2896102341 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34002cce0 con 0x7fa3500bc740 2024-02-18T10:07:59.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa34dd9b640 1 -- 172.21.15.118:0/2896102341 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34002ce40 con 0x7fa3500bc740 2024-02-18T10:07:59.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa34dd9b640 1 -- 172.21.15.118:0/2896102341 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340034660 con 0x7fa3500bc740 2024-02-18T10:07:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa3551f4640 1 -- 172.21.15.118:0/2896102341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bc740 msgr2=0x7fa350072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa3551f4640 1 --2- 172.21.15.118:0/2896102341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bc740 0x7fa350072de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa340009d90 tx=0x7fa34002bf30 comp rx=0 tx=0).stop 2024-02-18T10:07:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa3551f4640 1 -- 172.21.15.118:0/2896102341 shutdown_connections 2024-02-18T10:07:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa3551f4640 1 --2- 172.21.15.118:0/2896102341 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bc740 0x7fa350072de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa3551f4640 1 --2- 172.21.15.118:0/2896102341 >> v2:172.21.15.164:3300/0 conn(0x7fa3500bb6c0 0x7fa3500728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.516+0000 7fa3551f4640 1 -- 172.21.15.118:0/2896102341 >> 172.21.15.118:0/2896102341 conn(0x7fa3500ba3c0 msgr2=0x7fa3500ba7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.517+0000 7fa3551f4640 1 -- 172.21.15.118:0/2896102341 shutdown_connections 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.517+0000 7fa3551f4640 1 -- 172.21.15.118:0/2896102341 wait complete. 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.518+0000 7fa3551f4640 1 Processor -- start 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.518+0000 7fa3551f4640 1 -- start start 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3551f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bb6c0 0x7fa350146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3551f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3500bc740 0x7fa3501e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3551f4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3500bd1d0 0x7fa350141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3551f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa350147400 con 0x7fa3500bc740 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3551f4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa350142e40 con 0x7fa3500bd1d0 2024-02-18T10:07:59.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3551f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35009cc20 con 0x7fa3500bb6c0 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3500bc740 0x7fa3501e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3500bc740 0x7fa3501e4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52924/0 (socket says 172.21.15.118:52924) 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 -- 172.21.15.118:0/40254024 learned_addr learned my addr 172.21.15.118:0/40254024 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34f59e640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3500bd1d0 0x7fa350141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34ed9d640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bb6c0 0x7fa350146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 -- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bb6c0 msgr2=0x7fa350146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bb6c0 0x7fa350146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 -- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3500bd1d0 msgr2=0x7fa350141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3500bd1d0 0x7fa350141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 -- 172.21.15.118:0/40254024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344009400 con 0x7fa3500bc740 2024-02-18T10:07:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa34e59c640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3500bc740 0x7fa3501e4f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa34400ebb0 tx=0x7fa34400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3377fe640 1 -- 172.21.15.118:0/40254024 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400eeb0 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3377fe640 1 -- 172.21.15.118:0/40254024 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34400cc30 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa340009a70 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.519+0000 7fa3377fe640 1 -- 172.21.15.118:0/40254024 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344013470 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.520+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3500a23e0 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.520+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3500a0730 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.521+0000 7fa3377fe640 1 -- 172.21.15.118:0/40254024 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fa3440135d0 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.521+0000 7fa3377fe640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa33c06bc70 0x7fa33c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.521+0000 7fa3377fe640 1 -- 172.21.15.118:0/40254024 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa34408aa40 con 0x7fa3500bc740 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.521+0000 7fa34ed9d640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa33c06bc70 0x7fa33c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.522+0000 7fa34ed9d640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa33c06bc70 0x7fa33c06e130 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa348007fd0 tx=0x7fa348007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:07:59.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.526+0000 7fa3377fe640 1 -- 172.21.15.118:0/40254024 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa34408ce60 con 0x7fa3500bc740 2024-02-18T10:07:59.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.765+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa350074af0 con 0x7fa3500bc740 2024-02-18T10:07:59.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.766+0000 7fa3377fe640 1 -- 172.21.15.118:0/40254024 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1289 (secure 0 0 0) 0x7fa344055250 con 0x7fa3500bc740 2024-02-18T10:07:59.769 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T10:07:59.769 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":1,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","modified":"2024-02-18T09:59:58.838685Z","created":"2024-02-18T09:59:58.838685Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3301","nonce":0},{"type":"v1","addr":"172.21.15.164:6790","nonce":0}]},"addr":"172.21.15.164:6790/0","public_addr":"172.21.15.164:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-18T10:07:59.769 INFO:teuthology.orchestra.run.smithi118.stderr:dumped monmap epoch 1 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa33c06bc70 msgr2=0x7fa33c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa33c06bc70 0x7fa33c06e130 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa348007fd0 tx=0x7fa348007e80 comp rx=0 tx=0).stop 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3500bc740 msgr2=0x7fa3501e4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3500bc740 0x7fa3501e4f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa34400ebb0 tx=0x7fa34400c520 comp rx=0 tx=0).stop 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 shutdown_connections 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa33c06bc70 0x7fa33c06e130 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa3500bd1d0 0x7fa350141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3500bc740 0x7fa3501e4f30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.771 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 --2- 172.21.15.118:0/40254024 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3500bb6c0 0x7fa350146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 >> 172.21.15.118:0/40254024 conn(0x7fa3500ba3c0 msgr2=0x7fa350070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:07:59.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 shutdown_connections 2024-02-18T10:07:59.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.768+0000 7fa3551f4640 1 -- 172.21.15.118:0/40254024 wait complete. 2024-02-18T10:07:59.781 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-02-18T10:07:59.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.879+0000 7f87c6ac9640 1 Processor -- start 2024-02-18T10:07:59.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.879+0000 7f87c6ac9640 1 -- start start 2024-02-18T10:07:59.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c6ac9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c00b9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c6ac9640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87c00ba800 0x7f87c00b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c6ac9640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0146330 con 0x7f87c0145f50 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c6ac9640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00721a0 con 0x7f87c00ba800 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c6ac9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00ba090 con 0x7f87c00b51d0 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c5066640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87c00ba800 0x7f87c00b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c5066640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87c00ba800 0x7f87c00b9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52940/0 (socket says 172.21.15.118:52940) 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c5066640 1 -- 172.21.15.118:0/2208341164 learned_addr learned my addr 172.21.15.118:0/2208341164 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c5066640 1 -- 172.21.15.118:0/2208341164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 msgr2=0x7f87c00b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c5066640 1 --2- 172.21.15.118:0/2208341164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c00b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c5066640 1 -- 172.21.15.118:0/2208341164 >> v1:172.21.15.164:6789/0 conn(0x7f87c0145f50 legacy=0x7f87c006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.880+0000 7f87c5066640 1 -- 172.21.15.118:0/2208341164 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c006b2f0 con 0x7f87c00ba800 2024-02-18T10:07:59.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.881+0000 7f87c5066640 1 --2- 172.21.15.118:0/2208341164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c00ba800 0x7f87c00b9b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009e50 tx=0x7f87b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd73b00cf68ffe9 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:07:59.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.881+0000 7f87bf7fe640 1 -- 172.21.15.118:0/2208341164 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b802ca70 con 0x7f87c00ba800 2024-02-18T10:07:59.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.881+0000 7f87bf7fe640 1 -- 172.21.15.118:0/2208341164 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b802cbd0 con 0x7f87c00ba800 2024-02-18T10:07:59.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.881+0000 7f87bf7fe640 1 -- 172.21.15.118:0/2208341164 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80343f0 con 0x7f87c00ba800 2024-02-18T10:07:59.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 -- 172.21.15.118:0/2208341164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c00ba800 msgr2=0x7f87c00b9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/2208341164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c00ba800 0x7f87c00b9b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009e50 tx=0x7f87b802bed0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 -- 172.21.15.118:0/2208341164 shutdown_connections 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/2208341164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c00ba800 0x7f87c00b9b50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/2208341164 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c00b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 -- 172.21.15.118:0/2208341164 >> 172.21.15.118:0/2208341164 conn(0x7f87c00be630 msgr2=0x7f87c00bea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 -- 172.21.15.118:0/2208341164 shutdown_connections 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.882+0000 7f87c6ac9640 1 -- 172.21.15.118:0/2208341164 wait complete. 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.883+0000 7f87c6ac9640 1 Processor -- start 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.883+0000 7f87c6ac9640 1 -- start start 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.883+0000 7f87c6ac9640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c0148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.883+0000 7f87c6ac9640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87c00ba800 0x7f87c00a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.883+0000 7f87c6ac9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c0145f50 0x7f87c01479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c6ac9640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01491e0 con 0x7f87c0145f50 2024-02-18T10:07:59.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c6ac9640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0147530 con 0x7f87c00ba800 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c6ac9640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01483f0 con 0x7f87c00b51d0 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c0145f50 0x7f87c01479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c0145f50 0x7f87c01479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52952/0 (socket says 172.21.15.118:52952) 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 -- 172.21.15.118:0/3020854252 learned_addr learned my addr 172.21.15.118:0/3020854252 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87bffff640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87c00ba800 0x7f87c00a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c4865640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c0148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 -- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 msgr2=0x7f87c0148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c0148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 -- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87c00ba800 msgr2=0x7f87c00a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87c00ba800 0x7f87c00a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 -- 172.21.15.118:0/3020854252 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009b30 con 0x7f87c0145f50 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c4865640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c0148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:07:59.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87bffff640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87c00ba800 0x7f87c00a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c5066640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c0145f50 0x7f87c01479c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009f70 tx=0x7f87b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87bd7fa640 1 -- 172.21.15.118:0/3020854252 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8009510 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87bd7fa640 1 -- 172.21.15.118:0/3020854252 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b803e450 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87bd7fa640 1 -- 172.21.15.118:0/3020854252 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b803e7e0 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00a1f00 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.884+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c0146ee0 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.885+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c01476e0 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.886+0000 7f87bd7fa640 1 -- 172.21.15.118:0/3020854252 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f87b803e940 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.886+0000 7f87bd7fa640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87ac06bc70 0x7f87ac06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.886+0000 7f87c4865640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87ac06bc70 0x7f87ac06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.886+0000 7f87bd7fa640 1 -- 172.21.15.118:0/3020854252 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87b80ad5b0 con 0x7f87c0145f50 2024-02-18T10:07:59.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.886+0000 7f87c4865640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87ac06bc70 0x7f87ac06e130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f87b0006fd0 tx=0x7f87b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T10:07:59.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:07:59.890+0000 7f87bd7fa640 1 -- 172.21.15.118:0/3020854252 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87c01476e0 con 0x7f87c0145f50 2024-02-18T10:08:00.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.123+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f87c01476e0 con 0x7f87c0145f50 2024-02-18T10:08:00.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.124+0000 7f87bd7fa640 1 -- 172.21.15.118:0/3020854252 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f87c01476e0 con 0x7f87c0145f50 2024-02-18T10:08:00.126 INFO:teuthology.orchestra.run.smithi118.stdout:[client.admin] 2024-02-18T10:08:00.126 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAf1dFlF/iuDBAAjtOPYBhtZeQTg1evA2AL/Q== 2024-02-18T10:08:00.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.125+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87ac06bc70 msgr2=0x7f87ac06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:08:00.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.125+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87ac06bc70 0x7f87ac06e130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f87b0006fd0 tx=0x7f87b0008040 comp rx=0 tx=0).stop 2024-02-18T10:08:00.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.125+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c0145f50 msgr2=0x7f87c01479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T10:08:00.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.125+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c0145f50 0x7f87c01479c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009f70 tx=0x7f87b8004a40 comp rx=0 tx=0).stop 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 shutdown_connections 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f87ac06bc70 0x7f87ac06e130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87c0145f50 0x7f87c01479c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87c00ba800 0x7f87c00a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 --2- 172.21.15.118:0/3020854252 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87c00b51d0 0x7f87c0148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 >> 172.21.15.118:0/3020854252 conn(0x7f87c00be630 msgr2=0x7f87c00bea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 shutdown_connections 2024-02-18T10:08:00.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T10:08:00.126+0000 7f87c6ac9640 1 -- 172.21.15.118:0/3020854252 wait complete. 2024-02-18T10:08:00.140 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T10:08:00.140 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/tmp/tmp.pjmFjSgc0uxfstests-dev/local.config 2024-02-18T10:08:00.242 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.118:6789:/test export TEST_DIR=/tmp/tmp.QUduP9NKsItest export SCRATCH_DEV=172.21.15.118:6789:/scratch export SCRATCH_MNT=/tmp/tmp.w8GvOpYWfNscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAf1dFlF/iuDBAAjtOPYBhtZeQTg1evA2AL/Q==,test_dummy_encryption" 2024-02-18T10:08:00.243 INFO:teuthology.orchestra.run:Running command with timeout 10800 2024-02-18T10:08:00.243 DEBUG:teuthology.orchestra.run.smithi204:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.pjmFjSgc0uxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2024-02-18T10:08:02.932 INFO:teuthology.orchestra.run.smithi204.stdout:FSTYP -- ceph 2024-02-18T10:08:02.950 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM -- Linux/x86_64 smithi204 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 2024-02-18T10:08:02.951 INFO:teuthology.orchestra.run.smithi204.stdout:MKFS_OPTIONS -- 172.21.15.118:6789:/scratch 2024-02-18T10:08:02.955 INFO:teuthology.orchestra.run.smithi204.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAf1dFlF/iuDBAAjtOPYBhtZeQTg1evA2AL/Q==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.118:6789:/scratch /tmp/tmp.w8GvOpYWfNscratch 2024-02-18T10:08:02.955 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T10:08:03.158 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/001 [expunged] 2024-02-18T10:08:03.662 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:08:04.130 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:08:04.712 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/004 0s 2024-02-18T10:08:05.145 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:08:15.453 INFO:teuthology.orchestra.run.smithi204.stdout:generic/001 10s 2024-02-18T10:08:16.336 INFO:teuthology.orchestra.run.smithi204.stdout:generic/002 1s 2024-02-18T10:08:16.768 INFO:teuthology.orchestra.run.smithi204.stdout:generic/003 [not run] atime not maintained by ceph 2024-02-18T10:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-02-18T10:08:17.993 INFO:teuthology.orchestra.run.smithi204.stdout:generic/005 0s 2024-02-18T10:08:29.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:08:29.283 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:08:29.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:08:39.953 INFO:teuthology.orchestra.run.smithi204.stdout:generic/006 21s 2024-02-18T10:08:59.627 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:08:59.630 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:08:59.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:09:26.991 INFO:teuthology.orchestra.run.smithi204.stdout:generic/007 47s 2024-02-18T10:09:28.821 INFO:teuthology.orchestra.run.smithi204.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-18T10:09:29.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:09:29.767 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:09:29.770 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:09:30.923 INFO:teuthology.orchestra.run.smithi204.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-18T10:09:59.099 INFO:teuthology.orchestra.run.smithi204.stdout:generic/011 29s 2024-02-18T10:10:00.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:10:00.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:10:00.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:10:00.955 INFO:teuthology.orchestra.run.smithi204.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:10:30.231 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:10:30.234 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:10:30.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:10:36.160 INFO:teuthology.orchestra.run.smithi204.stdout:generic/013 36s 2024-02-18T10:10:36.659 INFO:teuthology.orchestra.run.smithi204.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-02-18T10:10:37.107 INFO:teuthology.orchestra.run.smithi204.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-18T10:10:39.791 INFO:teuthology.orchestra.run.smithi204.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:10:40.386 INFO:teuthology.orchestra.run.smithi204.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-02-18T10:10:49.424 INFO:teuthology.orchestra.run.smithi204.stdout:generic/020 9s 2024-02-18T10:10:52.033 INFO:teuthology.orchestra.run.smithi204.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:10:54.897 INFO:teuthology.orchestra.run.smithi204.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:10:56.864 INFO:teuthology.orchestra.run.smithi204.stdout:generic/023 2s 2024-02-18T10:10:57.322 INFO:teuthology.orchestra.run.smithi204.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-02-18T10:10:57.792 INFO:teuthology.orchestra.run.smithi204.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-02-18T10:10:58.269 INFO:teuthology.orchestra.run.smithi204.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-02-18T10:11:00.753 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:11:00.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:11:00.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:11:03.739 INFO:teuthology.orchestra.run.smithi204.stdout:generic/028 5s 2024-02-18T10:11:04.942 INFO:teuthology.orchestra.run.smithi204.stdout:generic/029 - output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/029.out.bad) 2024-02-18T10:11:04.949 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/029.out 2024-02-18 10:01:38.818993763 +0000 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/029.out.bad 2024-02-18 10:11:04.937060640 +0000 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -2,13 +2,13 @@ 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: wrote 5120/5120 bytes at offset 0 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: ==== Pre-Remount === 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: -000000 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 >XXXXXXXXXXXXXXXX< 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: * 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: 000800 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 >YYYYYYYYYYYYYYYY< 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: * 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: 001400 2024-02-18T10:11:04.950 INFO:teuthology.orchestra.run.smithi204.stdout: ==== Post-Remount == 2024-02-18T10:11:04.951 INFO:teuthology.orchestra.run.smithi204.stdout: -000000 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 >XXXXXXXXXXXXXXXX< 2024-02-18T10:11:04.951 INFO:teuthology.orchestra.run.smithi204.stdout: +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< 2024-02-18T10:11:04.951 INFO:teuthology.orchestra.run.smithi204.stdout: * 2024-02-18T10:11:04.951 INFO:teuthology.orchestra.run.smithi204.stdout: 000800 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 >YYYYYYYYYYYYYYYY< 2024-02-18T10:11:04.951 INFO:teuthology.orchestra.run.smithi204.stdout: * 2024-02-18T10:11:09.508 INFO:teuthology.orchestra.run.smithi204.stdout:generic/030 5s 2024-02-18T10:11:11.890 INFO:teuthology.orchestra.run.smithi204.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-18T10:11:12.349 INFO:teuthology.orchestra.run.smithi204.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:11:15.393 INFO:teuthology.orchestra.run.smithi204.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-18T10:11:15.869 INFO:teuthology.orchestra.run.smithi204.stdout:generic/034 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:16.458 INFO:teuthology.orchestra.run.smithi204.stdout:generic/035 1s 2024-02-18T10:11:23.408 INFO:teuthology.orchestra.run.smithi204.stdout:generic/037 7s 2024-02-18T10:11:23.912 INFO:teuthology.orchestra.run.smithi204.stdout:generic/039 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:24.384 INFO:teuthology.orchestra.run.smithi204.stdout:generic/040 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:24.875 INFO:teuthology.orchestra.run.smithi204.stdout:generic/041 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:25.490 INFO:teuthology.orchestra.run.smithi204.stdout:generic/042 [not run] ceph does not support shutdown 2024-02-18T10:11:26.102 INFO:teuthology.orchestra.run.smithi204.stdout:generic/050 [not run] ceph does not support shutdown 2024-02-18T10:11:26.748 INFO:teuthology.orchestra.run.smithi204.stdout:generic/052 [not run] ceph does not support shutdown 2024-02-18T10:11:27.890 INFO:teuthology.orchestra.run.smithi204.stdout:generic/053 1s 2024-02-18T10:11:28.438 INFO:teuthology.orchestra.run.smithi204.stdout:generic/056 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:28.923 INFO:teuthology.orchestra.run.smithi204.stdout:generic/057 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:31.020 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:11:31.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:11:31.025 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:11:31.945 INFO:teuthology.orchestra.run.smithi204.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:11:32.433 INFO:teuthology.orchestra.run.smithi204.stdout:generic/059 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:35.485 INFO:teuthology.orchestra.run.smithi204.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:11:38.321 INFO:teuthology.orchestra.run.smithi204.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:11:40.850 INFO:teuthology.orchestra.run.smithi204.stdout:generic/062 2s 2024-02-18T10:11:43.824 INFO:teuthology.orchestra.run.smithi204.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:11:44.324 INFO:teuthology.orchestra.run.smithi204.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-18T10:11:44.816 INFO:teuthology.orchestra.run.smithi204.stdout:generic/065 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:45.259 INFO:teuthology.orchestra.run.smithi204.stdout:generic/066 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:11:45.789 INFO:teuthology.orchestra.run.smithi204.stdout:generic/067 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:12:01.151 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:12:01.159 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:12:01.167 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:12:05.840 INFO:teuthology.orchestra.run.smithi204.stdout:generic/069 20s 2024-02-18T10:12:15.779 INFO:teuthology.orchestra.run.smithi204.stdout:generic/070 10s 2024-02-18T10:12:16.205 INFO:teuthology.orchestra.run.smithi204.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-18T10:12:16.673 INFO:teuthology.orchestra.run.smithi204.stdout:generic/073 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:12:17.536 INFO:teuthology.orchestra.run.smithi204.stdout:generic/075 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.out.bad) 2024-02-18T10:12:17.543 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/075.out 2024-02-18 10:01:38.825993666 +0000 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.out.bad 2024-02-18 10:12:17.531038759 +0000 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -4,15 +4,5 @@ 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: ----------------------------------------------- 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: fsx.0 : -d -N numops -S 0 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: ----------------------------------------------- 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: - 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: -fsx.1 : -d -N numops -S 0 -x 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: - 2024-02-18T10:12:17.544 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: -fsx.2 : -d -N numops -l filelen -S 0 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: - 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: -fsx.3 : -d -N numops -l filelen -S 0 -x 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: + fsx (-d -N 1000 -S 0) failed, 0 - compare /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.0.{good,bad,fsxlog} 2024-02-18T10:12:17.545 INFO:teuthology.orchestra.run.smithi204.stdout: +mv: '/tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.0.fsxlog' and '/tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.0.fsxlog' are the same file 2024-02-18T10:12:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:generic/076 [not run] require 172.21.15.118:6789:/scratch to be local device 2024-02-18T10:12:18.479 INFO:teuthology.orchestra.run.smithi204.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-02-18T10:12:18.903 INFO:teuthology.orchestra.run.smithi204.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-02-18T10:12:21.437 INFO:teuthology.orchestra.run.smithi204.stdout:generic/080 3s 2024-02-18T10:12:21.922 INFO:teuthology.orchestra.run.smithi204.stdout:generic/081 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:12:22.388 INFO:teuthology.orchestra.run.smithi204.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:12:28.218 INFO:teuthology.orchestra.run.smithi204.stdout:generic/084 6s 2024-02-18T10:12:28.725 INFO:teuthology.orchestra.run.smithi204.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:12:29.335 INFO:teuthology.orchestra.run.smithi204.stdout:generic/087 1s 2024-02-18T10:12:29.808 INFO:teuthology.orchestra.run.smithi204.stdout:generic/088 0s 2024-02-18T10:12:30.281 INFO:teuthology.orchestra.run.smithi204.stdout:generic/090 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:12:31.300 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:12:31.302 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:12:31.305 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:13:01.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:13:01.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:13:01.448 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:13:09.436 INFO:teuthology.orchestra.run.smithi204.stdout:generic/091 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/091.out.bad) 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/091.out 2024-02-18 10:01:38.828993624 +0000 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/091.out.bad 2024-02-18 10:13:09.431308184 +0000 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -5,3 +5,322 @@ 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: fsx -N 10000 -o 32768 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -W 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: +mapped writes DISABLED 2024-02-18T10:13:09.444 INFO:teuthology.orchestra.run.smithi204.stdout: +Seed set to 1 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode 0, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_PUNCH_HOLE | FALLOC_FL_KEEP_SIZE, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support clone range, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support dedupe range, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support exchange range, disabling! 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +skipping zero size read 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x1f000 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +copying to largest ever: 0x29000 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x3a000 2024-02-18T10:13:09.445 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x40000 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x57000 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x58000 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x6f000 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x72000 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +READ BAD DATA: offset = 0x3000, size = 0xced0, fname = /tmp/tmp.QUduP9NKsItest/junk 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +OFFSET GOOD BAD RANGE 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3000 0x7d54 0x0000 0x0 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3001 0x547d 0x0000 0x1 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3002 0x7d35 0x0000 0x2 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.446 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3003 0x357d 0x0000 0x3 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3004 0x7d7e 0x0000 0x4 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3005 0x7e7d 0x0000 0x5 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3006 0x7dd4 0x0000 0x6 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3007 0xd47d 0x0000 0x7 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3008 0x7da7 0x0000 0x8 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +0x3009 0xa77d 0x0000 0x9 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +0x300a 0x7d06 0x0000 0xa 2024-02-18T10:13:09.447 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +0x300b 0x067d 0x0000 0xb 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +0x300c 0x7d0b 0x0000 0xc 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +0x300d 0x0b7d 0x0000 0xd 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +0x300e 0x7ddd 0x0000 0xe 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +0x300f 0xdd7d 0x0000 0xf 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +LOG DUMP (261 total operations): 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.448 INFO:teuthology.orchestra.run.smithi204.stdout: +3( 3 mod 256): WRITE 0x69000 thru 0x78fff (0x10000 bytes) HOLE ***WWWW 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +5( 5 mod 256): READ 0x63000 thru 0x70fff (0xe000 bytes) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +7( 7 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +8( 8 mod 256): READ 0x5f000 thru 0x64fff (0x6000 bytes) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +9( 9 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +10( 10 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +11( 11 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +12( 12 mod 256): READ 0x43000 thru 0x4dfff (0xb000 bytes) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +13( 13 mod 256): MAPREAD 0x54000 thru 0x66b4f (0x12b50 bytes) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +15( 15 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +16( 16 mod 256): READ 0x28000 thru 0x2ffff (0x8000 bytes) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.449 INFO:teuthology.orchestra.run.smithi204.stdout: +18( 18 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +20( 20 mod 256): MAPREAD 0x55000 thru 0x6e2fc (0x192fd bytes) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +21( 21 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +22( 22 mod 256): TRUNCATE DOWN from 0x79000 to 0x1f000 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +23( 23 mod 256): WRITE 0x61000 thru 0x65fff (0x5000 bytes) HOLE 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +24( 24 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +25( 25 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +26( 26 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +27( 27 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +28( 28 mod 256): COPY 0x61000 thru 0x64fff (0x4000 bytes) to 0x25000 thru 0x28fff 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +29( 29 mod 256): TRUNCATE DOWN from 0x66000 to 0x3a000 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +30( 30 mod 256): MAPREAD 0x39000 thru 0x39449 (0x44a bytes) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +32( 32 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.450 INFO:teuthology.orchestra.run.smithi204.stdout: +33( 33 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +34( 34 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +35( 35 mod 256): WRITE 0x29000 thru 0x38fff (0x10000 bytes) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +36( 36 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +37( 37 mod 256): READ 0x17000 thru 0x1afff (0x4000 bytes) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +38( 38 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +39( 39 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +40( 40 mod 256): WRITE 0x71000 thru 0x78fff (0x8000 bytes) HOLE 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +41( 41 mod 256): COPY 0x59000 thru 0x64fff (0xc000 bytes) to 0x14000 thru 0x1ffff 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +42( 42 mod 256): MAPREAD 0x6b000 thru 0x78fa1 (0xdfa2 bytes) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +43( 43 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +44( 44 mod 256): WRITE 0x20000 thru 0x2afff (0xb000 bytes) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +45( 45 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +46( 46 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.451 INFO:teuthology.orchestra.run.smithi204.stdout: +47( 47 mod 256): TRUNCATE DOWN from 0x79000 to 0x39000 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +48( 48 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +49( 49 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +50( 50 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +51( 51 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +52( 52 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +53( 53 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +54( 54 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +55( 55 mod 256): COPY 0x1000 thru 0x3fff (0x3000 bytes) to 0x12000 thru 0x14fff 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +56( 56 mod 256): READ 0x5000 thru 0xbfff (0x7000 bytes) ***RRRR*** 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +57( 57 mod 256): WRITE 0x4e000 thru 0x69fff (0x1c000 bytes) HOLE 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +58( 58 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +59( 59 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +60( 60 mod 256): MAPREAD 0x10000 thru 0x2e39b (0x1e39c bytes) 2024-02-18T10:13:09.452 INFO:teuthology.orchestra.run.smithi204.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +62( 62 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +65( 65 mod 256): WRITE 0x19000 thru 0x19fff (0x1000 bytes) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +67( 67 mod 256): WRITE 0x1f000 thru 0x3cfff (0x1e000 bytes) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +68( 68 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +69( 69 mod 256): TRUNCATE DOWN from 0x6a000 to 0x57000 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +70( 70 mod 256): READ 0x52000 thru 0x55fff (0x4000 bytes) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +71( 71 mod 256): TRUNCATE UP from 0x57000 to 0x58000 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +72( 72 mod 256): TRUNCATE DOWN from 0x58000 to 0x4b000 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +73( 73 mod 256): TRUNCATE DOWN from 0x4b000 to 0x28000 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +74( 74 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.453 INFO:teuthology.orchestra.run.smithi204.stdout: +75( 75 mod 256): MAPREAD 0x1b000 thru 0x1f654 (0x4655 bytes) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +76( 76 mod 256): WRITE 0x38000 thru 0x49fff (0x12000 bytes) HOLE 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +77( 77 mod 256): WRITE 0x3000 thru 0x4fff (0x2000 bytes) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +78( 78 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +79( 79 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +80( 80 mod 256): MAPREAD 0x5000 thru 0x1a378 (0x15379 bytes) ***RRRR*** 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +81( 81 mod 256): WRITE 0x6f000 thru 0x70fff (0x2000 bytes) HOLE 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +83( 83 mod 256): TRUNCATE DOWN from 0x71000 to 0x4f000 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +84( 84 mod 256): READ 0x3c000 thru 0x4dfff (0x12000 bytes) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +86( 86 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +87( 87 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +88( 88 mod 256): COPY 0xa000 thru 0xefff (0x5000 bytes) to 0x66000 thru 0x6afff EEEE****** 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +89( 89 mod 256): WRITE 0x2b000 thru 0x48fff (0x1e000 bytes) 2024-02-18T10:13:09.454 INFO:teuthology.orchestra.run.smithi204.stdout: +90( 90 mod 256): COPY 0x5d000 thru 0x6dfff (0x11000 bytes) to 0x24000 thru 0x34fff 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +91( 91 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +92( 92 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +93( 93 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +94( 94 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +95( 95 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +96( 96 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +97( 97 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +98( 98 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +99( 99 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +100(100 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +101(101 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +102(102 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +103(103 mod 256): MAPREAD 0x54000 thru 0x5a617 (0x6618 bytes) 2024-02-18T10:13:09.455 INFO:teuthology.orchestra.run.smithi204.stdout: +104(104 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +105(105 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +106(106 mod 256): WRITE 0x3b000 thru 0x40fff (0x6000 bytes) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +107(107 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +108(108 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +109(109 mod 256): WRITE 0x21000 thru 0x23fff (0x3000 bytes) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +110(110 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +111(111 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +112(112 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +113(113 mod 256): WRITE 0x49000 thru 0x51fff (0x9000 bytes) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +115(115 mod 256): WRITE 0x46000 thru 0x52fff (0xd000 bytes) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +116(116 mod 256): COPY 0xa000 thru 0x14fff (0xb000 bytes) to 0x1e000 thru 0x28fff EEEE****** 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +117(117 mod 256): READ 0x57000 thru 0x59fff (0x3000 bytes) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +118(118 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.456 INFO:teuthology.orchestra.run.smithi204.stdout: +119(119 mod 256): COPY 0x48000 thru 0x55fff (0xe000 bytes) to 0xe000 thru 0x1bfff 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +120(120 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +121(121 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +122(122 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +123(123 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +124(124 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +125(125 mod 256): WRITE 0x0 thru 0x19fff (0x1a000 bytes) ***WWWW 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +126(126 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +127(127 mod 256): TRUNCATE UP from 0x5b000 to 0x72000 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +128(128 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +129(129 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +130(130 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +131(131 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +132(132 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.457 INFO:teuthology.orchestra.run.smithi204.stdout: +133(133 mod 256): READ 0x19000 thru 0x29fff (0x11000 bytes) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +134(134 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +135(135 mod 256): MAPREAD 0x4d000 thru 0x4d15d (0x15e bytes) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +136(136 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +137(137 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +138(138 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +140(140 mod 256): WRITE 0x10000 thru 0x1bfff (0xc000 bytes) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +142(142 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +143(143 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +144(144 mod 256): WRITE 0x42000 thru 0x4afff (0x9000 bytes) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +145(145 mod 256): WRITE 0x6b000 thru 0x78fff (0xe000 bytes) EXTEND 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +146(146 mod 256): WRITE 0x67000 thru 0x78fff (0x12000 bytes) 2024-02-18T10:13:09.458 INFO:teuthology.orchestra.run.smithi204.stdout: +147(147 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +148(148 mod 256): WRITE 0x25000 thru 0x34fff (0x10000 bytes) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +149(149 mod 256): WRITE 0x29000 thru 0x44fff (0x1c000 bytes) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +150(150 mod 256): READ 0x5a000 thru 0x67fff (0xe000 bytes) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +151(151 mod 256): TRUNCATE DOWN from 0x79000 to 0x12000 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +152(152 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +154(154 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +155(155 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +156(156 mod 256): COPY 0xa000 thru 0xdfff (0x4000 bytes) to 0x13000 thru 0x16fff EEEE****** 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +157(157 mod 256): WRITE 0x62000 thru 0x77fff (0x16000 bytes) HOLE 2024-02-18T10:13:09.459 INFO:teuthology.orchestra.run.smithi204.stdout: +158(158 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +160(160 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +161(161 mod 256): MAPREAD 0x4e000 thru 0x53d94 (0x5d95 bytes) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +162(162 mod 256): MAPREAD 0x1d000 thru 0x2324c (0x624d bytes) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +164(164 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +165(165 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +166(166 mod 256): WRITE 0x3e000 thru 0x4cfff (0xf000 bytes) 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +167(167 mod 256): TRUNCATE DOWN from 0x78000 to 0x29000 2024-02-18T10:13:09.460 INFO:teuthology.orchestra.run.smithi204.stdout: +168(168 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +169(169 mod 256): MAPREAD 0x1d000 thru 0x28e2a (0xbe2b bytes) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +170(170 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +171(171 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +173(173 mod 256): COPY 0x44000 thru 0x47fff (0x4000 bytes) to 0x38000 thru 0x3bfff 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +174(174 mod 256): READ 0x23000 thru 0x33fff (0x11000 bytes) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +175(175 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +177(177 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +178(178 mod 256): READ 0xc000 thru 0x10fff (0x5000 bytes) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +179(179 mod 256): COPY 0x4e000 thru 0x64fff (0x17000 bytes) to 0x35000 thru 0x4bfff 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +180(180 mod 256): MAPREAD 0x54000 thru 0x634ce (0xf4cf bytes) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +181(181 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +182(182 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.461 INFO:teuthology.orchestra.run.smithi204.stdout: +183(183 mod 256): MAPREAD 0x38000 thru 0x4da09 (0x15a0a bytes) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +184(184 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +185(185 mod 256): TRUNCATE DOWN from 0x6f000 to 0x15000 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +186(186 mod 256): TRUNCATE UP from 0x15000 to 0x50000 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +187(187 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +188(188 mod 256): WRITE 0x28000 thru 0x33fff (0xc000 bytes) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +189(189 mod 256): WRITE 0x32000 thru 0x44fff (0x13000 bytes) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +190(190 mod 256): TRUNCATE DOWN from 0x50000 to 0x49000 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +191(191 mod 256): WRITE 0x50000 thru 0x63fff (0x14000 bytes) HOLE 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +192(192 mod 256): MAPREAD 0x1a000 thru 0x1ad96 (0xd97 bytes) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +193(193 mod 256): WRITE 0x23000 thru 0x29fff (0x7000 bytes) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +194(194 mod 256): WRITE 0x5b000 thru 0x64fff (0xa000 bytes) EXTEND 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +195(195 mod 256): MAPREAD 0x23000 thru 0x2fd78 (0xcd79 bytes) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +196(196 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.462 INFO:teuthology.orchestra.run.smithi204.stdout: +197(197 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +198(198 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +199(199 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +200(200 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +201(201 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +202(202 mod 256): TRUNCATE DOWN from 0x65000 to 0x5e000 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +203(203 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +204(204 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +205(205 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +206(206 mod 256): READ 0x2d000 thru 0x36fff (0xa000 bytes) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +207(207 mod 256): MAPREAD 0x29000 thru 0x47985 (0x1e986 bytes) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +208(208 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +209(209 mod 256): WRITE 0x15000 thru 0x31fff (0x1d000 bytes) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +210(210 mod 256): READ 0x12000 thru 0x23fff (0x12000 bytes) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +211(211 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.463 INFO:teuthology.orchestra.run.smithi204.stdout: +212(212 mod 256): MAPREAD 0x28000 thru 0x34970 (0xc971 bytes) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +213(213 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +214(214 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +215(215 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +216(216 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +217(217 mod 256): WRITE 0x72000 thru 0x78fff (0x7000 bytes) HOLE 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +218(218 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +219(219 mod 256): COPY 0x72000 thru 0x77fff (0x6000 bytes) to 0x27000 thru 0x2cfff 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +220(220 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +221(221 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +222(222 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +223(223 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +224(224 mod 256): WRITE 0x39000 thru 0x3afff (0x2000 bytes) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +225(225 mod 256): MAPREAD 0x6b000 thru 0x78658 (0xd659 bytes) 2024-02-18T10:13:09.464 INFO:teuthology.orchestra.run.smithi204.stdout: +226(226 mod 256): READ 0x1a000 thru 0x35fff (0x1c000 bytes) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +227(227 mod 256): READ 0x1b000 thru 0x1bfff (0x1000 bytes) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +228(228 mod 256): MAPREAD 0x37000 thru 0x49af1 (0x12af2 bytes) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +229(229 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +230(230 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +231(231 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +232(232 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +233(233 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +234(234 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +235(235 mod 256): MAPREAD 0x2b000 thru 0x3365b (0x865c bytes) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +236(236 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +237(237 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +238(238 mod 256): READ 0x40000 thru 0x42fff (0x3000 bytes) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +239(239 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.465 INFO:teuthology.orchestra.run.smithi204.stdout: +240(240 mod 256): COPY 0x3f000 thru 0x46fff (0x8000 bytes) to 0x31000 thru 0x38fff 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +241(241 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +242(242 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +243(243 mod 256): READ 0x23000 thru 0x3bfff (0x19000 bytes) 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +244(244 mod 256): TRUNCATE DOWN from 0x79000 to 0x15000 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +245(245 mod 256): MAPREAD 0xa000 thru 0xe6d6 (0x46d7 bytes) ***RRRR*** 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +246(246 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +247(247 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +248(248 mod 256): TRUNCATE DOWN from 0x15000 to 0xc000 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +249(249 mod 256): WRITE 0x30000 thru 0x46fff (0x17000 bytes) HOLE 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +250(250 mod 256): READ 0xb000 thru 0x15fff (0xb000 bytes) ***RRRR*** 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +251(251 mod 256): TRUNCATE UP from 0x47000 to 0x53000 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +252(252 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +253(253 mod 256): TRUNCATE DOWN from 0x53000 to 0x11000 2024-02-18T10:13:09.466 INFO:teuthology.orchestra.run.smithi204.stdout: +254(254 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +255(255 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +256( 0 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +257( 1 mod 256): TRUNCATE DOWN from 0x11000 to 0x10000 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +258( 2 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +259( 3 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +260( 4 mod 256): SKIPPED (no operation) 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +261( 5 mod 256): MAPREAD 0x3000 thru 0xfecf (0xced0 bytes) ***RRRR*** 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +Log of operations saved to "/tmp/tmp.QUduP9NKsItest/junk.fsxops"; replay with --replay-ops 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +Correct content saved for comparison 2024-02-18T10:13:09.467 INFO:teuthology.orchestra.run.smithi204.stdout: +(maybe hexdump "/tmp/tmp.QUduP9NKsItest/junk" vs "/tmp/tmp.QUduP9NKsItest/junk.fsxgood") 2024-02-18T10:13:09.954 INFO:teuthology.orchestra.run.smithi204.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:13:10.452 INFO:teuthology.orchestra.run.smithi204.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-18T10:13:13.833 INFO:teuthology.orchestra.run.smithi204.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-18T10:13:14.589 INFO:teuthology.orchestra.run.smithi204.stdout:generic/097 1s 2024-02-18T10:13:15.748 INFO:teuthology.orchestra.run.smithi204.stdout:generic/098 - output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/098.out.bad) 2024-02-18T10:13:15.758 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/098.out 2024-02-18 10:01:38.829993610 +0000 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/098.out.bad 2024-02-18 10:13:15.744219086 +0000 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -4,9 +4,7 @@ 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: wrote 32768/32768 bytes at offset 262144 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: File content after remount: 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: -0000000 aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: -* 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: -0400000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: +0000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: * 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: 0500000 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: wrote 131072/131072 bytes at offset 0 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -14,8 +12,6 @@ 2024-02-18T10:13:15.759 INFO:teuthology.orchestra.run.smithi204.stdout: wrote 32768/32768 bytes at offset 262144 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: File content after remount: 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: -0000000 aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: -* 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: -0400000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: +0000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: * 2024-02-18T10:13:15.760 INFO:teuthology.orchestra.run.smithi204.stdout: 0500000 2024-02-18T10:13:17.295 INFO:teuthology.orchestra.run.smithi204.stdout:generic/099 2s 2024-02-18T10:13:17.782 INFO:teuthology.orchestra.run.smithi204.stdout:generic/101 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:13:18.267 INFO:teuthology.orchestra.run.smithi204.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:13:18.753 INFO:teuthology.orchestra.run.smithi204.stdout:generic/104 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:13:19.660 INFO:teuthology.orchestra.run.smithi204.stdout:generic/105 1s 2024-02-18T10:13:20.243 INFO:teuthology.orchestra.run.smithi204.stdout:generic/106 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:13:20.738 INFO:teuthology.orchestra.run.smithi204.stdout:generic/107 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:13:21.358 INFO:teuthology.orchestra.run.smithi204.stdout:generic/108 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:13:21.864 INFO:teuthology.orchestra.run.smithi204.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:13:22.349 INFO:teuthology.orchestra.run.smithi204.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:13:23.864 INFO:teuthology.orchestra.run.smithi204.stdout:generic/112 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/112.out.bad) 2024-02-18T10:13:23.872 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/112.out 2024-02-18 10:01:38.831993582 +0000 2024-02-18T10:13:23.872 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/112.out.bad 2024-02-18 10:13:23.859104556 +0000 2024-02-18T10:13:23.872 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -4,15 +4,4 @@ 2024-02-18T10:13:23.872 INFO:teuthology.orchestra.run.smithi204.stdout: ----------------------------------------------- 2024-02-18T10:13:23.872 INFO:teuthology.orchestra.run.smithi204.stdout: fsx.0 : -A -d -N numops -S 0 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: ----------------------------------------------- 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: - 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: -fsx.1 : -A -d -N numops -S 0 -x 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: - 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: -fsx.2 : -A -d -N numops -l filelen -S 0 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: - 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: -fsx.3 : -A -d -N numops -l filelen -S 0 -x 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: ------------------------------------------------ 2024-02-18T10:13:23.873 INFO:teuthology.orchestra.run.smithi204.stdout: + fsx (-A -d -N 1000 -S 0) returned 0 - see 112.0.full 2024-02-18T10:13:31.573 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:13:31.576 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:13:31.579 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:13:31.646 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-02-18T10:13:31.643+0000 7ff644cb2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50001) UID: 0 2024-02-18T10:13:31.646 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-02-18T10:13:31.643+0000 7fd71beff640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50001) UID: 0 2024-02-18T10:14:56.604 INFO:teuthology.orchestra.run.smithi204.stdout:generic/113 93s 2024-02-18T10:14:57.045 INFO:teuthology.orchestra.run.smithi204.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-02-18T10:14:57.506 INFO:teuthology.orchestra.run.smithi204.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:14:57.991 INFO:teuthology.orchestra.run.smithi204.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:15:04.460 INFO:teuthology.orchestra.run.smithi204.stdout:generic/117 6s 2024-02-18T10:15:05.042 INFO:teuthology.orchestra.run.smithi204.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:15:05.526 INFO:teuthology.orchestra.run.smithi204.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:15:05.950 INFO:teuthology.orchestra.run.smithi204.stdout:generic/120 [not run] atime not maintained by ceph 2024-02-18T10:15:06.469 INFO:teuthology.orchestra.run.smithi204.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:15:06.957 INFO:teuthology.orchestra.run.smithi204.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:15:08.058 INFO:teuthology.orchestra.run.smithi204.stdout:generic/123 2s 2024-02-18T10:15:49.752 INFO:teuthology.orchestra.run.smithi204.stdout:generic/124 41s 2024-02-18T10:15:50.609 INFO:teuthology.orchestra.run.smithi204.stdout:generic/126 1s 2024-02-18T10:15:52.149 INFO:teuthology.orchestra.run.smithi204.stdout:generic/128 2s 2024-02-18T10:15:52.657 INFO:teuthology.orchestra.run.smithi204.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-02-18T10:15:53.125 INFO:teuthology.orchestra.run.smithi204.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-02-18T10:15:54.748 INFO:teuthology.orchestra.run.smithi204.stdout:generic/131 1s 2024-02-18T10:15:55.275 INFO:teuthology.orchestra.run.smithi204.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:15:56.501 INFO:teuthology.orchestra.run.smithi204.stdout:generic/135 1s 2024-02-18T10:15:57.063 INFO:teuthology.orchestra.run.smithi204.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:15:57.593 INFO:teuthology.orchestra.run.smithi204.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:15:58.114 INFO:teuthology.orchestra.run.smithi204.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:15:58.617 INFO:teuthology.orchestra.run.smithi204.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:15:59.898 INFO:teuthology.orchestra.run.smithi204.stdout:generic/141 1s 2024-02-18T10:16:00.471 INFO:teuthology.orchestra.run.smithi204.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:00.973 INFO:teuthology.orchestra.run.smithi204.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:01.463 INFO:teuthology.orchestra.run.smithi204.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:01.948 INFO:teuthology.orchestra.run.smithi204.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:02.416 INFO:teuthology.orchestra.run.smithi204.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:02.891 INFO:teuthology.orchestra.run.smithi204.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:03.368 INFO:teuthology.orchestra.run.smithi204.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:03.868 INFO:teuthology.orchestra.run.smithi204.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:04.349 INFO:teuthology.orchestra.run.smithi204.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:04.846 INFO:teuthology.orchestra.run.smithi204.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:05.350 INFO:teuthology.orchestra.run.smithi204.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:05.834 INFO:teuthology.orchestra.run.smithi204.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:06.288 INFO:teuthology.orchestra.run.smithi204.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:06.769 INFO:teuthology.orchestra.run.smithi204.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:07.267 INFO:teuthology.orchestra.run.smithi204.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:07.765 INFO:teuthology.orchestra.run.smithi204.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:08.279 INFO:teuthology.orchestra.run.smithi204.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:16:08.696 INFO:teuthology.orchestra.run.smithi204.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-02-18T10:16:09.174 INFO:teuthology.orchestra.run.smithi204.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-02-18T10:16:09.953 INFO:teuthology.orchestra.run.smithi204.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:10.602 INFO:teuthology.orchestra.run.smithi204.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-18T10:16:11.361 INFO:teuthology.orchestra.run.smithi204.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-18T10:16:12.582 INFO:teuthology.orchestra.run.smithi204.stdout:generic/169 1s 2024-02-18T10:16:13.392 INFO:teuthology.orchestra.run.smithi204.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:14.132 INFO:teuthology.orchestra.run.smithi204.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:14.855 INFO:teuthology.orchestra.run.smithi204.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:15.571 INFO:teuthology.orchestra.run.smithi204.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:21.648 INFO:teuthology.orchestra.run.smithi204.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:16:22.164 INFO:teuthology.orchestra.run.smithi204.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:22.604 INFO:teuthology.orchestra.run.smithi204.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:23.056 INFO:teuthology.orchestra.run.smithi204.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:23.494 INFO:teuthology.orchestra.run.smithi204.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:16:23.946 INFO:teuthology.orchestra.run.smithi204.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:16:24.714 INFO:teuthology.orchestra.run.smithi204.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:25.221 INFO:teuthology.orchestra.run.smithi204.stdout:generic/184 1s 2024-02-18T10:16:25.947 INFO:teuthology.orchestra.run.smithi204.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:26.683 INFO:teuthology.orchestra.run.smithi204.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:27.453 INFO:teuthology.orchestra.run.smithi204.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:28.114 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:16:28.117 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:16:28.120 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:16:28.173 INFO:teuthology.orchestra.run.smithi204.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:28.873 INFO:teuthology.orchestra.run.smithi204.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:30.942 INFO:teuthology.orchestra.run.smithi204.stdout:generic/193 2s 2024-02-18T10:16:31.675 INFO:teuthology.orchestra.run.smithi204.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:32.440 INFO:teuthology.orchestra.run.smithi204.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:33.172 INFO:teuthology.orchestra.run.smithi204.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:33.877 INFO:teuthology.orchestra.run.smithi204.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:53.248 INFO:teuthology.orchestra.run.smithi204.stdout:generic/198 [failed, exit status 10]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/198.out.bad) 2024-02-18T10:16:53.256 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/198.out 2024-02-18 10:01:38.845993388 +0000 2024-02-18T10:16:53.256 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/198.out.bad 2024-02-18 10:16:53.243168598 +0000 2024-02-18T10:16:53.256 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -1,2 +1,5 @@ 2024-02-18T10:16:53.256 INFO:teuthology.orchestra.run.smithi204.stdout: QA output created by 198 2024-02-18T10:16:53.256 INFO:teuthology.orchestra.run.smithi204.stdout: Silence is golden. 2024-02-18T10:16:53.256 INFO:teuthology.orchestra.run.smithi204.stdout: +non one buffer at buf[0] => 0x00,00,00,00 2024-02-18T10:16:53.257 INFO:teuthology.orchestra.run.smithi204.stdout: +non-one read at offset 0 2024-02-18T10:16:53.257 INFO:teuthology.orchestra.run.smithi204.stdout: +*** WARNING *** /tmp/tmp.QUduP9NKsItest/aiodio_sparse has not been unlinked; if you don't rm it manually first, it may influence the next run 2024-02-18T10:16:53.973 INFO:teuthology.orchestra.run.smithi204.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:54.572 INFO:teuthology.orchestra.run.smithi204.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:55.214 INFO:teuthology.orchestra.run.smithi204.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:55.958 INFO:teuthology.orchestra.run.smithi204.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:56.710 INFO:teuthology.orchestra.run.smithi204.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:57.469 INFO:teuthology.orchestra.run.smithi204.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:58.232 INFO:teuthology.orchestra.run.smithi204.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:16:58.402 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:16:58.405 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:16:58.407 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:17:09.242 INFO:teuthology.orchestra.run.smithi204.stdout:generic/207 11s 2024-02-18T10:17:09.789 INFO:teuthology.orchestra.run.smithi204.stdout:generic/210 0s 2024-02-18T10:17:10.716 INFO:teuthology.orchestra.run.smithi204.stdout:generic/211 1s 2024-02-18T10:17:11.259 INFO:teuthology.orchestra.run.smithi204.stdout:generic/212 1s 2024-02-18T10:17:11.726 INFO:teuthology.orchestra.run.smithi204.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:17:12.200 INFO:teuthology.orchestra.run.smithi204.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:17:14.748 INFO:teuthology.orchestra.run.smithi204.stdout:generic/215 2s 2024-02-18T10:17:15.488 INFO:teuthology.orchestra.run.smithi204.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:16.216 INFO:teuthology.orchestra.run.smithi204.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:16.947 INFO:teuthology.orchestra.run.smithi204.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:17.402 INFO:teuthology.orchestra.run.smithi204.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:17:18.137 INFO:teuthology.orchestra.run.smithi204.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:19.646 INFO:teuthology.orchestra.run.smithi204.stdout:generic/221 1s 2024-02-18T10:17:20.395 INFO:teuthology.orchestra.run.smithi204.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:20.854 INFO:teuthology.orchestra.run.smithi204.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:17:21.389 INFO:teuthology.orchestra.run.smithi204.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-18T10:17:22.161 INFO:teuthology.orchestra.run.smithi204.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:22.637 INFO:teuthology.orchestra.run.smithi204.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:17:23.370 INFO:teuthology.orchestra.run.smithi204.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:23.811 INFO:teuthology.orchestra.run.smithi204.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:17:24.245 INFO:teuthology.orchestra.run.smithi204.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:17:25.790 INFO:teuthology.orchestra.run.smithi204.stdout:generic/236 1s 2024-02-18T10:17:26.381 INFO:teuthology.orchestra.run.smithi204.stdout:generic/237 1s 2024-02-18T10:17:27.126 INFO:teuthology.orchestra.run.smithi204.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:17:27.579 INFO:teuthology.orchestra.run.smithi204.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-02-18T10:17:28.007 INFO:teuthology.orchestra.run.smithi204.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:17:28.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:17:28.519 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:17:28.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:17:28.575 INFO:teuthology.orchestra.run.smithi204.stdout:generic/245 0s 2024-02-18T10:17:29.019 INFO:teuthology.orchestra.run.smithi204.stdout:generic/246 1s 2024-02-18T10:17:58.662 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:17:58.665 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:17:58.668 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:18:29.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:18:29.098 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:18:29.104 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:18:59.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:18:59.394 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:18:59.397 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:19:29.515 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:19:29.518 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:19:29.521 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:19:59.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:20:00.094 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:20:00.098 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:20:30.225 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:20:30.228 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:20:30.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:21:00.554 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:21:00.558 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:21:00.561 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:21:30.894 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:21:30.897 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:21:30.899 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:21:44.530 INFO:teuthology.orchestra.run.smithi204.stdout:generic/247 255s 2024-02-18T10:21:45.107 INFO:teuthology.orchestra.run.smithi204.stdout:generic/248 1s 2024-02-18T10:22:01.025 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:22:01.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:22:01.031 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:22:06.656 INFO:teuthology.orchestra.run.smithi204.stdout:generic/249 21s 2024-02-18T10:22:07.123 INFO:teuthology.orchestra.run.smithi204.stdout:generic/250 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:22:07.602 INFO:teuthology.orchestra.run.smithi204.stdout:generic/252 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:22:08.355 INFO:teuthology.orchestra.run.smithi204.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:09.100 INFO:teuthology.orchestra.run.smithi204.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:16.276 INFO:teuthology.orchestra.run.smithi204.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:22:22.642 INFO:teuthology.orchestra.run.smithi204.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:22:23.987 INFO:teuthology.orchestra.run.smithi204.stdout:generic/257 1s 2024-02-18T10:22:24.427 INFO:teuthology.orchestra.run.smithi204.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-02-18T10:22:25.248 INFO:teuthology.orchestra.run.smithi204.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:25.883 INFO:teuthology.orchestra.run.smithi204.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.w8GvOpYWfNscratch 2024-02-18T10:22:26.627 INFO:teuthology.orchestra.run.smithi204.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:27.387 INFO:teuthology.orchestra.run.smithi204.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:28.280 INFO:teuthology.orchestra.run.smithi204.stdout:generic/263 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/263.out.bad) 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/263.out 2024-02-18 10:01:38.856993235 +0000 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/263.out.bad 2024-02-18 10:22:28.275429502 +0000 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -1,3 +1,240 @@ 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: QA output created by 263 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: -fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: +Seed set to 1 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode 0, disabling! 2024-02-18T10:22:28.290 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_PUNCH_HOLE | FALLOC_FL_KEEP_SIZE, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support clone range, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support dedupe range, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +main: filesystem does not support exchange range, disabling! 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +skipping zero size read 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x1f000 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x3a000 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x40000 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x4f000 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x6f000 2024-02-18T10:22:28.291 INFO:teuthology.orchestra.run.smithi204.stdout: +truncating to largest ever: 0x72000 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +READ BAD DATA: offset = 0x18000, size = 0xc6a, fname = /tmp/tmp.QUduP9NKsItest/junk 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +OFFSET GOOD BAD RANGE 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18000 0xafce 0x0000 0x0 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18001 0xceaf 0x0000 0x1 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18002 0xaf3d 0x0000 0x2 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18003 0x3daf 0x0000 0x3 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18004 0xaf32 0x0000 0x4 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18005 0x32af 0x0000 0x5 2024-02-18T10:22:28.292 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18006 0xaf4b 0x0000 0x6 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18007 0x4baf 0x0000 0x7 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18008 0xaf1d 0x0000 0x8 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +0x18009 0x1daf 0x0000 0x9 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +0x1800a 0xaf26 0x0000 0xa 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +0x1800b 0x26af 0x0000 0xb 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +0x1800c 0xaf85 0x0000 0xc 2024-02-18T10:22:28.293 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +0x1800d 0x85af 0x0000 0xd 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +0x1800e 0xafa4 0x0000 0xe 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +0x1800f 0xa4af 0x0000 0xf 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +LOG DUMP (183 total operations): 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +1( 1 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +2( 2 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +3( 3 mod 256): MAPWRITE 0x69000 thru 0x6948f (0x490 bytes) 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +4( 4 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +5( 5 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +6( 6 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.294 INFO:teuthology.orchestra.run.smithi204.stdout: +7( 7 mod 256): MAPREAD 0x24000 thru 0x252b7 (0x12b8 bytes) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +8( 8 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +9( 9 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +10( 10 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +11( 11 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +12( 12 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +13( 13 mod 256): MAPREAD 0x2a000 thru 0x2b84b (0x184c bytes) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +14( 14 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +15( 15 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +16( 16 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +17( 17 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +18( 18 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +19( 19 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +20( 20 mod 256): MAPREAD 0x13000 thru 0x13b3a (0xb3b bytes) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +21( 21 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.295 INFO:teuthology.orchestra.run.smithi204.stdout: +22( 22 mod 256): TRUNCATE DOWN from 0x69490 to 0x1f000 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +23( 23 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +24( 24 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +25( 25 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +26( 26 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +27( 27 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +28( 28 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +29( 29 mod 256): TRUNCATE UP from 0x1f000 to 0x3a000 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +30( 30 mod 256): MAPREAD 0x39000 thru 0x390cd (0xce bytes) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +32( 32 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +33( 33 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +34( 34 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +35( 35 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.296 INFO:teuthology.orchestra.run.smithi204.stdout: +36( 36 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +37( 37 mod 256): MAPREAD 0x23000 thru 0x24420 (0x1421 bytes) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +38( 38 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +39( 39 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +40( 40 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +41( 41 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +42( 42 mod 256): MAPREAD 0x1d000 thru 0x1d2ab (0x2ac bytes) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +43( 43 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x22000 thru 0x22fff 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +44( 44 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +45( 45 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +46( 46 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +47( 47 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +48( 48 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.297 INFO:teuthology.orchestra.run.smithi204.stdout: +49( 49 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +50( 50 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +51( 51 mod 256): MAPWRITE 0x14000 thru 0x14c81 (0xc82 bytes) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +52( 52 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +53( 53 mod 256): TRUNCATE DOWN from 0x40000 to 0x16000 ******WWWW 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +54( 54 mod 256): MAPWRITE 0x15000 thru 0x15628 (0x629 bytes) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +55( 55 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +56( 56 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +57( 57 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +58( 58 mod 256): MAPWRITE 0x34000 thru 0x34c6f (0xc70 bytes) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +59( 59 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) HOLE 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +60( 60 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +61( 61 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +62( 62 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +63( 63 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.298 INFO:teuthology.orchestra.run.smithi204.stdout: +64( 64 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +65( 65 mod 256): MAPWRITE 0x19000 thru 0x193b6 (0x3b7 bytes) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +66( 66 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +67( 67 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +68( 68 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +69( 69 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +70( 70 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +71( 71 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +72( 72 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +73( 73 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +74( 74 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +75( 75 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +76( 76 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +77( 77 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +78( 78 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.299 INFO:teuthology.orchestra.run.smithi204.stdout: +79( 79 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +80( 80 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +81( 81 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +82( 82 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +83( 83 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +84( 84 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +85( 85 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +86( 86 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +87( 87 mod 256): TRUNCATE DOWN from 0x39000 to 0x16000 ******WWWW 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +88( 88 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +89( 89 mod 256): MAPREAD 0xc000 thru 0xd35c (0x135d bytes) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +90( 90 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +91( 91 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +92( 92 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.300 INFO:teuthology.orchestra.run.smithi204.stdout: +93( 93 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +94( 94 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +95( 95 mod 256): MAPREAD 0xb000 thru 0xc8f7 (0x18f8 bytes) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +96( 96 mod 256): MAPWRITE 0x38000 thru 0x3909b (0x109c bytes) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +97( 97 mod 256): MAPWRITE 0x3000 thru 0x48f2 (0x18f3 bytes) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +98( 98 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +99( 99 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +100(100 mod 256): MAPREAD 0x37000 thru 0x377ef (0x7f0 bytes) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +101(101 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +102(102 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +103(103 mod 256): TRUNCATE DOWN from 0x70000 to 0x4f000 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +104(104 mod 256): READ 0x3c000 thru 0x3cfff (0x1000 bytes) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +105(105 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.301 INFO:teuthology.orchestra.run.smithi204.stdout: +106(106 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +107(107 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +108(108 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x66000 thru 0x66fff 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +109(109 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +110(110 mod 256): COPY 0x5d000 thru 0x5dfff (0x1000 bytes) to 0x24000 thru 0x24fff 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +111(111 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +112(112 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +113(113 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +114(114 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +115(115 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +116(116 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +117(117 mod 256): WRITE 0xa000 thru 0xafff (0x1000 bytes) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +118(118 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.302 INFO:teuthology.orchestra.run.smithi204.stdout: +119(119 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +120(120 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +121(121 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +122(122 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +123(123 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +124(124 mod 256): MAPREAD 0x54000 thru 0x55754 (0x1755 bytes) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +125(125 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +126(126 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +127(127 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +128(128 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +129(129 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +130(130 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +131(131 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +132(132 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.303 INFO:teuthology.orchestra.run.smithi204.stdout: +133(133 mod 256): MAPWRITE 0xf000 thru 0x1004e (0x104f bytes) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +134(134 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +135(135 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +136(136 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +137(137 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x1e000 thru 0x1efff 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +138(138 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +139(139 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +140(140 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +141(141 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +142(142 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +143(143 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +144(144 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.304 INFO:teuthology.orchestra.run.smithi204.stdout: +145(145 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +146(146 mod 256): MAPWRITE 0x0 thru 0x1cc3 (0x1cc4 bytes) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +147(147 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +148(148 mod 256): TRUNCATE UP from 0x5b000 to 0x72000 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +149(149 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +150(150 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +151(151 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +152(152 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +153(153 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +154(154 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +155(155 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +156(156 mod 256): MAPREAD 0x4d000 thru 0x4ecd8 (0x1cd9 bytes) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +157(157 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +158(158 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.305 INFO:teuthology.orchestra.run.smithi204.stdout: +159(159 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +160(160 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +161(161 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +162(162 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +163(163 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +164(164 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +165(165 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +166(166 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +167(167 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +168(168 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +169(169 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +170(170 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.306 INFO:teuthology.orchestra.run.smithi204.stdout: +171(171 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +172(172 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +173(173 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +174(174 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +175(175 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) ***WWWW 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +176(176 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +177(177 mod 256): COPY 0x10000 thru 0x10fff (0x1000 bytes) to 0x13000 thru 0x13fff 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +178(178 mod 256): WRITE 0x62000 thru 0x62fff (0x1000 bytes) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +179(179 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +180(180 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +181(181 mod 256): SKIPPED (no operation) 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +182(182 mod 256): TRUNCATE DOWN from 0x72000 to 0x1d000 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +183(183 mod 256): MAPREAD 0x18000 thru 0x18c69 (0xc6a bytes) ***RRRR*** 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +Log of operations saved to "/tmp/tmp.QUduP9NKsItest/junk.fsxops"; replay with --replay-ops 2024-02-18T10:22:28.307 INFO:teuthology.orchestra.run.smithi204.stdout: +Correct content saved for comparison 2024-02-18T10:22:28.308 INFO:teuthology.orchestra.run.smithi204.stdout: +(maybe hexdump "/tmp/tmp.QUduP9NKsItest/junk" vs "/tmp/tmp.QUduP9NKsItest/junk.fsxgood") 2024-02-18T10:22:29.095 INFO:teuthology.orchestra.run.smithi204.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:29.856 INFO:teuthology.orchestra.run.smithi204.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:30.650 INFO:teuthology.orchestra.run.smithi204.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:31.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:22:31.167 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:22:31.170 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:22:31.424 INFO:teuthology.orchestra.run.smithi204.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:32.208 INFO:teuthology.orchestra.run.smithi204.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:32.993 INFO:teuthology.orchestra.run.smithi204.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:33.779 INFO:teuthology.orchestra.run.smithi204.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:34.550 INFO:teuthology.orchestra.run.smithi204.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:35.044 INFO:teuthology.orchestra.run.smithi204.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-02-18T10:22:35.837 INFO:teuthology.orchestra.run.smithi204.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:36.619 INFO:teuthology.orchestra.run.smithi204.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:37.423 INFO:teuthology.orchestra.run.smithi204.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:38.232 INFO:teuthology.orchestra.run.smithi204.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:39.018 INFO:teuthology.orchestra.run.smithi204.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:39.797 INFO:teuthology.orchestra.run.smithi204.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:40.256 INFO:teuthology.orchestra.run.smithi204.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:22:40.990 INFO:teuthology.orchestra.run.smithi204.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:41.616 INFO:teuthology.orchestra.run.smithi204.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.w8GvOpYWfNscratch 2024-02-18T10:22:42.357 INFO:teuthology.orchestra.run.smithi204.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:43.115 INFO:teuthology.orchestra.run.smithi204.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:43.859 INFO:teuthology.orchestra.run.smithi204.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:44.612 INFO:teuthology.orchestra.run.smithi204.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:45.388 INFO:teuthology.orchestra.run.smithi204.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:46.309 INFO:teuthology.orchestra.run.smithi204.stdout:generic/294 1s 2024-02-18T10:22:47.163 INFO:teuthology.orchestra.run.smithi204.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:47.977 INFO:teuthology.orchestra.run.smithi204.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:48.724 INFO:teuthology.orchestra.run.smithi204.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:49.475 INFO:teuthology.orchestra.run.smithi204.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:50.008 INFO:teuthology.orchestra.run.smithi204.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:22:50.519 INFO:teuthology.orchestra.run.smithi204.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:22:51.292 INFO:teuthology.orchestra.run.smithi204.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:22:52.227 INFO:teuthology.orchestra.run.smithi204.stdout:generic/306 1s 2024-02-18T10:22:54.457 INFO:teuthology.orchestra.run.smithi204.stdout:generic/307 2s 2024-02-18T10:22:55.034 INFO:teuthology.orchestra.run.smithi204.stdout:generic/308 1s 2024-02-18T10:22:56.544 INFO:teuthology.orchestra.run.smithi204.stdout:generic/309 1s 2024-02-18T10:22:56.969 INFO:teuthology.orchestra.run.smithi204.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:23:01.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:23:01.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:23:01.284 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:23:01.514 INFO:teuthology.orchestra.run.smithi204.stdout:generic/313 5s 2024-02-18T10:23:02.424 INFO:teuthology.orchestra.run.smithi204.stdout:generic/314 1s 2024-02-18T10:23:02.867 INFO:teuthology.orchestra.run.smithi204.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-18T10:23:11.064 INFO:teuthology.orchestra.run.smithi204.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:23:12.089 INFO:teuthology.orchestra.run.smithi204.stdout:generic/317 1s 2024-02-18T10:23:13.067 INFO:teuthology.orchestra.run.smithi204.stdout:generic/318 1s 2024-02-18T10:23:13.848 INFO:teuthology.orchestra.run.smithi204.stdout:generic/319 0s 2024-02-18T10:23:14.365 INFO:teuthology.orchestra.run.smithi204.stdout:generic/321 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:14.824 INFO:teuthology.orchestra.run.smithi204.stdout:generic/322 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:15.248 INFO:teuthology.orchestra.run.smithi204.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-02-18T10:23:15.717 INFO:teuthology.orchestra.run.smithi204.stdout:generic/325 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:16.520 INFO:teuthology.orchestra.run.smithi204.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:23:17.263 INFO:teuthology.orchestra.run.smithi204.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:23:17.995 INFO:teuthology.orchestra.run.smithi204.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:23:18.834 INFO:teuthology.orchestra.run.smithi204.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:23:19.572 INFO:teuthology.orchestra.run.smithi204.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:23:20.369 INFO:teuthology.orchestra.run.smithi204.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:23:21.179 INFO:teuthology.orchestra.run.smithi204.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:23:21.655 INFO:teuthology.orchestra.run.smithi204.stdout:generic/335 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:22.113 INFO:teuthology.orchestra.run.smithi204.stdout:generic/336 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:23.140 INFO:teuthology.orchestra.run.smithi204.stdout:generic/337 1s 2024-02-18T10:23:23.666 INFO:teuthology.orchestra.run.smithi204.stdout:generic/338 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:24.162 INFO:teuthology.orchestra.run.smithi204.stdout:generic/341 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:24.662 INFO:teuthology.orchestra.run.smithi204.stdout:generic/342 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:25.168 INFO:teuthology.orchestra.run.smithi204.stdout:generic/343 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:23:31.651 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:23:31.654 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:23:31.657 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:24:01.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:24:01.801 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:24:01.804 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:24:31.936 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:24:31.941 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:24:31.943 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:25:02.142 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:25:02.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:25:02.148 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:25:32.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:25:32.413 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:25:32.416 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:26:02.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:26:02.546 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:26:02.548 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:26:32.673 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:26:32.676 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:26:32.679 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:26:48.597 INFO:teuthology.orchestra.run.smithi204.stdout:generic/346 203s 2024-02-18T10:26:49.126 INFO:teuthology.orchestra.run.smithi204.stdout:generic/347 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:26:49.638 INFO:teuthology.orchestra.run.smithi204.stdout:generic/348 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:26:50.403 INFO:teuthology.orchestra.run.smithi204.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:26:51.634 INFO:teuthology.orchestra.run.smithi204.stdout:generic/355 1s 2024-02-18T10:26:52.392 INFO:teuthology.orchestra.run.smithi204.stdout:generic/356 [not run] swapfiles are not supported 2024-02-18T10:26:53.105 INFO:teuthology.orchestra.run.smithi204.stdout:generic/357 [not run] swapfiles are not supported 2024-02-18T10:26:53.859 INFO:teuthology.orchestra.run.smithi204.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:26:54.602 INFO:teuthology.orchestra.run.smithi204.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:26:55.158 INFO:teuthology.orchestra.run.smithi204.stdout:generic/360 1s 2024-02-18T10:26:55.624 INFO:teuthology.orchestra.run.smithi204.stdout:generic/361 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:26:56.064 INFO:teuthology.orchestra.run.smithi204.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:56.524 INFO:teuthology.orchestra.run.smithi204.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:56.985 INFO:teuthology.orchestra.run.smithi204.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:57.410 INFO:teuthology.orchestra.run.smithi204.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:57.849 INFO:teuthology.orchestra.run.smithi204.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:58.275 INFO:teuthology.orchestra.run.smithi204.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:58.694 INFO:teuthology.orchestra.run.smithi204.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:59.141 INFO:teuthology.orchestra.run.smithi204.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:26:59.586 INFO:teuthology.orchestra.run.smithi204.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-02-18T10:27:00.034 INFO:teuthology.orchestra.run.smithi204.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:27:00.804 INFO:teuthology.orchestra.run.smithi204.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:27:01.597 INFO:teuthology.orchestra.run.smithi204.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:27:02.255 INFO:teuthology.orchestra.run.smithi204.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-18T10:27:02.911 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:27:02.913 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:27:02.916 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:27:02.989 INFO:teuthology.orchestra.run.smithi204.stdout:generic/375 0s 2024-02-18T10:27:03.469 INFO:teuthology.orchestra.run.smithi204.stdout:generic/376 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:27:04.441 INFO:teuthology.orchestra.run.smithi204.stdout:generic/377 1s 2024-02-18T10:27:05.400 INFO:teuthology.orchestra.run.smithi204.stdout:generic/378 1s 2024-02-18T10:27:05.837 INFO:teuthology.orchestra.run.smithi204.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:06.289 INFO:teuthology.orchestra.run.smithi204.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:06.702 INFO:teuthology.orchestra.run.smithi204.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:07.138 INFO:teuthology.orchestra.run.smithi204.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:07.588 INFO:teuthology.orchestra.run.smithi204.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:08.033 INFO:teuthology.orchestra.run.smithi204.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:08.475 INFO:teuthology.orchestra.run.smithi204.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:08.901 INFO:teuthology.orchestra.run.smithi204.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:09.331 INFO:teuthology.orchestra.run.smithi204.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-02-18T10:27:09.813 INFO:teuthology.orchestra.run.smithi204.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:27:10.434 INFO:teuthology.orchestra.run.smithi204.stdout:generic/392 [not run] ceph does not support shutdown 2024-02-18T10:27:11.971 INFO:teuthology.orchestra.run.smithi204.stdout:generic/393 1s 2024-02-18T10:27:12.568 INFO:teuthology.orchestra.run.smithi204.stdout:generic/394 1s 2024-02-18T10:27:13.144 INFO:teuthology.orchestra.run.smithi204.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:27:13.720 INFO:teuthology.orchestra.run.smithi204.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:27:14.329 INFO:teuthology.orchestra.run.smithi204.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:27:14.933 INFO:teuthology.orchestra.run.smithi204.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:27:15.348 INFO:teuthology.orchestra.run.smithi204.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:27:16.385 INFO:teuthology.orchestra.run.smithi204.stdout:generic/401 1s 2024-02-18T10:27:17.133 INFO:teuthology.orchestra.run.smithi204.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-02-18T10:27:18.560 INFO:teuthology.orchestra.run.smithi204.stdout:generic/403 1s 2024-02-18T10:27:19.075 INFO:teuthology.orchestra.run.smithi204.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:27:22.490 INFO:teuthology.orchestra.run.smithi204.stdout:generic/406 3s 2024-02-18T10:27:23.088 INFO:teuthology.orchestra.run.smithi204.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:27:23.607 INFO:teuthology.orchestra.run.smithi204.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:27:24.088 INFO:teuthology.orchestra.run.smithi204.stdout:generic/409 [not run] require 172.21.15.118:6789:/scratch to be local device 2024-02-18T10:27:24.555 INFO:teuthology.orchestra.run.smithi204.stdout:generic/410 [not run] require 172.21.15.118:6789:/scratch to be local device 2024-02-18T10:27:25.001 INFO:teuthology.orchestra.run.smithi204.stdout:generic/411 [not run] require 172.21.15.118:6789:/scratch to be local device 2024-02-18T10:27:26.211 INFO:teuthology.orchestra.run.smithi204.stdout:generic/412 - output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/412.out.bad) 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: --- tests/generic/412.out 2024-02-18 10:01:38.880992902 +0000 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/412.out.bad 2024-02-18 10:27:26.206923311 +0000 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: @@ -4,6 +4,6 @@ 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: wrote 32768/32768 bytes at offset 65536 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: File digest before unmounting the filesystem: 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: -3c5ca3c3ab42f4b04d7e7eb0b0d4d806 SCRATCH_MNT/foo 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: +84c48b8da7e9b9d3c5667ad9819debd9 SCRATCH_MNT/foo 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: File digest after mounting again the filesystem: 2024-02-18T10:27:26.220 INFO:teuthology.orchestra.run.smithi204.stdout: -3c5ca3c3ab42f4b04d7e7eb0b0d4d806 SCRATCH_MNT/foo 2024-02-18T10:27:26.221 INFO:teuthology.orchestra.run.smithi204.stdout: +84c48b8da7e9b9d3c5667ad9819debd9 SCRATCH_MNT/foo 2024-02-18T10:27:26.866 INFO:teuthology.orchestra.run.smithi204.stdout:generic/413 [not run] mount 172.21.15.118:6789:/scratch with dax failed 2024-02-18T10:27:27.635 INFO:teuthology.orchestra.run.smithi204.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:27:28.268 INFO:teuthology.orchestra.run.smithi204.stdout:generic/417 [not run] ceph does not support shutdown 2024-02-18T10:27:28.908 INFO:teuthology.orchestra.run.smithi204.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:27:33.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:27:33.244 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:27:33.247 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:27:34.822 INFO:teuthology.orchestra.run.smithi204.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:27:35.402 INFO:teuthology.orchestra.run.smithi204.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:27:35.881 INFO:teuthology.orchestra.run.smithi204.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-18T10:27:36.491 INFO:teuthology.orchestra.run.smithi204.stdout:generic/423 1s 2024-02-18T10:27:36.950 INFO:teuthology.orchestra.run.smithi204.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-02-18T10:27:37.491 INFO:teuthology.orchestra.run.smithi204.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-02-18T10:27:59.951 INFO:teuthology.orchestra.run.smithi204.stdout:generic/426 22s 2024-02-18T10:28:00.982 INFO:teuthology.orchestra.run.smithi204.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-18T10:28:01.510 INFO:teuthology.orchestra.run.smithi204.stdout:generic/428 0s 2024-02-18T10:28:02.162 INFO:teuthology.orchestra.run.smithi204.stdout:generic/430 1s 2024-02-18T10:28:02.773 INFO:teuthology.orchestra.run.smithi204.stdout:generic/431 0s 2024-02-18T10:28:03.369 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:28:03.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:28:03.375 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:28:03.446 INFO:teuthology.orchestra.run.smithi204.stdout:generic/432 1s 2024-02-18T10:28:03.998 INFO:teuthology.orchestra.run.smithi204.stdout:generic/433 0s 2024-02-18T10:28:04.630 INFO:teuthology.orchestra.run.smithi204.stdout:generic/434 0s 2024-02-18T10:28:05.286 INFO:teuthology.orchestra.run.smithi204.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:28:06.623 INFO:teuthology.orchestra.run.smithi204.stdout:generic/437 1s 2024-02-18T10:28:15.436 INFO:teuthology.orchestra.run.smithi204.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:28:16.010 INFO:teuthology.orchestra.run.smithi204.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:28:16.555 INFO:teuthology.orchestra.run.smithi204.stdout:generic/441 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:28:17.042 INFO:teuthology.orchestra.run.smithi204.stdout:generic/443 1s 2024-02-18T10:28:17.658 INFO:teuthology.orchestra.run.smithi204.stdout:generic/444 0s 2024-02-18T10:28:18.304 INFO:teuthology.orchestra.run.smithi204.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:28:27.099 INFO:teuthology.orchestra.run.smithi204.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:28:27.948 INFO:teuthology.orchestra.run.smithi204.stdout:generic/448 0s 2024-02-18T10:28:28.449 INFO:teuthology.orchestra.run.smithi204.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-18T10:28:34.108 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:28:34.110 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:28:34.113 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:28:35.336 INFO:teuthology.orchestra.run.smithi204.stdout:generic/450 7s 2024-02-18T10:29:04.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:29:04.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:29:04.256 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:29:05.912 INFO:teuthology.orchestra.run.smithi204.stdout:generic/451 30s 2024-02-18T10:29:07.622 INFO:teuthology.orchestra.run.smithi204.stdout:generic/452 2s 2024-02-18T10:29:08.103 INFO:teuthology.orchestra.run.smithi204.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-02-18T10:29:08.575 INFO:teuthology.orchestra.run.smithi204.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-02-18T10:29:09.090 INFO:teuthology.orchestra.run.smithi204.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:29:09.864 INFO:teuthology.orchestra.run.smithi204.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:29:34.420 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:29:34.672 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:29:34.676 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:30:05.500 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:30:05.503 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:30:05.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:30:35.782 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:30:35.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:30:35.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:31:06.069 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:31:06.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:31:06.076 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:31:36.576 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:31:36.579 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:31:36.581 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:32:06.955 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:32:06.960 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:32:06.962 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:32:07.006 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-02-18T10:32:07.002+0000 7fbae34e8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50616) UID: 0 2024-02-18T10:32:07.007 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-02-18T10:32:07.002+0000 7f995c07d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50616) UID: 0 2024-02-18T10:32:07.007 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-02-18T10:32:07.002+0000 7f6720ebb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50616) UID: 0 2024-02-18T10:32:07.007 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-02-18T10:32:07.002+0000 7f0bf41a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50616) UID: 0 2024-02-18T10:33:30.709 INFO:teuthology.orchestra.run.smithi204.stdout:generic/460 261s 2024-02-18T10:33:31.364 INFO:teuthology.orchestra.run.smithi204.stdout:generic/462 [not run] mount 172.21.15.118:6789:/scratch with dax failed 2024-02-18T10:33:31.937 INFO:teuthology.orchestra.run.smithi204.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:33:38.242 INFO:teuthology.orchestra.run.smithi204.stdout:generic/465 7s 2024-02-18T10:33:38.746 INFO:teuthology.orchestra.run.smithi204.stdout:generic/466 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:33:41.358 INFO:teuthology.orchestra.run.smithi204.stdout:generic/467 3s 2024-02-18T10:33:43.170 INFO:teuthology.orchestra.run.smithi204.stdout:generic/468 [not run] ceph does not support shutdown 2024-02-18T10:33:43.639 INFO:teuthology.orchestra.run.smithi204.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-18T10:33:44.202 INFO:teuthology.orchestra.run.smithi204.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-02-18T10:34:22.778 INFO:teuthology.orchestra.run.smithi204.stdout:generic/471 38s 2024-02-18T10:34:23.675 INFO:teuthology.orchestra.run.smithi204.stdout:generic/472 [not run] swapfiles are not supported 2024-02-18T10:34:24.329 INFO:teuthology.orchestra.run.smithi204.stdout:generic/474 [not run] ceph does not support shutdown 2024-02-18T10:34:30.484 INFO:teuthology.orchestra.run.smithi204.stdout:generic/477 6s 2024-02-18T10:34:42.817 INFO:teuthology.orchestra.run.smithi204.stdout:generic/478 12s 2024-02-18T10:34:43.420 INFO:teuthology.orchestra.run.smithi204.stdout:generic/479 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:43.910 INFO:teuthology.orchestra.run.smithi204.stdout:generic/480 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:44.369 INFO:teuthology.orchestra.run.smithi204.stdout:generic/481 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:44.821 INFO:teuthology.orchestra.run.smithi204.stdout:generic/483 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:45.312 INFO:teuthology.orchestra.run.smithi204.stdout:generic/484 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:45.792 INFO:teuthology.orchestra.run.smithi204.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-18T10:34:47.557 INFO:teuthology.orchestra.run.smithi204.stdout:generic/486 2s 2024-02-18T10:34:48.075 INFO:teuthology.orchestra.run.smithi204.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-02-18T10:34:48.501 INFO:teuthology.orchestra.run.smithi204.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-02-18T10:34:48.966 INFO:teuthology.orchestra.run.smithi204.stdout:generic/489 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:49.795 INFO:teuthology.orchestra.run.smithi204.stdout:generic/490 1s 2024-02-18T10:34:50.290 INFO:teuthology.orchestra.run.smithi204.stdout:generic/491 [not run] ceph does not support freezing 2024-02-18T10:34:50.754 INFO:teuthology.orchestra.run.smithi204.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-02-18T10:34:51.579 INFO:teuthology.orchestra.run.smithi204.stdout:generic/493 [not run] swapfiles are not supported 2024-02-18T10:34:52.342 INFO:teuthology.orchestra.run.smithi204.stdout:generic/494 [not run] swapfiles are not supported 2024-02-18T10:34:53.098 INFO:teuthology.orchestra.run.smithi204.stdout:generic/495 [not run] swapfiles are not supported 2024-02-18T10:34:53.811 INFO:teuthology.orchestra.run.smithi204.stdout:generic/496 [not run] swapfiles are not supported 2024-02-18T10:34:54.541 INFO:teuthology.orchestra.run.smithi204.stdout:generic/497 [not run] swapfiles are not supported 2024-02-18T10:34:55.045 INFO:teuthology.orchestra.run.smithi204.stdout:generic/498 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:55.501 INFO:teuthology.orchestra.run.smithi204.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-18T10:34:56.268 INFO:teuthology.orchestra.run.smithi204.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:34:56.756 INFO:teuthology.orchestra.run.smithi204.stdout:generic/502 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:34:57.206 INFO:teuthology.orchestra.run.smithi204.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:34:57.735 INFO:teuthology.orchestra.run.smithi204.stdout:generic/504 0s 2024-02-18T10:34:58.339 INFO:teuthology.orchestra.run.smithi204.stdout:generic/505 [not run] ceph does not support shutdown 2024-02-18T10:34:58.784 INFO:teuthology.orchestra.run.smithi204.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:34:59.287 INFO:teuthology.orchestra.run.smithi204.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-02-18T10:34:59.728 INFO:teuthology.orchestra.run.smithi204.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-02-18T10:35:00.206 INFO:teuthology.orchestra.run.smithi204.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-02-18T10:35:00.700 INFO:teuthology.orchestra.run.smithi204.stdout:generic/510 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:35:01.149 INFO:teuthology.orchestra.run.smithi204.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-02-18T10:35:01.648 INFO:teuthology.orchestra.run.smithi204.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:35:02.456 INFO:teuthology.orchestra.run.smithi204.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:35:03.270 INFO:teuthology.orchestra.run.smithi204.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:35:04.078 INFO:teuthology.orchestra.run.smithi204.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:35:04.576 INFO:teuthology.orchestra.run.smithi204.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-02-18T10:35:05.250 INFO:teuthology.orchestra.run.smithi204.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-18T10:35:06.209 INFO:teuthology.orchestra.run.smithi204.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:35:06.686 INFO:teuthology.orchestra.run.smithi204.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-02-18T10:35:07.158 INFO:teuthology.orchestra.run.smithi204.stdout:generic/520 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:35:08.350 INFO:teuthology.orchestra.run.smithi204.stdout:generic/523 1s 2024-02-18T10:37:47.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:37:47.058 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:37:47.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:37:49.221 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-02-18T10:37:49.110+0000 7f51612b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45552) UID: 0 2024-02-18T10:37:49.222 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-02-18T10:37:49.110+0000 7fc841767640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45552) UID: 0 2024-02-18T10:37:49.222 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-02-18T10:37:49.110+0000 7f808380b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45552) UID: 0 2024-02-18T10:37:49.223 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-02-18T10:37:49.111+0000 7f2176e00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45552) UID: 0 2024-02-18T10:38:12.865 INFO:teuthology.orchestra.run.smithi204.stdout:generic/524 184s 2024-02-18T10:38:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:generic/525 [not run] filesystem does not support huge file size 2024-02-18T10:38:14.092 INFO:teuthology.orchestra.run.smithi204.stdout:generic/526 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:38:14.557 INFO:teuthology.orchestra.run.smithi204.stdout:generic/527 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:38:15.147 INFO:teuthology.orchestra.run.smithi204.stdout:generic/528 1s 2024-02-18T10:38:16.213 INFO:teuthology.orchestra.run.smithi204.stdout:generic/529 1s 2024-02-18T10:38:16.892 INFO:teuthology.orchestra.run.smithi204.stdout:generic/530 [not run] ceph does not support shutdown 2024-02-18T10:38:17.328 INFO:teuthology.orchestra.run.smithi204.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-02-18T10:38:17.835 INFO:teuthology.orchestra.run.smithi204.stdout:generic/532 0s 2024-02-18T10:38:18.888 INFO:teuthology.orchestra.run.smithi204.stdout:generic/533 1s 2024-02-18T10:38:19.309 INFO:teuthology.orchestra.run.smithi204.stdout:generic/534 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:38:19.775 INFO:teuthology.orchestra.run.smithi204.stdout:generic/535 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:38:20.398 INFO:teuthology.orchestra.run.smithi204.stdout:generic/536 [not run] ceph does not support shutdown 2024-02-18T10:38:21.038 INFO:teuthology.orchestra.run.smithi204.stdout:generic/537 [not run] FSTRIM not supported 2024-02-18T10:45:47.793 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:45:47.797 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:45:47.799 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:46:17.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:46:17.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:46:17.956 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:46:48.124 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:46:48.128 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:46:48.131 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:47:18.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:47:18.266 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:47:18.268 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:47:48.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:47:48.396 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:47:48.399 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:48:18.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:48:18.526 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:48:18.529 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:48:48.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:48:48.768 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:48:48.770 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:49:18.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:49:18.904 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:49:18.907 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:49:49.038 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:49:49.042 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:49:49.044 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:50:19.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:50:19.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:50:19.180 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:50:49.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:50:49.323 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:50:49.326 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:51:19.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:51:19.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:51:19.498 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:51:49.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:51:49.621 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:51:49.623 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:52:19.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:52:19.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:52:19.761 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:52:24.815 INFO:teuthology.orchestra.run.smithi204.stdout:generic/538 843s 2024-02-18T10:52:34.724 INFO:teuthology.orchestra.run.smithi204.stdout:generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:52:35.503 INFO:teuthology.orchestra.run.smithi204.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:52:36.268 INFO:teuthology.orchestra.run.smithi204.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:52:37.021 INFO:teuthology.orchestra.run.smithi204.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:52:37.782 INFO:teuthology.orchestra.run.smithi204.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:52:38.529 INFO:teuthology.orchestra.run.smithi204.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:52:39.019 INFO:teuthology.orchestra.run.smithi204.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-02-18T10:52:39.505 INFO:teuthology.orchestra.run.smithi204.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:52:40.018 INFO:teuthology.orchestra.run.smithi204.stdout:generic/547 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:52:40.603 INFO:teuthology.orchestra.run.smithi204.stdout:generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:52:41.224 INFO:teuthology.orchestra.run.smithi204.stdout:generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:52:41.816 INFO:teuthology.orchestra.run.smithi204.stdout:generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:52:42.331 INFO:teuthology.orchestra.run.smithi204.stdout:generic/552 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:52:42.888 INFO:teuthology.orchestra.run.smithi204.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-02-18T10:52:43.692 INFO:teuthology.orchestra.run.smithi204.stdout:generic/554 [not run] swapfiles are not supported 2024-02-18T10:52:44.181 INFO:teuthology.orchestra.run.smithi204.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-02-18T10:52:44.624 INFO:teuthology.orchestra.run.smithi204.stdout:generic/556 [not run] ceph does not support casefold feature 2024-02-18T10:52:45.104 INFO:teuthology.orchestra.run.smithi204.stdout:generic/557 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:52:45.598 INFO:teuthology.orchestra.run.smithi204.stdout:generic/563 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:52:46.385 INFO:teuthology.orchestra.run.smithi204.stdout:generic/564 1s 2024-02-18T10:52:47.304 INFO:teuthology.orchestra.run.smithi204.stdout:generic/565 1s 2024-02-18T10:52:47.711 INFO:teuthology.orchestra.run.smithi204.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:52:49.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:52:49.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:52:49.882 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:52:54.883 INFO:teuthology.orchestra.run.smithi204.stdout:generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T10:52:55.320 INFO:teuthology.orchestra.run.smithi204.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:52:55.788 INFO:teuthology.orchestra.run.smithi204.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:52:56.219 INFO:teuthology.orchestra.run.smithi204.stdout:generic/570 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:52:56.671 INFO:teuthology.orchestra.run.smithi204.stdout:generic/571 [not run] Require fcntl setlease support 2024-02-18T10:52:57.123 INFO:teuthology.orchestra.run.smithi204.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-02-18T10:52:57.562 INFO:teuthology.orchestra.run.smithi204.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-02-18T10:52:57.999 INFO:teuthology.orchestra.run.smithi204.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-02-18T10:52:58.432 INFO:teuthology.orchestra.run.smithi204.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-02-18T10:52:58.973 INFO:teuthology.orchestra.run.smithi204.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-02-18T10:52:59.399 INFO:teuthology.orchestra.run.smithi204.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-02-18T10:52:59.890 INFO:teuthology.orchestra.run.smithi204.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-02-18T10:53:00.470 INFO:teuthology.orchestra.run.smithi204.stdout:generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:01.737 INFO:teuthology.orchestra.run.smithi204.stdout:generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:02.310 INFO:teuthology.orchestra.run.smithi204.stdout:generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:02.892 INFO:teuthology.orchestra.run.smithi204.stdout:generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:03.472 INFO:teuthology.orchestra.run.smithi204.stdout:generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:04.016 INFO:teuthology.orchestra.run.smithi204.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T10:53:04.514 INFO:teuthology.orchestra.run.smithi204.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:53:05.313 INFO:teuthology.orchestra.run.smithi204.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:53:05.904 INFO:teuthology.orchestra.run.smithi204.stdout:generic/591 0s 2024-02-18T10:53:06.510 INFO:teuthology.orchestra.run.smithi204.stdout:generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:07.106 INFO:teuthology.orchestra.run.smithi204.stdout:generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:07.537 INFO:teuthology.orchestra.run.smithi204.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:53:08.049 INFO:teuthology.orchestra.run.smithi204.stdout:generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:08.544 INFO:teuthology.orchestra.run.smithi204.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-02-18T10:53:09.835 INFO:teuthology.orchestra.run.smithi204.stdout:generic/597 1s 2024-02-18T10:53:11.280 INFO:teuthology.orchestra.run.smithi204.stdout:generic/598 2s 2024-02-18T10:53:11.903 INFO:teuthology.orchestra.run.smithi204.stdout:generic/599 [not run] ceph does not support shutdown 2024-02-18T10:53:12.341 INFO:teuthology.orchestra.run.smithi204.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:53:12.793 INFO:teuthology.orchestra.run.smithi204.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:53:13.367 INFO:teuthology.orchestra.run.smithi204.stdout:generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:13.824 INFO:teuthology.orchestra.run.smithi204.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T10:53:19.185 INFO:teuthology.orchestra.run.smithi204.stdout:generic/604 6s 2024-02-18T10:53:20.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:53:20.141 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:53:20.143 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:53:21.115 INFO:teuthology.orchestra.run.smithi204.stdout:generic/605 [not run] mount 172.21.15.118:6789:/scratch with dax=always failed 2024-02-18T10:53:21.628 INFO:teuthology.orchestra.run.smithi204.stdout:generic/606 [not run] mount 172.21.15.118:6789:/scratch with dax=always failed 2024-02-18T10:53:22.093 INFO:teuthology.orchestra.run.smithi204.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-02-18T10:53:22.615 INFO:teuthology.orchestra.run.smithi204.stdout:generic/608 [not run] mount 172.21.15.118:6789:/scratch with dax=always failed 2024-02-18T10:53:23.295 INFO:teuthology.orchestra.run.smithi204.stdout:generic/609 1s 2024-02-18T10:53:31.070 INFO:teuthology.orchestra.run.smithi204.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-18T10:53:32.153 INFO:teuthology.orchestra.run.smithi204.stdout:generic/611 1s 2024-02-18T10:53:32.723 INFO:teuthology.orchestra.run.smithi204.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T10:53:33.359 INFO:teuthology.orchestra.run.smithi204.stdout:generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:34.007 INFO:teuthology.orchestra.run.smithi204.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-02-18T10:53:35.063 INFO:teuthology.orchestra.run.smithi204.stdout:generic/618 1s 2024-02-18T10:53:35.659 INFO:teuthology.orchestra.run.smithi204.stdout:generic/620 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:53:36.317 INFO:teuthology.orchestra.run.smithi204.stdout:generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T10:53:36.937 INFO:teuthology.orchestra.run.smithi204.stdout:generic/623 [not run] ceph does not support shutdown 2024-02-18T10:53:37.367 INFO:teuthology.orchestra.run.smithi204.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-02-18T10:53:37.813 INFO:teuthology.orchestra.run.smithi204.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-02-18T10:53:38.275 INFO:teuthology.orchestra.run.smithi204.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-02-18T10:53:39.062 INFO:teuthology.orchestra.run.smithi204.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:53:39.564 INFO:teuthology.orchestra.run.smithi204.stdout:generic/629 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:53:40.260 INFO:teuthology.orchestra.run.smithi204.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-18T10:53:42.264 INFO:teuthology.orchestra.run.smithi204.stdout:generic/632 2s 2024-02-18T10:53:44.271 INFO:teuthology.orchestra.run.smithi204.stdout:generic/633 2s 2024-02-18T10:53:46.858 INFO:teuthology.orchestra.run.smithi204.stdout:generic/634 2s 2024-02-18T10:53:47.548 INFO:teuthology.orchestra.run.smithi204.stdout:generic/635 [not run] ceph does not support shutdown 2024-02-18T10:53:48.293 INFO:teuthology.orchestra.run.smithi204.stdout:generic/636 [not run] swapfiles are not supported 2024-02-18T10:53:49.319 INFO:teuthology.orchestra.run.smithi204.stdout:generic/637 1s 2024-02-18T10:53:49.794 INFO:teuthology.orchestra.run.smithi204.stdout:generic/638 0s 2024-02-18T10:53:50.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:53:50.290 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:53:50.294 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:53:50.605 INFO:teuthology.orchestra.run.smithi204.stdout:generic/639 1s 2024-02-18T10:53:51.064 INFO:teuthology.orchestra.run.smithi204.stdout:generic/640 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T10:53:51.787 INFO:teuthology.orchestra.run.smithi204.stdout:generic/641 [not run] swapfiles are not supported 2024-02-18T10:53:52.310 INFO:teuthology.orchestra.run.smithi204.stdout:generic/644 1s 2024-02-18T10:54:20.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:54:20.551 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:54:20.554 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:54:50.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:54:51.425 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:54:51.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:55:21.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:55:21.559 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:55:21.564 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:55:51.823 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:55:51.826 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:55:51.828 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:55:51.877 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-02-18T10:55:51.875+0000 7fd71beff640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51043) UID: 0 2024-02-18T10:55:51.877 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-02-18T10:55:51.875+0000 7ff644cb2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51043) UID: 0 2024-02-18T10:55:53.775 INFO:teuthology.orchestra.run.smithi204.stdout:generic/645 121s 2024-02-18T10:55:54.521 INFO:teuthology.orchestra.run.smithi204.stdout:generic/646 [not run] ceph does not support shutdown 2024-02-18T10:55:55.333 INFO:teuthology.orchestra.run.smithi204.stdout:generic/647 1s 2024-02-18T10:55:56.138 INFO:teuthology.orchestra.run.smithi204.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:55:56.895 INFO:teuthology.orchestra.run.smithi204.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:55:57.664 INFO:teuthology.orchestra.run.smithi204.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:55:58.532 INFO:teuthology.orchestra.run.smithi204.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:55:59.278 INFO:teuthology.orchestra.run.smithi204.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:00.086 INFO:teuthology.orchestra.run.smithi204.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:00.832 INFO:teuthology.orchestra.run.smithi204.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:01.597 INFO:teuthology.orchestra.run.smithi204.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:02.343 INFO:teuthology.orchestra.run.smithi204.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:03.100 INFO:teuthology.orchestra.run.smithi204.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:03.860 INFO:teuthology.orchestra.run.smithi204.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:04.628 INFO:teuthology.orchestra.run.smithi204.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:05.400 INFO:teuthology.orchestra.run.smithi204.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:06.160 INFO:teuthology.orchestra.run.smithi204.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:06.929 INFO:teuthology.orchestra.run.smithi204.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:07.687 INFO:teuthology.orchestra.run.smithi204.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:08.442 INFO:teuthology.orchestra.run.smithi204.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:09.202 INFO:teuthology.orchestra.run.smithi204.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:10.293 INFO:teuthology.orchestra.run.smithi204.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:56:11.058 INFO:teuthology.orchestra.run.smithi204.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-02-18T10:56:11.969 INFO:teuthology.orchestra.run.smithi204.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T10:58:27.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:58:27.586 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:58:27.589 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:58:57.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:58:57.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:58:57.760 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:59:27.890 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:59:27.894 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:59:27.896 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T10:59:28.030 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-02-18T10:59:28.029+0000 7fd71beff640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51100) UID: 0 2024-02-18T10:59:28.031 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-02-18T10:59:28.029+0000 7ff644cb2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51100) UID: 0 2024-02-18T11:01:43.889 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:01:43.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:01:43.895 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:02:14.039 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:02:14.042 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:02:14.045 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:02:44.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:02:44.344 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:02:44.347 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:03:14.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:03:14.496 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:03:14.498 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:03:14.524 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-02-18T11:03:14.522+0000 7fd71beff640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51188) UID: 0 2024-02-18T11:03:14.524 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-02-18T11:03:14.522+0000 7ff644cb2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51188) UID: 0 2024-02-18T11:05:42.131 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:05:42.135 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:05:42.137 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:06:12.380 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:06:12.383 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:06:12.386 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:06:42.534 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:06:42.538 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:06:42.541 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:06:42.567 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-02-18T11:06:42.566+0000 7fd71beff640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51247) UID: 0 2024-02-18T11:06:42.567 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-02-18T11:06:42.566+0000 7ff644cb2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51247) UID: 0 2024-02-18T11:09:01.253 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:09:01.256 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:09:01.259 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:09:25.218 INFO:teuthology.orchestra.run.smithi204.stdout:generic/676 793s 2024-02-18T11:09:25.695 INFO:teuthology.orchestra.run.smithi204.stdout:generic/677 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T11:09:26.243 INFO:teuthology.orchestra.run.smithi204.stdout:generic/678 [not run] kernel does not support IO_URING 2024-02-18T11:09:26.703 INFO:teuthology.orchestra.run.smithi204.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T11:09:27.666 INFO:teuthology.orchestra.run.smithi204.stdout:generic/680 1s 2024-02-18T11:09:28.118 INFO:teuthology.orchestra.run.smithi204.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T11:09:28.548 INFO:teuthology.orchestra.run.smithi204.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-02-18T11:09:29.096 INFO:teuthology.orchestra.run.smithi204.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T11:09:31.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:09:31.418 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:09:31.420 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:09:41.153 INFO:teuthology.orchestra.run.smithi204.stdout:generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2024-02-18T11:09:50.332 INFO:teuthology.orchestra.run.smithi204.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-02-18T11:10:00.100 INFO:teuthology.orchestra.run.smithi204.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-02-18T11:10:01.663 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:10:01.667 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:10:01.670 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:10:06.251 INFO:teuthology.orchestra.run.smithi204.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-02-18T11:10:06.786 INFO:teuthology.orchestra.run.smithi204.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T11:10:07.378 INFO:teuthology.orchestra.run.smithi204.stdout:generic/689 1s 2024-02-18T11:10:07.879 INFO:teuthology.orchestra.run.smithi204.stdout:generic/690 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T11:10:08.377 INFO:teuthology.orchestra.run.smithi204.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-02-18T11:10:08.962 INFO:teuthology.orchestra.run.smithi204.stdout:generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T11:10:09.430 INFO:teuthology.orchestra.run.smithi204.stdout:generic/695 [not run] require 172.21.15.118:6789:/scratch to be valid block disk 2024-02-18T11:10:10.368 INFO:teuthology.orchestra.run.smithi204.stdout:generic/696 1s 2024-02-18T11:10:11.023 INFO:teuthology.orchestra.run.smithi204.stdout:generic/697 1s 2024-02-18T11:10:12.799 INFO:teuthology.orchestra.run.smithi204.stdout:generic/698 1s 2024-02-18T11:10:13.931 INFO:teuthology.orchestra.run.smithi204.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2024-02-18T11:10:14.435 INFO:teuthology.orchestra.run.smithi204.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-02-18T11:10:15.224 INFO:teuthology.orchestra.run.smithi204.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-02-18T11:10:15.752 INFO:teuthology.orchestra.run.smithi204.stdout:generic/703 [not run] kernel does not support IO_URING 2024-02-18T11:10:16.265 INFO:teuthology.orchestra.run.smithi204.stdout:generic/704 [not run] require 172.21.15.118:6789:/test to be valid block disk 2024-02-18T11:10:17.072 INFO:teuthology.orchestra.run.smithi204.stdout:generic/706 1s 2024-02-18T11:10:17.688 INFO:teuthology.orchestra.run.smithi204.stdout:generic/708 0s 2024-02-18T11:10:18.148 INFO:teuthology.orchestra.run.smithi204.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:18.635 INFO:teuthology.orchestra.run.smithi204.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:19.129 INFO:teuthology.orchestra.run.smithi204.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:19.614 INFO:teuthology.orchestra.run.smithi204.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:20.117 INFO:teuthology.orchestra.run.smithi204.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-02-18T11:10:20.607 INFO:teuthology.orchestra.run.smithi204.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:21.092 INFO:teuthology.orchestra.run.smithi204.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-02-18T11:10:21.568 INFO:teuthology.orchestra.run.smithi204.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:22.069 INFO:teuthology.orchestra.run.smithi204.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:22.553 INFO:teuthology.orchestra.run.smithi204.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:23.044 INFO:teuthology.orchestra.run.smithi204.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:23.526 INFO:teuthology.orchestra.run.smithi204.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:23.992 INFO:teuthology.orchestra.run.smithi204.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-02-18T11:10:24.494 INFO:teuthology.orchestra.run.smithi204.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-18T11:10:24.982 INFO:teuthology.orchestra.run.smithi204.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-02-18T11:10:25.443 INFO:teuthology.orchestra.run.smithi204.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-18T11:10:25.924 INFO:teuthology.orchestra.run.smithi204.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-18T11:10:26.735 INFO:teuthology.orchestra.run.smithi204.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-18T11:10:27.329 INFO:teuthology.orchestra.run.smithi204.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-02-18T11:10:31.902 INFO:teuthology.orchestra.run.smithi204.stdout:generic/728 4s 2024-02-18T11:10:32.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:10:32.106 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:10:32.108 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:10:32.572 INFO:teuthology.orchestra.run.smithi204.stdout:generic/729 1s 2024-02-18T11:10:32.955 INFO:teuthology.orchestra.run.smithi204.stdout:generic/730 [not run] require 172.21.15.118:6789:/test to be valid block disk 2024-02-18T11:10:33.353 INFO:teuthology.orchestra.run.smithi204.stdout:generic/731 [not run] require 172.21.15.118:6789:/test to be valid block disk 2024-02-18T11:10:34.469 INFO:teuthology.orchestra.run.smithi204.stdout:generic/732 1s 2024-02-18T11:10:34.970 INFO:teuthology.orchestra.run.smithi204.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-02-18T11:10:35.478 INFO:teuthology.orchestra.run.smithi204.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-02-18T11:11:02.219 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:11:02.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:11:02.225 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:11:31.384 INFO:teuthology.orchestra.run.smithi204.stdout:generic/736 56s 2024-02-18T11:11:32.052 INFO:teuthology.orchestra.run.smithi204.stdout:generic/737 [not run] ceph does not support shutdown 2024-02-18T11:11:32.513 INFO:teuthology.orchestra.run.smithi204.stdout:generic/738 [not run] ceph does not support freezing 2024-02-18T11:11:32.624 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:11:32.627 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:11:32.629 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-18T11:11:32.659 INFO:tasks.ceph.mds.c.smithi118.stderr:2024-02-18T11:11:32.658+0000 7ff644cb2640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51365) UID: 0 2024-02-18T11:11:32.659 INFO:tasks.ceph.mds.a.smithi118.stderr:2024-02-18T11:11:32.658+0000 7fd71beff640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51365) UID: 0 2024-02-18T11:11:33.058 INFO:teuthology.orchestra.run.smithi204.stdout:generic/739 [not run] mount option "test_dummy_encryption" not allowed in this test 2024-02-18T11:11:33.464 INFO:teuthology.orchestra.run.smithi204.stdout:shared/002 [not run] not suitable for this filesystem type: ceph 2024-02-18T11:11:33.817 INFO:teuthology.orchestra.run.smithi204.stdout:shared/032 [not run] not suitable for this filesystem type: ceph 2024-02-18T11:11:33.837 INFO:teuthology.orchestra.run.smithi204.stdout:Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 generic/734 generic/735 generic/736 generic/737 generic/738 generic/739 shared/002 shared/032 2024-02-18T11:11:33.838 INFO:teuthology.orchestra.run.smithi204.stdout:Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/014 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/129 generic/130 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/240 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 generic/734 generic/735 generic/737 generic/738 generic/739 shared/002 shared/032 2024-02-18T11:11:33.838 INFO:teuthology.orchestra.run.smithi204.stdout:Failures: generic/029 generic/075 generic/091 generic/098 generic/112 generic/198 generic/263 generic/412 2024-02-18T11:11:33.838 INFO:teuthology.orchestra.run.smithi204.stdout:Failed 8 of 604 tests 2024-02-18T11:11:33.859 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-02-18T11:11:33.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T11:11:33.903 INFO:tasks.cephfs.test_fscrypt:Command failed. 2024-02-18T11:11:33.903 INFO:tasks.cephfs.test_fscrypt:Command return value: 1 2024-02-18T11:11:33.903 INFO:tasks.cephfs.test_fscrypt:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi204 6.8.0-rc4-g8d59ab0bd93c #1 SMP PREEMPT_DYNAMIC Tue Feb 13 11:16:44 UTC 2024 MKFS_OPTIONS -- 172.21.15.118:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQAf1dFlF/iuDBAAjtOPYBhtZeQTg1evA2AL/Q==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.118:6789:/scratch /tmp/tmp.w8GvOpYWfNscratch ceph/001 [expunged] ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/004 0s ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test generic/001 10s generic/002 1s generic/003 [not run] atime not maintained by ceph generic/004 [not run] O_TMPFILE is not supported generic/005 0s generic/006 21s generic/007 47s generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/011 29s generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/013 36s generic/014 [not run] Sparse files are not supported or do not work as expected generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/018 [not run] defragmentation not supported for fstype "ceph" generic/020 9s generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/023 2s generic/024 [not run] kernel doesn't support renameat2 syscall generic/025 [not run] kernel doesn't support renameat2 syscall generic/026 [not run] ceph does not define maximum ACL count generic/028 5s generic/029 - output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/029.out.bad) --- tests/generic/029.out 2024-02-18 10:01:38.818993763 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/029.out.bad 2024-02-18 10:11:04.937060640 +0000 @@ -2,13 +2,13 @@ wrote 5120/5120 bytes at offset 0 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) ==== Pre-Remount === -000000 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 >XXXXXXXXXXXXXXXX< +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< * 000800 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 >YYYYYYYYYYYYYYYY< * 001400 ==== Post-Remount == -000000 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 58 >XXXXXXXXXXXXXXXX< +000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 >................< * 000800 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 59 >YYYYYYYYYYYYYYYY< * generic/030 5s generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/034 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/035 1s generic/037 7s generic/039 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/040 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/041 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/042 [not run] ceph does not support shutdown generic/050 [not run] ceph does not support shutdown generic/052 [not run] ceph does not support shutdown generic/053 1s generic/056 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/057 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/059 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/062 2s generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/065 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/066 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/067 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/069 20s generic/070 10s generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/073 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/075 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.out.bad) --- tests/generic/075.out 2024-02-18 10:01:38.825993666 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.out.bad 2024-02-18 10:12:17.531038759 +0000 @@ -4,15 +4,5 @@ ----------------------------------------------- fsx.0 : -d -N numops -S 0 ----------------------------------------------- - ------------------------------------------------ -fsx.1 : -d -N numops -S 0 -x ------------------------------------------------ - ------------------------------------------------ -fsx.2 : -d -N numops -l filelen -S 0 ------------------------------------------------ - ------------------------------------------------ -fsx.3 : -d -N numops -l filelen -S 0 -x ------------------------------------------------ + fsx (-d -N 1000 -S 0) failed, 0 - compare /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.0.{good,bad,fsxlog} +mv: '/tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.0.fsxlog' and '/tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/075.0.fsxlog' are the same file generic/076 [not run] require 172.21.15.118:6789:/scratch to be local device generic/078 [not run] kernel doesn't support renameat2 syscall generic/079 [not run] file system doesn't support chattr +ia generic/080 3s generic/081 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/082 [not run] disk quotas not supported by this filesystem type: ceph generic/084 6s generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/087 1s generic/088 0s generic/090 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/091 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/091.out.bad) --- tests/generic/091.out 2024-02-18 10:01:38.828993624 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/091.out.bad 2024-02-18 10:13:09.431308184 +0000 @@ -5,3 +5,322 @@ fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W fsx -N 10000 -o 32768 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -R -W fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -W +mapped writes DISABLED +Seed set to 1 +main: filesystem does not support fallocate mode 0, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_PUNCH_HOLE | FALLOC_FL_KEEP_SIZE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! +main: filesystem does not support clone range, disabling! +main: filesystem does not support dedupe range, disabling! +main: filesystem does not support exchange range, disabling! +skipping zero size read +truncating to largest ever: 0x1f000 +copying to largest ever: 0x29000 +truncating to largest ever: 0x3a000 +truncating to largest ever: 0x40000 +truncating to largest ever: 0x57000 +truncating to largest ever: 0x58000 +truncating to largest ever: 0x6f000 +truncating to largest ever: 0x72000 +READ BAD DATA: offset = 0x3000, size = 0xced0, fname = /tmp/tmp.QUduP9NKsItest/junk +OFFSET GOOD BAD RANGE +0x3000 0x7d54 0x0000 0x0 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3001 0x547d 0x0000 0x1 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3002 0x7d35 0x0000 0x2 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3003 0x357d 0x0000 0x3 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3004 0x7d7e 0x0000 0x4 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3005 0x7e7d 0x0000 0x5 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3006 0x7dd4 0x0000 0x6 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3007 0xd47d 0x0000 0x7 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3008 0x7da7 0x0000 0x8 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x3009 0xa77d 0x0000 0x9 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x300a 0x7d06 0x0000 0xa +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x300b 0x067d 0x0000 0xb +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x300c 0x7d0b 0x0000 0xc +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x300d 0x0b7d 0x0000 0xd +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x300e 0x7ddd 0x0000 0xe +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x300f 0xdd7d 0x0000 0xf +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +LOG DUMP (261 total operations): +1( 1 mod 256): SKIPPED (no operation) +2( 2 mod 256): SKIPPED (no operation) +3( 3 mod 256): WRITE 0x69000 thru 0x78fff (0x10000 bytes) HOLE ***WWWW +4( 4 mod 256): SKIPPED (no operation) +5( 5 mod 256): READ 0x63000 thru 0x70fff (0xe000 bytes) +6( 6 mod 256): SKIPPED (no operation) +7( 7 mod 256): SKIPPED (no operation) +8( 8 mod 256): READ 0x5f000 thru 0x64fff (0x6000 bytes) +9( 9 mod 256): SKIPPED (no operation) +10( 10 mod 256): SKIPPED (no operation) +11( 11 mod 256): SKIPPED (no operation) +12( 12 mod 256): READ 0x43000 thru 0x4dfff (0xb000 bytes) +13( 13 mod 256): MAPREAD 0x54000 thru 0x66b4f (0x12b50 bytes) +14( 14 mod 256): SKIPPED (no operation) +15( 15 mod 256): SKIPPED (no operation) +16( 16 mod 256): READ 0x28000 thru 0x2ffff (0x8000 bytes) +17( 17 mod 256): SKIPPED (no operation) +18( 18 mod 256): SKIPPED (no operation) +19( 19 mod 256): SKIPPED (no operation) +20( 20 mod 256): MAPREAD 0x55000 thru 0x6e2fc (0x192fd bytes) +21( 21 mod 256): SKIPPED (no operation) +22( 22 mod 256): TRUNCATE DOWN from 0x79000 to 0x1f000 +23( 23 mod 256): WRITE 0x61000 thru 0x65fff (0x5000 bytes) HOLE +24( 24 mod 256): SKIPPED (no operation) +25( 25 mod 256): SKIPPED (no operation) +26( 26 mod 256): SKIPPED (no operation) +27( 27 mod 256): READ 0x28000 thru 0x28fff (0x1000 bytes) +28( 28 mod 256): COPY 0x61000 thru 0x64fff (0x4000 bytes) to 0x25000 thru 0x28fff +29( 29 mod 256): TRUNCATE DOWN from 0x66000 to 0x3a000 +30( 30 mod 256): MAPREAD 0x39000 thru 0x39449 (0x44a bytes) +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 +32( 32 mod 256): SKIPPED (no operation) +33( 33 mod 256): SKIPPED (no operation) +34( 34 mod 256): SKIPPED (no operation) +35( 35 mod 256): WRITE 0x29000 thru 0x38fff (0x10000 bytes) +36( 36 mod 256): SKIPPED (no operation) +37( 37 mod 256): READ 0x17000 thru 0x1afff (0x4000 bytes) +38( 38 mod 256): SKIPPED (no operation) +39( 39 mod 256): SKIPPED (no operation) +40( 40 mod 256): WRITE 0x71000 thru 0x78fff (0x8000 bytes) HOLE +41( 41 mod 256): COPY 0x59000 thru 0x64fff (0xc000 bytes) to 0x14000 thru 0x1ffff +42( 42 mod 256): MAPREAD 0x6b000 thru 0x78fa1 (0xdfa2 bytes) +43( 43 mod 256): SKIPPED (no operation) +44( 44 mod 256): WRITE 0x20000 thru 0x2afff (0xb000 bytes) +45( 45 mod 256): SKIPPED (no operation) +46( 46 mod 256): SKIPPED (no operation) +47( 47 mod 256): TRUNCATE DOWN from 0x79000 to 0x39000 +48( 48 mod 256): SKIPPED (no operation) +49( 49 mod 256): SKIPPED (no operation) +50( 50 mod 256): SKIPPED (no operation) +51( 51 mod 256): SKIPPED (no operation) +52( 52 mod 256): SKIPPED (no operation) +53( 53 mod 256): SKIPPED (no operation) +54( 54 mod 256): SKIPPED (no operation) +55( 55 mod 256): COPY 0x1000 thru 0x3fff (0x3000 bytes) to 0x12000 thru 0x14fff +56( 56 mod 256): READ 0x5000 thru 0xbfff (0x7000 bytes) ***RRRR*** +57( 57 mod 256): WRITE 0x4e000 thru 0x69fff (0x1c000 bytes) HOLE +58( 58 mod 256): SKIPPED (no operation) +59( 59 mod 256): SKIPPED (no operation) +60( 60 mod 256): MAPREAD 0x10000 thru 0x2e39b (0x1e39c bytes) +61( 61 mod 256): SKIPPED (no operation) +62( 62 mod 256): SKIPPED (no operation) +63( 63 mod 256): SKIPPED (no operation) +64( 64 mod 256): SKIPPED (no operation) +65( 65 mod 256): WRITE 0x19000 thru 0x19fff (0x1000 bytes) +66( 66 mod 256): SKIPPED (no operation) +67( 67 mod 256): WRITE 0x1f000 thru 0x3cfff (0x1e000 bytes) +68( 68 mod 256): SKIPPED (no operation) +69( 69 mod 256): TRUNCATE DOWN from 0x6a000 to 0x57000 +70( 70 mod 256): READ 0x52000 thru 0x55fff (0x4000 bytes) +71( 71 mod 256): TRUNCATE UP from 0x57000 to 0x58000 +72( 72 mod 256): TRUNCATE DOWN from 0x58000 to 0x4b000 +73( 73 mod 256): TRUNCATE DOWN from 0x4b000 to 0x28000 +74( 74 mod 256): SKIPPED (no operation) +75( 75 mod 256): MAPREAD 0x1b000 thru 0x1f654 (0x4655 bytes) +76( 76 mod 256): WRITE 0x38000 thru 0x49fff (0x12000 bytes) HOLE +77( 77 mod 256): WRITE 0x3000 thru 0x4fff (0x2000 bytes) +78( 78 mod 256): SKIPPED (no operation) +79( 79 mod 256): SKIPPED (no operation) +80( 80 mod 256): MAPREAD 0x5000 thru 0x1a378 (0x15379 bytes) ***RRRR*** +81( 81 mod 256): WRITE 0x6f000 thru 0x70fff (0x2000 bytes) HOLE +82( 82 mod 256): SKIPPED (no operation) +83( 83 mod 256): TRUNCATE DOWN from 0x71000 to 0x4f000 +84( 84 mod 256): READ 0x3c000 thru 0x4dfff (0x12000 bytes) +85( 85 mod 256): SKIPPED (no operation) +86( 86 mod 256): SKIPPED (no operation) +87( 87 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 +88( 88 mod 256): COPY 0xa000 thru 0xefff (0x5000 bytes) to 0x66000 thru 0x6afff EEEE****** +89( 89 mod 256): WRITE 0x2b000 thru 0x48fff (0x1e000 bytes) +90( 90 mod 256): COPY 0x5d000 thru 0x6dfff (0x11000 bytes) to 0x24000 thru 0x34fff +91( 91 mod 256): SKIPPED (no operation) +92( 92 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 +93( 93 mod 256): SKIPPED (no operation) +94( 94 mod 256): SKIPPED (no operation) +95( 95 mod 256): SKIPPED (no operation) +96( 96 mod 256): SKIPPED (no operation) +97( 97 mod 256): SKIPPED (no operation) +98( 98 mod 256): SKIPPED (no operation) +99( 99 mod 256): SKIPPED (no operation) +100(100 mod 256): SKIPPED (no operation) +101(101 mod 256): SKIPPED (no operation) +102(102 mod 256): SKIPPED (no operation) +103(103 mod 256): MAPREAD 0x54000 thru 0x5a617 (0x6618 bytes) +104(104 mod 256): SKIPPED (no operation) +105(105 mod 256): SKIPPED (no operation) +106(106 mod 256): WRITE 0x3b000 thru 0x40fff (0x6000 bytes) +107(107 mod 256): SKIPPED (no operation) +108(108 mod 256): SKIPPED (no operation) +109(109 mod 256): WRITE 0x21000 thru 0x23fff (0x3000 bytes) +110(110 mod 256): SKIPPED (no operation) +111(111 mod 256): SKIPPED (no operation) +112(112 mod 256): SKIPPED (no operation) +113(113 mod 256): WRITE 0x49000 thru 0x51fff (0x9000 bytes) +114(114 mod 256): SKIPPED (no operation) +115(115 mod 256): WRITE 0x46000 thru 0x52fff (0xd000 bytes) +116(116 mod 256): COPY 0xa000 thru 0x14fff (0xb000 bytes) to 0x1e000 thru 0x28fff EEEE****** +117(117 mod 256): READ 0x57000 thru 0x59fff (0x3000 bytes) +118(118 mod 256): SKIPPED (no operation) +119(119 mod 256): COPY 0x48000 thru 0x55fff (0xe000 bytes) to 0xe000 thru 0x1bfff +120(120 mod 256): SKIPPED (no operation) +121(121 mod 256): SKIPPED (no operation) +122(122 mod 256): SKIPPED (no operation) +123(123 mod 256): SKIPPED (no operation) +124(124 mod 256): SKIPPED (no operation) +125(125 mod 256): WRITE 0x0 thru 0x19fff (0x1a000 bytes) ***WWWW +126(126 mod 256): SKIPPED (no operation) +127(127 mod 256): TRUNCATE UP from 0x5b000 to 0x72000 +128(128 mod 256): SKIPPED (no operation) +129(129 mod 256): SKIPPED (no operation) +130(130 mod 256): SKIPPED (no operation) +131(131 mod 256): SKIPPED (no operation) +132(132 mod 256): SKIPPED (no operation) +133(133 mod 256): READ 0x19000 thru 0x29fff (0x11000 bytes) +134(134 mod 256): SKIPPED (no operation) +135(135 mod 256): MAPREAD 0x4d000 thru 0x4d15d (0x15e bytes) +136(136 mod 256): SKIPPED (no operation) +137(137 mod 256): SKIPPED (no operation) +138(138 mod 256): SKIPPED (no operation) +139(139 mod 256): SKIPPED (no operation) +140(140 mod 256): WRITE 0x10000 thru 0x1bfff (0xc000 bytes) +141(141 mod 256): SKIPPED (no operation) +142(142 mod 256): SKIPPED (no operation) +143(143 mod 256): SKIPPED (no operation) +144(144 mod 256): WRITE 0x42000 thru 0x4afff (0x9000 bytes) +145(145 mod 256): WRITE 0x6b000 thru 0x78fff (0xe000 bytes) EXTEND +146(146 mod 256): WRITE 0x67000 thru 0x78fff (0x12000 bytes) +147(147 mod 256): SKIPPED (no operation) +148(148 mod 256): WRITE 0x25000 thru 0x34fff (0x10000 bytes) +149(149 mod 256): WRITE 0x29000 thru 0x44fff (0x1c000 bytes) +150(150 mod 256): READ 0x5a000 thru 0x67fff (0xe000 bytes) +151(151 mod 256): TRUNCATE DOWN from 0x79000 to 0x12000 +152(152 mod 256): SKIPPED (no operation) +153(153 mod 256): SKIPPED (no operation) +154(154 mod 256): SKIPPED (no operation) +155(155 mod 256): SKIPPED (no operation) +156(156 mod 256): COPY 0xa000 thru 0xdfff (0x4000 bytes) to 0x13000 thru 0x16fff EEEE****** +157(157 mod 256): WRITE 0x62000 thru 0x77fff (0x16000 bytes) HOLE +158(158 mod 256): SKIPPED (no operation) +159(159 mod 256): SKIPPED (no operation) +160(160 mod 256): SKIPPED (no operation) +161(161 mod 256): MAPREAD 0x4e000 thru 0x53d94 (0x5d95 bytes) +162(162 mod 256): MAPREAD 0x1d000 thru 0x2324c (0x624d bytes) +163(163 mod 256): SKIPPED (no operation) +164(164 mod 256): SKIPPED (no operation) +165(165 mod 256): SKIPPED (no operation) +166(166 mod 256): WRITE 0x3e000 thru 0x4cfff (0xf000 bytes) +167(167 mod 256): TRUNCATE DOWN from 0x78000 to 0x29000 +168(168 mod 256): SKIPPED (no operation) +169(169 mod 256): MAPREAD 0x1d000 thru 0x28e2a (0xbe2b bytes) +170(170 mod 256): WRITE 0x6e000 thru 0x6efff (0x1000 bytes) HOLE +171(171 mod 256): SKIPPED (no operation) +172(172 mod 256): SKIPPED (no operation) +173(173 mod 256): COPY 0x44000 thru 0x47fff (0x4000 bytes) to 0x38000 thru 0x3bfff +174(174 mod 256): READ 0x23000 thru 0x33fff (0x11000 bytes) +175(175 mod 256): SKIPPED (no operation) +176(176 mod 256): SKIPPED (no operation) +177(177 mod 256): SKIPPED (no operation) +178(178 mod 256): READ 0xc000 thru 0x10fff (0x5000 bytes) +179(179 mod 256): COPY 0x4e000 thru 0x64fff (0x17000 bytes) to 0x35000 thru 0x4bfff +180(180 mod 256): MAPREAD 0x54000 thru 0x634ce (0xf4cf bytes) +181(181 mod 256): SKIPPED (no operation) +182(182 mod 256): SKIPPED (no operation) +183(183 mod 256): MAPREAD 0x38000 thru 0x4da09 (0x15a0a bytes) +184(184 mod 256): SKIPPED (no operation) +185(185 mod 256): TRUNCATE DOWN from 0x6f000 to 0x15000 +186(186 mod 256): TRUNCATE UP from 0x15000 to 0x50000 +187(187 mod 256): SKIPPED (no operation) +188(188 mod 256): WRITE 0x28000 thru 0x33fff (0xc000 bytes) +189(189 mod 256): WRITE 0x32000 thru 0x44fff (0x13000 bytes) +190(190 mod 256): TRUNCATE DOWN from 0x50000 to 0x49000 +191(191 mod 256): WRITE 0x50000 thru 0x63fff (0x14000 bytes) HOLE +192(192 mod 256): MAPREAD 0x1a000 thru 0x1ad96 (0xd97 bytes) +193(193 mod 256): WRITE 0x23000 thru 0x29fff (0x7000 bytes) +194(194 mod 256): WRITE 0x5b000 thru 0x64fff (0xa000 bytes) EXTEND +195(195 mod 256): MAPREAD 0x23000 thru 0x2fd78 (0xcd79 bytes) +196(196 mod 256): SKIPPED (no operation) +197(197 mod 256): SKIPPED (no operation) +198(198 mod 256): SKIPPED (no operation) +199(199 mod 256): SKIPPED (no operation) +200(200 mod 256): SKIPPED (no operation) +201(201 mod 256): SKIPPED (no operation) +202(202 mod 256): TRUNCATE DOWN from 0x65000 to 0x5e000 +203(203 mod 256): SKIPPED (no operation) +204(204 mod 256): SKIPPED (no operation) +205(205 mod 256): SKIPPED (no operation) +206(206 mod 256): READ 0x2d000 thru 0x36fff (0xa000 bytes) +207(207 mod 256): MAPREAD 0x29000 thru 0x47985 (0x1e986 bytes) +208(208 mod 256): SKIPPED (no operation) +209(209 mod 256): WRITE 0x15000 thru 0x31fff (0x1d000 bytes) +210(210 mod 256): READ 0x12000 thru 0x23fff (0x12000 bytes) +211(211 mod 256): SKIPPED (no operation) +212(212 mod 256): MAPREAD 0x28000 thru 0x34970 (0xc971 bytes) +213(213 mod 256): SKIPPED (no operation) +214(214 mod 256): SKIPPED (no operation) +215(215 mod 256): SKIPPED (no operation) +216(216 mod 256): SKIPPED (no operation) +217(217 mod 256): WRITE 0x72000 thru 0x78fff (0x7000 bytes) HOLE +218(218 mod 256): SKIPPED (no operation) +219(219 mod 256): COPY 0x72000 thru 0x77fff (0x6000 bytes) to 0x27000 thru 0x2cfff +220(220 mod 256): SKIPPED (no operation) +221(221 mod 256): SKIPPED (no operation) +222(222 mod 256): SKIPPED (no operation) +223(223 mod 256): SKIPPED (no operation) +224(224 mod 256): WRITE 0x39000 thru 0x3afff (0x2000 bytes) +225(225 mod 256): MAPREAD 0x6b000 thru 0x78658 (0xd659 bytes) +226(226 mod 256): READ 0x1a000 thru 0x35fff (0x1c000 bytes) +227(227 mod 256): READ 0x1b000 thru 0x1bfff (0x1000 bytes) +228(228 mod 256): MAPREAD 0x37000 thru 0x49af1 (0x12af2 bytes) +229(229 mod 256): SKIPPED (no operation) +230(230 mod 256): SKIPPED (no operation) +231(231 mod 256): SKIPPED (no operation) +232(232 mod 256): SKIPPED (no operation) +233(233 mod 256): SKIPPED (no operation) +234(234 mod 256): SKIPPED (no operation) +235(235 mod 256): MAPREAD 0x2b000 thru 0x3365b (0x865c bytes) +236(236 mod 256): SKIPPED (no operation) +237(237 mod 256): SKIPPED (no operation) +238(238 mod 256): READ 0x40000 thru 0x42fff (0x3000 bytes) +239(239 mod 256): SKIPPED (no operation) +240(240 mod 256): COPY 0x3f000 thru 0x46fff (0x8000 bytes) to 0x31000 thru 0x38fff +241(241 mod 256): SKIPPED (no operation) +242(242 mod 256): SKIPPED (no operation) +243(243 mod 256): READ 0x23000 thru 0x3bfff (0x19000 bytes) +244(244 mod 256): TRUNCATE DOWN from 0x79000 to 0x15000 +245(245 mod 256): MAPREAD 0xa000 thru 0xe6d6 (0x46d7 bytes) ***RRRR*** +246(246 mod 256): SKIPPED (no operation) +247(247 mod 256): SKIPPED (no operation) +248(248 mod 256): TRUNCATE DOWN from 0x15000 to 0xc000 +249(249 mod 256): WRITE 0x30000 thru 0x46fff (0x17000 bytes) HOLE +250(250 mod 256): READ 0xb000 thru 0x15fff (0xb000 bytes) ***RRRR*** +251(251 mod 256): TRUNCATE UP from 0x47000 to 0x53000 +252(252 mod 256): SKIPPED (no operation) +253(253 mod 256): TRUNCATE DOWN from 0x53000 to 0x11000 +254(254 mod 256): SKIPPED (no operation) +255(255 mod 256): WRITE 0x2000 thru 0x2fff (0x1000 bytes) +256( 0 mod 256): SKIPPED (no operation) +257( 1 mod 256): TRUNCATE DOWN from 0x11000 to 0x10000 +258( 2 mod 256): SKIPPED (no operation) +259( 3 mod 256): SKIPPED (no operation) +260( 4 mod 256): SKIPPED (no operation) +261( 5 mod 256): MAPREAD 0x3000 thru 0xfecf (0xced0 bytes) ***RRRR*** +Log of operations saved to "/tmp/tmp.QUduP9NKsItest/junk.fsxops"; replay with --replay-ops +Correct content saved for comparison +(maybe hexdump "/tmp/tmp.QUduP9NKsItest/junk" vs "/tmp/tmp.QUduP9NKsItest/junk.fsxgood") generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/097 1s generic/098 - output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/098.out.bad) --- tests/generic/098.out 2024-02-18 10:01:38.829993610 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/098.out.bad 2024-02-18 10:13:15.744219086 +0000 @@ -4,9 +4,7 @@ wrote 32768/32768 bytes at offset 262144 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) File content after remount: -0000000 aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa -* -0400000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 +0000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0500000 wrote 131072/131072 bytes at offset 0 @@ -14,8 +12,6 @@ wrote 32768/32768 bytes at offset 262144 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) File content after remount: -0000000 aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa -* -0400000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 +0000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0500000 generic/099 2s generic/101 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/104 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/105 1s generic/106 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/107 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/108 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/110 [not run] Reflink not supported by test filesystem type: ceph generic/111 [not run] Reflink not supported by test filesystem type: ceph generic/112 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/112.out.bad) --- tests/generic/112.out 2024-02-18 10:01:38.831993582 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/112.out.bad 2024-02-18 10:13:23.859104556 +0000 @@ -4,15 +4,4 @@ ----------------------------------------------- fsx.0 : -A -d -N numops -S 0 ----------------------------------------------- - ------------------------------------------------ -fsx.1 : -A -d -N numops -S 0 -x ------------------------------------------------ - ------------------------------------------------ -fsx.2 : -A -d -N numops -l filelen -S 0 ------------------------------------------------ - ------------------------------------------------ -fsx.3 : -A -d -N numops -l filelen -S 0 -x ------------------------------------------------ + fsx (-A -d -N 1000 -S 0) returned 0 - see 112.0.full generic/113 93s generic/114 [not run] Sparse files are not supported or do not work as expected generic/115 [not run] Reflink not supported by test filesystem type: ceph generic/116 [not run] Reflink not supported by test filesystem type: ceph generic/117 6s generic/118 [not run] Reflink not supported by test filesystem type: ceph generic/119 [not run] Reflink not supported by test filesystem type: ceph generic/120 [not run] atime not maintained by ceph generic/121 [not run] Dedupe not supported by test filesystem type: ceph generic/122 [not run] Dedupe not supported by test filesystem type: ceph generic/123 2s generic/124 41s generic/126 1s generic/128 2s generic/129 [not run] Sparse files are not supported or do not work as expected generic/130 [not run] Sparse files are not supported or do not work as expected generic/131 1s generic/134 [not run] Reflink not supported by test filesystem type: ceph generic/135 1s generic/136 [not run] Dedupe not supported by test filesystem type: ceph generic/138 [not run] Reflink not supported by test filesystem type: ceph generic/139 [not run] Reflink not supported by test filesystem type: ceph generic/140 [not run] Reflink not supported by test filesystem type: ceph generic/141 1s generic/142 [not run] Reflink not supported by test filesystem type: ceph generic/143 [not run] Reflink not supported by test filesystem type: ceph generic/144 [not run] Reflink not supported by test filesystem type: ceph generic/145 [not run] Reflink not supported by test filesystem type: ceph generic/146 [not run] Reflink not supported by test filesystem type: ceph generic/147 [not run] Reflink not supported by test filesystem type: ceph generic/148 [not run] Reflink not supported by test filesystem type: ceph generic/149 [not run] Reflink not supported by test filesystem type: ceph generic/150 [not run] Reflink not supported by test filesystem type: ceph generic/151 [not run] Reflink not supported by test filesystem type: ceph generic/152 [not run] Reflink not supported by test filesystem type: ceph generic/153 [not run] Reflink not supported by test filesystem type: ceph generic/154 [not run] Reflink not supported by test filesystem type: ceph generic/155 [not run] Reflink not supported by test filesystem type: ceph generic/156 [not run] Reflink not supported by test filesystem type: ceph generic/157 [not run] Reflink not supported by test filesystem type: ceph generic/158 [not run] Dedupe not supported by test filesystem type: ceph generic/159 [not run] file system doesn't support chattr +i generic/160 [not run] file system doesn't support chattr +i generic/161 [not run] Reflink not supported by scratch filesystem type: ceph generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph generic/169 1s generic/171 [not run] Reflink not supported by scratch filesystem type: ceph generic/172 [not run] Reflink not supported by scratch filesystem type: ceph generic/173 [not run] Reflink not supported by scratch filesystem type: ceph generic/174 [not run] Reflink not supported by scratch filesystem type: ceph generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/178 [not run] Reflink not supported by test filesystem type: ceph generic/179 [not run] Reflink not supported by test filesystem type: ceph generic/180 [not run] Reflink not supported by test filesystem type: ceph generic/181 [not run] Reflink not supported by test filesystem type: ceph generic/182 [not run] Dedupe not supported by test filesystem type: ceph generic/183 [not run] Reflink not supported by scratch filesystem type: ceph generic/184 1s generic/185 [not run] Reflink not supported by scratch filesystem type: ceph generic/188 [not run] Reflink not supported by scratch filesystem type: ceph generic/189 [not run] Reflink not supported by scratch filesystem type: ceph generic/190 [not run] Reflink not supported by scratch filesystem type: ceph generic/191 [not run] Reflink not supported by scratch filesystem type: ceph generic/193 2s generic/194 [not run] Reflink not supported by scratch filesystem type: ceph generic/195 [not run] Reflink not supported by scratch filesystem type: ceph generic/196 [not run] Reflink not supported by scratch filesystem type: ceph generic/197 [not run] Reflink not supported by scratch filesystem type: ceph generic/198 [failed, exit status 10]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/198.out.bad) --- tests/generic/198.out 2024-02-18 10:01:38.845993388 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/198.out.bad 2024-02-18 10:16:53.243168598 +0000 @@ -1,2 +1,5 @@ QA output created by 198 Silence is golden. +non one buffer at buf[0] => 0x00,00,00,00 +non-one read at offset 0 +*** WARNING *** /tmp/tmp.QUduP9NKsItest/aiodio_sparse has not been unlinked; if you don't rm it manually first, it may influence the next run generic/199 [not run] Reflink not supported by scratch filesystem type: ceph generic/200 [not run] Reflink not supported by scratch filesystem type: ceph generic/201 [not run] Reflink not supported by scratch filesystem type: ceph generic/202 [not run] Reflink not supported by scratch filesystem type: ceph generic/203 [not run] Reflink not supported by scratch filesystem type: ceph generic/205 [not run] Reflink not supported by scratch filesystem type: ceph generic/206 [not run] Reflink not supported by scratch filesystem type: ceph generic/207 11s generic/210 0s generic/211 1s generic/212 1s generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/215 2s generic/216 [not run] Reflink not supported by scratch filesystem type: ceph generic/217 [not run] Reflink not supported by scratch filesystem type: ceph generic/218 [not run] Reflink not supported by scratch filesystem type: ceph generic/219 [not run] disk quotas not supported by this filesystem type: ceph generic/220 [not run] Reflink not supported by scratch filesystem type: ceph generic/221 1s generic/222 [not run] Reflink not supported by scratch filesystem type: ceph generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/227 [not run] Reflink not supported by scratch filesystem type: ceph generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/229 [not run] Reflink not supported by scratch filesystem type: ceph generic/230 [not run] disk quotas not supported by this filesystem type: ceph generic/235 [not run] disk quotas not supported by this filesystem type: ceph generic/236 1s generic/237 1s generic/238 [not run] Reflink not supported by scratch filesystem type: ceph generic/240 [not run] Sparse files are not supported or do not work as expected generic/244 [not run] disk quotas not supported by this filesystem type: ceph generic/245 0s generic/246 1s generic/247 255s generic/248 1s generic/249 21s generic/250 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/252 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/253 [not run] Reflink not supported by scratch filesystem type: ceph generic/254 [not run] Reflink not supported by scratch filesystem type: ceph generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/257 1s generic/258 [not run] ceph does not support negative timestamps generic/259 [not run] Reflink not supported by scratch filesystem type: ceph generic/260 [not run] FITRIM not supported on /tmp/tmp.w8GvOpYWfNscratch generic/261 [not run] Reflink not supported by scratch filesystem type: ceph generic/262 [not run] Reflink not supported by scratch filesystem type: ceph generic/263 [failed, exit status 1]- output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/263.out.bad) --- tests/generic/263.out 2024-02-18 10:01:38.856993235 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/263.out.bad 2024-02-18 10:22:28.275429502 +0000 @@ -1,3 +1,240 @@ QA output created by 263 fsx -N 10000 -o 8192 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z -fsx -N 10000 -o 128000 -l 500000 -r PSIZE -t BSIZE -w BSIZE -Z +Seed set to 1 +main: filesystem does not support fallocate mode 0, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_PUNCH_HOLE | FALLOC_FL_KEEP_SIZE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_ZERO_RANGE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! +main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! +main: filesystem does not support clone range, disabling! +main: filesystem does not support dedupe range, disabling! +main: filesystem does not support exchange range, disabling! +skipping zero size read +truncating to largest ever: 0x1f000 +truncating to largest ever: 0x3a000 +truncating to largest ever: 0x40000 +truncating to largest ever: 0x4f000 +truncating to largest ever: 0x6f000 +truncating to largest ever: 0x72000 +READ BAD DATA: offset = 0x18000, size = 0xc6a, fname = /tmp/tmp.QUduP9NKsItest/junk +OFFSET GOOD BAD RANGE +0x18000 0xafce 0x0000 0x0 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18001 0xceaf 0x0000 0x1 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18002 0xaf3d 0x0000 0x2 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18003 0x3daf 0x0000 0x3 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18004 0xaf32 0x0000 0x4 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18005 0x32af 0x0000 0x5 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18006 0xaf4b 0x0000 0x6 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18007 0x4baf 0x0000 0x7 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18008 0xaf1d 0x0000 0x8 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x18009 0x1daf 0x0000 0x9 +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x1800a 0xaf26 0x0000 0xa +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x1800b 0x26af 0x0000 0xb +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x1800c 0xaf85 0x0000 0xc +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x1800d 0x85af 0x0000 0xd +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x1800e 0xafa4 0x0000 0xe +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +0x1800f 0xa4af 0x0000 0xf +operation# (mod 256) for the bad data unknown, check HOLE and EXTEND ops +LOG DUMP (183 total operations): +1( 1 mod 256): SKIPPED (no operation) +2( 2 mod 256): SKIPPED (no operation) +3( 3 mod 256): MAPWRITE 0x69000 thru 0x6948f (0x490 bytes) +4( 4 mod 256): SKIPPED (no operation) +5( 5 mod 256): SKIPPED (no operation) +6( 6 mod 256): SKIPPED (no operation) +7( 7 mod 256): MAPREAD 0x24000 thru 0x252b7 (0x12b8 bytes) +8( 8 mod 256): SKIPPED (no operation) +9( 9 mod 256): SKIPPED (no operation) +10( 10 mod 256): SKIPPED (no operation) +11( 11 mod 256): SKIPPED (no operation) +12( 12 mod 256): READ 0x65000 thru 0x65fff (0x1000 bytes) +13( 13 mod 256): MAPREAD 0x2a000 thru 0x2b84b (0x184c bytes) +14( 14 mod 256): SKIPPED (no operation) +15( 15 mod 256): SKIPPED (no operation) +16( 16 mod 256): SKIPPED (no operation) +17( 17 mod 256): SKIPPED (no operation) +18( 18 mod 256): SKIPPED (no operation) +19( 19 mod 256): SKIPPED (no operation) +20( 20 mod 256): MAPREAD 0x13000 thru 0x13b3a (0xb3b bytes) +21( 21 mod 256): SKIPPED (no operation) +22( 22 mod 256): TRUNCATE DOWN from 0x69490 to 0x1f000 +23( 23 mod 256): SKIPPED (no operation) +24( 24 mod 256): SKIPPED (no operation) +25( 25 mod 256): SKIPPED (no operation) +26( 26 mod 256): SKIPPED (no operation) +27( 27 mod 256): SKIPPED (no operation) +28( 28 mod 256): SKIPPED (no operation) +29( 29 mod 256): TRUNCATE UP from 0x1f000 to 0x3a000 +30( 30 mod 256): MAPREAD 0x39000 thru 0x390cd (0xce bytes) +31( 31 mod 256): TRUNCATE UP from 0x3a000 to 0x40000 +32( 32 mod 256): SKIPPED (no operation) +33( 33 mod 256): SKIPPED (no operation) +34( 34 mod 256): SKIPPED (no operation) +35( 35 mod 256): SKIPPED (no operation) +36( 36 mod 256): SKIPPED (no operation) +37( 37 mod 256): MAPREAD 0x23000 thru 0x24420 (0x1421 bytes) +38( 38 mod 256): READ 0x2d000 thru 0x2dfff (0x1000 bytes) +39( 39 mod 256): SKIPPED (no operation) +40( 40 mod 256): SKIPPED (no operation) +41( 41 mod 256): SKIPPED (no operation) +42( 42 mod 256): MAPREAD 0x1d000 thru 0x1d2ab (0x2ac bytes) +43( 43 mod 256): COPY 0x9000 thru 0x9fff (0x1000 bytes) to 0x22000 thru 0x22fff +44( 44 mod 256): SKIPPED (no operation) +45( 45 mod 256): SKIPPED (no operation) +46( 46 mod 256): SKIPPED (no operation) +47( 47 mod 256): SKIPPED (no operation) +48( 48 mod 256): SKIPPED (no operation) +49( 49 mod 256): SKIPPED (no operation) +50( 50 mod 256): SKIPPED (no operation) +51( 51 mod 256): MAPWRITE 0x14000 thru 0x14c81 (0xc82 bytes) +52( 52 mod 256): SKIPPED (no operation) +53( 53 mod 256): TRUNCATE DOWN from 0x40000 to 0x16000 ******WWWW +54( 54 mod 256): MAPWRITE 0x15000 thru 0x15628 (0x629 bytes) +55( 55 mod 256): SKIPPED (no operation) +56( 56 mod 256): SKIPPED (no operation) +57( 57 mod 256): SKIPPED (no operation) +58( 58 mod 256): MAPWRITE 0x34000 thru 0x34c6f (0xc70 bytes) +59( 59 mod 256): WRITE 0x38000 thru 0x38fff (0x1000 bytes) HOLE +60( 60 mod 256): SKIPPED (no operation) +61( 61 mod 256): SKIPPED (no operation) +62( 62 mod 256): SKIPPED (no operation) +63( 63 mod 256): SKIPPED (no operation) +64( 64 mod 256): SKIPPED (no operation) +65( 65 mod 256): MAPWRITE 0x19000 thru 0x193b6 (0x3b7 bytes) +66( 66 mod 256): SKIPPED (no operation) +67( 67 mod 256): SKIPPED (no operation) +68( 68 mod 256): SKIPPED (no operation) +69( 69 mod 256): SKIPPED (no operation) +70( 70 mod 256): SKIPPED (no operation) +71( 71 mod 256): SKIPPED (no operation) +72( 72 mod 256): SKIPPED (no operation) +73( 73 mod 256): SKIPPED (no operation) +74( 74 mod 256): SKIPPED (no operation) +75( 75 mod 256): SKIPPED (no operation) +76( 76 mod 256): SKIPPED (no operation) +77( 77 mod 256): SKIPPED (no operation) +78( 78 mod 256): SKIPPED (no operation) +79( 79 mod 256): SKIPPED (no operation) +80( 80 mod 256): SKIPPED (no operation) +81( 81 mod 256): SKIPPED (no operation) +82( 82 mod 256): SKIPPED (no operation) +83( 83 mod 256): SKIPPED (no operation) +84( 84 mod 256): SKIPPED (no operation) +85( 85 mod 256): SKIPPED (no operation) +86( 86 mod 256): SKIPPED (no operation) +87( 87 mod 256): TRUNCATE DOWN from 0x39000 to 0x16000 ******WWWW +88( 88 mod 256): SKIPPED (no operation) +89( 89 mod 256): MAPREAD 0xc000 thru 0xd35c (0x135d bytes) +90( 90 mod 256): SKIPPED (no operation) +91( 91 mod 256): SKIPPED (no operation) +92( 92 mod 256): SKIPPED (no operation) +93( 93 mod 256): SKIPPED (no operation) +94( 94 mod 256): SKIPPED (no operation) +95( 95 mod 256): MAPREAD 0xb000 thru 0xc8f7 (0x18f8 bytes) +96( 96 mod 256): MAPWRITE 0x38000 thru 0x3909b (0x109c bytes) +97( 97 mod 256): MAPWRITE 0x3000 thru 0x48f2 (0x18f3 bytes) +98( 98 mod 256): SKIPPED (no operation) +99( 99 mod 256): SKIPPED (no operation) +100(100 mod 256): MAPREAD 0x37000 thru 0x377ef (0x7f0 bytes) +101(101 mod 256): WRITE 0x6f000 thru 0x6ffff (0x1000 bytes) HOLE +102(102 mod 256): SKIPPED (no operation) +103(103 mod 256): TRUNCATE DOWN from 0x70000 to 0x4f000 +104(104 mod 256): READ 0x3c000 thru 0x3cfff (0x1000 bytes) +105(105 mod 256): SKIPPED (no operation) +106(106 mod 256): SKIPPED (no operation) +107(107 mod 256): TRUNCATE UP from 0x4f000 to 0x6f000 +108(108 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x66000 thru 0x66fff +109(109 mod 256): SKIPPED (no operation) +110(110 mod 256): COPY 0x5d000 thru 0x5dfff (0x1000 bytes) to 0x24000 thru 0x24fff +111(111 mod 256): SKIPPED (no operation) +112(112 mod 256): TRUNCATE DOWN from 0x6f000 to 0x5b000 +113(113 mod 256): SKIPPED (no operation) +114(114 mod 256): SKIPPED (no operation) +115(115 mod 256): SKIPPED (no operation) +116(116 mod 256): SKIPPED (no operation) +117(117 mod 256): WRITE 0xa000 thru 0xafff (0x1000 bytes) +118(118 mod 256): SKIPPED (no operation) +119(119 mod 256): SKIPPED (no operation) +120(120 mod 256): SKIPPED (no operation) +121(121 mod 256): SKIPPED (no operation) +122(122 mod 256): SKIPPED (no operation) +123(123 mod 256): SKIPPED (no operation) +124(124 mod 256): MAPREAD 0x54000 thru 0x55754 (0x1755 bytes) +125(125 mod 256): SKIPPED (no operation) +126(126 mod 256): SKIPPED (no operation) +127(127 mod 256): SKIPPED (no operation) +128(128 mod 256): SKIPPED (no operation) +129(129 mod 256): SKIPPED (no operation) +130(130 mod 256): WRITE 0x21000 thru 0x21fff (0x1000 bytes) +131(131 mod 256): SKIPPED (no operation) +132(132 mod 256): SKIPPED (no operation) +133(133 mod 256): MAPWRITE 0xf000 thru 0x1004e (0x104f bytes) +134(134 mod 256): SKIPPED (no operation) +135(135 mod 256): SKIPPED (no operation) +136(136 mod 256): SKIPPED (no operation) +137(137 mod 256): COPY 0xa000 thru 0xafff (0x1000 bytes) to 0x1e000 thru 0x1efff +138(138 mod 256): READ 0x57000 thru 0x57fff (0x1000 bytes) +139(139 mod 256): SKIPPED (no operation) +140(140 mod 256): SKIPPED (no operation) +141(141 mod 256): SKIPPED (no operation) +142(142 mod 256): SKIPPED (no operation) +143(143 mod 256): SKIPPED (no operation) +144(144 mod 256): SKIPPED (no operation) +145(145 mod 256): SKIPPED (no operation) +146(146 mod 256): MAPWRITE 0x0 thru 0x1cc3 (0x1cc4 bytes) +147(147 mod 256): SKIPPED (no operation) +148(148 mod 256): TRUNCATE UP from 0x5b000 to 0x72000 +149(149 mod 256): SKIPPED (no operation) +150(150 mod 256): SKIPPED (no operation) +151(151 mod 256): SKIPPED (no operation) +152(152 mod 256): SKIPPED (no operation) +153(153 mod 256): SKIPPED (no operation) +154(154 mod 256): READ 0x19000 thru 0x19fff (0x1000 bytes) +155(155 mod 256): SKIPPED (no operation) +156(156 mod 256): MAPREAD 0x4d000 thru 0x4ecd8 (0x1cd9 bytes) +157(157 mod 256): SKIPPED (no operation) +158(158 mod 256): SKIPPED (no operation) +159(159 mod 256): SKIPPED (no operation) +160(160 mod 256): SKIPPED (no operation) +161(161 mod 256): SKIPPED (no operation) +162(162 mod 256): SKIPPED (no operation) +163(163 mod 256): SKIPPED (no operation) +164(164 mod 256): SKIPPED (no operation) +165(165 mod 256): SKIPPED (no operation) +166(166 mod 256): SKIPPED (no operation) +167(167 mod 256): SKIPPED (no operation) +168(168 mod 256): READ 0x3e000 thru 0x3efff (0x1000 bytes) +169(169 mod 256): SKIPPED (no operation) +170(170 mod 256): SKIPPED (no operation) +171(171 mod 256): SKIPPED (no operation) +172(172 mod 256): SKIPPED (no operation) +173(173 mod 256): SKIPPED (no operation) +174(174 mod 256): SKIPPED (no operation) +175(175 mod 256): WRITE 0x18000 thru 0x18fff (0x1000 bytes) ***WWWW +176(176 mod 256): SKIPPED (no operation) +177(177 mod 256): COPY 0x10000 thru 0x10fff (0x1000 bytes) to 0x13000 thru 0x13fff +178(178 mod 256): WRITE 0x62000 thru 0x62fff (0x1000 bytes) +179(179 mod 256): SKIPPED (no operation) +180(180 mod 256): SKIPPED (no operation) +181(181 mod 256): SKIPPED (no operation) +182(182 mod 256): TRUNCATE DOWN from 0x72000 to 0x1d000 +183(183 mod 256): MAPREAD 0x18000 thru 0x18c69 (0xc6a bytes) ***RRRR*** +Log of operations saved to "/tmp/tmp.QUduP9NKsItest/junk.fsxops"; replay with --replay-ops +Correct content saved for comparison +(maybe hexdump "/tmp/tmp.QUduP9NKsItest/junk" vs "/tmp/tmp.QUduP9NKsItest/junk.fsxgood") generic/264 [not run] Reflink not supported by scratch filesystem type: ceph generic/265 [not run] Reflink not supported by scratch filesystem type: ceph generic/266 [not run] Reflink not supported by scratch filesystem type: ceph generic/267 [not run] Reflink not supported by scratch filesystem type: ceph generic/268 [not run] Reflink not supported by scratch filesystem type: ceph generic/271 [not run] Reflink not supported by scratch filesystem type: ceph generic/272 [not run] Reflink not supported by scratch filesystem type: ceph generic/276 [not run] Reflink not supported by scratch filesystem type: ceph generic/277 [not run] file system doesn't support chattr +A generic/278 [not run] Reflink not supported by scratch filesystem type: ceph generic/279 [not run] Reflink not supported by scratch filesystem type: ceph generic/281 [not run] Reflink not supported by scratch filesystem type: ceph generic/282 [not run] Reflink not supported by scratch filesystem type: ceph generic/283 [not run] Reflink not supported by scratch filesystem type: ceph generic/284 [not run] Reflink not supported by scratch filesystem type: ceph generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/287 [not run] Reflink not supported by scratch filesystem type: ceph generic/288 [not run] FITRIM not supported on /tmp/tmp.w8GvOpYWfNscratch generic/289 [not run] Reflink not supported by scratch filesystem type: ceph generic/290 [not run] Reflink not supported by scratch filesystem type: ceph generic/291 [not run] Reflink not supported by scratch filesystem type: ceph generic/292 [not run] Reflink not supported by scratch filesystem type: ceph generic/293 [not run] Reflink not supported by scratch filesystem type: ceph generic/294 1s generic/295 [not run] Reflink not supported by scratch filesystem type: ceph generic/296 [not run] Reflink not supported by scratch filesystem type: ceph generic/301 [not run] Reflink not supported by scratch filesystem type: ceph generic/302 [not run] Reflink not supported by scratch filesystem type: ceph generic/303 [not run] Reflink not supported by test filesystem type: ceph generic/304 [not run] Dedupe not supported by test filesystem type: ceph generic/305 [not run] Reflink not supported by scratch filesystem type: ceph generic/306 1s generic/307 2s generic/308 1s generic/309 1s generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/313 5s generic/314 1s generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/317 1s generic/318 1s generic/319 0s generic/321 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/322 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/324 [not run] defragmentation not supported for fstype "ceph" generic/325 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/326 [not run] Reflink not supported by scratch filesystem type: ceph generic/327 [not run] Reflink not supported by scratch filesystem type: ceph generic/328 [not run] Reflink not supported by scratch filesystem type: ceph generic/329 [not run] Reflink not supported by scratch filesystem type: ceph generic/330 [not run] Reflink not supported by scratch filesystem type: ceph generic/331 [not run] Reflink not supported by scratch filesystem type: ceph generic/332 [not run] Reflink not supported by scratch filesystem type: ceph generic/335 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/336 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/337 1s generic/338 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/341 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/342 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/343 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/346 203s generic/347 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/348 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/353 [not run] Reflink not supported by scratch filesystem type: ceph generic/355 1s generic/356 [not run] swapfiles are not supported generic/357 [not run] swapfiles are not supported generic/358 [not run] Reflink not supported by scratch filesystem type: ceph generic/359 [not run] Reflink not supported by scratch filesystem type: ceph generic/360 1s generic/361 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/362 [not run] this test requires richacl support on $SCRATCH_DEV generic/363 [not run] this test requires richacl support on $SCRATCH_DEV generic/364 [not run] this test requires richacl support on $SCRATCH_DEV generic/365 [not run] this test requires richacl support on $SCRATCH_DEV generic/366 [not run] this test requires richacl support on $SCRATCH_DEV generic/367 [not run] this test requires richacl support on $SCRATCH_DEV generic/368 [not run] this test requires richacl support on $SCRATCH_DEV generic/369 [not run] this test requires richacl support on $SCRATCH_DEV generic/370 [not run] this test requires richacl support on $SCRATCH_DEV generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/372 [not run] Reflink not supported by scratch filesystem type: ceph generic/373 [not run] Reflink not supported by scratch filesystem type: ceph generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph generic/375 0s generic/376 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/377 1s generic/378 1s generic/379 [not run] disk quotas not supported by this filesystem type: ceph generic/380 [not run] disk quotas not supported by this filesystem type: ceph generic/381 [not run] disk quotas not supported by this filesystem type: ceph generic/382 [not run] disk quotas not supported by this filesystem type: ceph generic/383 [not run] disk quotas not supported by this filesystem type: ceph generic/384 [not run] disk quotas not supported by this filesystem type: ceph generic/385 [not run] disk quotas not supported by this filesystem type: ceph generic/386 [not run] disk quotas not supported by this filesystem type: ceph generic/389 [not run] O_TMPFILE is not supported generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/392 [not run] ceph does not support shutdown generic/393 1s generic/394 1s generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test generic/400 [not run] disk quotas not supported by this filesystem type: ceph generic/401 1s generic/402 [not run] filesystem ceph timestamp bounds are unknown generic/403 1s generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/406 3s generic/407 [not run] Reflink not supported by test filesystem type: ceph generic/408 [not run] Dedupe not supported by test filesystem type: ceph generic/409 [not run] require 172.21.15.118:6789:/scratch to be local device generic/410 [not run] require 172.21.15.118:6789:/scratch to be local device generic/411 [not run] require 172.21.15.118:6789:/scratch to be local device generic/412 - output mismatch (see /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/412.out.bad) --- tests/generic/412.out 2024-02-18 10:01:38.880992902 +0000 +++ /tmp/tmp.pjmFjSgc0uxfstests-dev/results//generic/412.out.bad 2024-02-18 10:27:26.206923311 +0000 @@ -4,6 +4,6 @@ wrote 32768/32768 bytes at offset 65536 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) File digest before unmounting the filesystem: -3c5ca3c3ab42f4b04d7e7eb0b0d4d806 SCRATCH_MNT/foo +84c48b8da7e9b9d3c5667ad9819debd9 SCRATCH_MNT/foo File digest after mounting again the filesystem: -3c5ca3c3ab42f4b04d7e7eb0b0d4d806 SCRATCH_MNT/foo +84c48b8da7e9b9d3c5667ad9819debd9 SCRATCH_MNT/foo generic/413 [not run] mount 172.21.15.118:6789:/scratch with dax failed generic/414 [not run] Reflink not supported by scratch filesystem type: ceph generic/417 [not run] ceph does not support shutdown generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/423 1s generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) generic/426 22s generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/428 0s generic/430 1s generic/431 0s generic/432 1s generic/433 0s generic/434 0s generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/437 1s generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test generic/441 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/443 1s generic/444 0s generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/448 0s generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/450 7s generic/451 30s generic/452 2s generic/453 [not run] ceph does not allow unrestricted byte streams for names generic/454 [not run] ceph does not allow unrestricted byte streams for names generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/458 [not run] Reflink not supported by scratch filesystem type: ceph generic/460 261s generic/462 [not run] mount 172.21.15.118:6789:/scratch with dax failed generic/463 [not run] Reflink not supported by test filesystem type: ceph generic/465 7s generic/466 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/467 3s generic/468 [not run] ceph does not support shutdown generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/470 [not run] This test requires a valid $LOGWRITES_DEV generic/471 38s generic/472 [not run] swapfiles are not supported generic/474 [not run] ceph does not support shutdown generic/477 6s generic/478 12s generic/479 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/480 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/481 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/483 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/484 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/486 2s generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/489 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/490 1s generic/491 [not run] ceph does not support freezing generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) generic/493 [not run] swapfiles are not supported generic/494 [not run] swapfiles are not supported generic/495 [not run] swapfiles are not supported generic/496 [not run] swapfiles are not supported generic/497 [not run] swapfiles are not supported generic/498 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/501 [not run] Reflink not supported by scratch filesystem type: ceph generic/502 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/504 0s generic/505 [not run] ceph does not support shutdown generic/506 [not run] disk quotas not supported by this filesystem type: ceph generic/507 [not run] file system doesn't support chattr +ASai generic/508 [not run] lsattr not supported by test filesystem type: ceph generic/509 [not run] O_TMPFILE is not supported generic/510 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/513 [not run] Reflink not supported by scratch filesystem type: ceph generic/514 [not run] Reflink not supported by scratch filesystem type: ceph generic/515 [not run] Reflink not supported by scratch filesystem type: ceph generic/516 [not run] Dedupe not supported by test filesystem type: ceph generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph generic/518 [not run] Reflink not supported by scratch filesystem type: ceph generic/519 [not run] FIBMAP not supported by this filesystem generic/520 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/523 1s generic/524 184s generic/525 [not run] filesystem does not support huge file size generic/526 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/527 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/528 1s generic/529 1s generic/530 [not run] ceph does not support shutdown generic/531 [not run] O_TMPFILE is not supported generic/532 0s generic/533 1s generic/534 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/535 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/536 [not run] ceph does not support shutdown generic/537 [not run] FSTRIM not supported generic/538 843s generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/540 [not run] Reflink not supported by scratch filesystem type: ceph generic/541 [not run] Reflink not supported by scratch filesystem type: ceph generic/542 [not run] Reflink not supported by scratch filesystem type: ceph generic/543 [not run] Reflink not supported by scratch filesystem type: ceph generic/544 [not run] Reflink not supported by scratch filesystem type: ceph generic/545 [not run] file system doesn't support chattr +i generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/547 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test generic/552 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) generic/554 [not run] swapfiles are not supported generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) generic/556 [not run] ceph does not support casefold feature generic/557 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/563 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/564 1s generic/565 1s generic/566 [not run] disk quotas not supported by this filesystem type: ceph generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/570 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/571 [not run] Require fcntl setlease support generic/572 [not run] fsverity utility required, skipped this test generic/573 [not run] fsverity utility required, skipped this test generic/574 [not run] fsverity utility required, skipped this test generic/575 [not run] fsverity utility required, skipped this test generic/576 [not run] fsverity utility required, skipped this test generic/577 [not run] fsverity utility required, skipped this test generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/587 [not run] disk quotas not supported by this filesystem type: ceph generic/588 [not run] Reflink not supported by scratch filesystem type: ceph generic/591 0s generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test generic/594 [not run] disk quotas not supported by this filesystem type: ceph generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test generic/596 [not run] file system doesn't support chattr +S generic/597 1s generic/598 2s generic/599 [not run] ceph does not support shutdown generic/600 [not run] disk quotas not supported by this filesystem type: ceph generic/601 [not run] disk quotas not supported by this filesystem type: ceph generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test generic/603 [not run] disk quotas not supported by this filesystem type: ceph generic/604 6s generic/605 [not run] mount 172.21.15.118:6789:/scratch with dax=always failed generic/606 [not run] mount 172.21.15.118:6789:/scratch with dax=always failed generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) generic/608 [not run] mount 172.21.15.118:6789:/scratch with dax=always failed generic/609 1s generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/611 1s generic/612 [not run] Reflink not supported by test filesystem type: ceph generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test generic/614 [not run] test requires delayed allocation buffered writes generic/618 1s generic/620 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test generic/623 [not run] ceph does not support shutdown generic/624 [not run] fsverity utility required, skipped this test generic/625 [not run] fsverity utility required, skipped this test generic/626 [not run] kernel doesn't support renameat2 syscall generic/628 [not run] Reflink not supported by scratch filesystem type: ceph generic/629 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph generic/632 2s generic/633 2s generic/634 2s generic/635 [not run] ceph does not support shutdown generic/636 [not run] swapfiles are not supported generic/637 1s generic/638 0s generic/639 1s generic/640 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/641 [not run] swapfiles are not supported generic/644 1s generic/645 121s generic/646 [not run] ceph does not support shutdown generic/647 1s generic/651 [not run] Reflink not supported by scratch filesystem type: ceph generic/652 [not run] Reflink not supported by scratch filesystem type: ceph generic/653 [not run] Reflink not supported by scratch filesystem type: ceph generic/654 [not run] Reflink not supported by scratch filesystem type: ceph generic/655 [not run] Reflink not supported by scratch filesystem type: ceph generic/657 [not run] Reflink not supported by scratch filesystem type: ceph generic/658 [not run] Reflink not supported by scratch filesystem type: ceph generic/659 [not run] Reflink not supported by scratch filesystem type: ceph generic/660 [not run] Reflink not supported by scratch filesystem type: ceph generic/661 [not run] Reflink not supported by scratch filesystem type: ceph generic/662 [not run] Reflink not supported by scratch filesystem type: ceph generic/663 [not run] Reflink not supported by scratch filesystem type: ceph generic/664 [not run] Reflink not supported by scratch filesystem type: ceph generic/665 [not run] Reflink not supported by scratch filesystem type: ceph generic/666 [not run] Reflink not supported by scratch filesystem type: ceph generic/667 [not run] Reflink not supported by scratch filesystem type: ceph generic/668 [not run] Reflink not supported by scratch filesystem type: ceph generic/669 [not run] Reflink not supported by scratch filesystem type: ceph generic/673 [not run] Reflink not supported by scratch filesystem type: ceph generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph generic/675 [not run] Reflink not supported by scratch filesystem type: ceph generic/676 793s generic/677 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/678 [not run] kernel does not support IO_URING generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/680 1s generic/681 [not run] disk quotas not supported by this filesystem type: ceph generic/682 [not run] disk quotas not supported by this filesystem type: ceph generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/689 1s generic/690 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/692 [not run] fsverity utility required, skipped this test generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test generic/695 [not run] require 172.21.15.118:6789:/scratch to be valid block disk generic/696 1s generic/697 1s generic/698 1s generic/699 [not run] overlayfs doesn't support idmappped layers generic/700 [not run] kernel doesn't support renameat2 syscall generic/702 [not run] Reflink not supported by scratch filesystem type: ceph generic/703 [not run] kernel does not support IO_URING generic/704 [not run] require 172.21.15.118:6789:/test to be valid block disk generic/706 1s generic/708 0s generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph generic/721 [not run] xfs_io startupdate support is missing generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/728 4s generic/729 1s generic/730 [not run] require 172.21.15.118:6789:/test to be valid block disk generic/731 [not run] require 172.21.15.118:6789:/test to be valid block disk generic/732 1s generic/734 [not run] Reflink not supported by test filesystem type: ceph generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/736 56s generic/737 [not run] ceph does not support shutdown generic/738 [not run] ceph does not support freezing generic/739 [not run] mount option "test_dummy_encryption" not allowed in this test shared/002 [not run] not suitable for this filesystem type: ceph shared/032 [not run] not suitable for this filesystem type: ceph Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 generic/734 generic/735 generic/736 generic/737 generic/738 generic/739 shared/002 shared/032 Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/014 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/129 generic/130 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/240 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 generic/734 generic/735 generic/737 generic/738 generic/739 shared/002 shared/032 Failures: generic/029 generic/075 generic/091 generic/098 generic/112 generic/198 generic/263 generic/412 Failed 8 of 604 tests 2024-02-18T11:11:33.904 INFO:tasks.cephfs.test_fscrypt:Command stderr - 2024-02-18T11:11:33.904 DEBUG:teuthology.orchestra.run.smithi204:> sudo userdel --force --remove fsgqa 2024-02-18T11:11:34.844 DEBUG:teuthology.orchestra.run.smithi204:> sudo userdel --force --remove 123456-fsgqa 2024-02-18T11:11:35.539 DEBUG:teuthology.orchestra.run.smithi204:> sudo groupdel fsgqa 2024-02-18T11:11:35.650 INFO:teuthology.orchestra.run.smithi204.stderr:groupdel: group 'fsgqa' does not exist 2024-02-18T11:11:35.654 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-02-18T11:11:35.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:35.655 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.pjmFjSgc0uxfstests-dev/results) 2024-02-18T11:11:35.748 INFO:teuthology.orchestra.run.smithi204.stdout: File: /tmp/tmp.pjmFjSgc0uxfstests-dev/results 2024-02-18T11:11:35.748 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-02-18T11:11:35.749 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 801h/2049d Inode: 655400 Links: 5 2024-02-18T11:11:35.749 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-18T11:11:35.749 INFO:teuthology.orchestra.run.smithi204.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-02-18T11:11:35.749 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-02-18 10:08:02.876610527 +0000 2024-02-18T11:11:35.749 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-02-18 11:11:33.833346227 +0000 2024-02-18T11:11:35.749 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-02-18 11:11:33.833346227 +0000 2024-02-18T11:11:35.749 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-02-18 10:08:02.876610527 +0000 2024-02-18T11:11:35.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:35.753 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-02-18T11:11:35.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:35.848 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.pjmFjSgc0uxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-02-18T11:11:36.358 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.pjmFjSgc0uxfstests-dev to /var/log/ceph. 2024-02-18T11:11:36.358 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf /tmp/tmp.pjmFjSgc0uxfstests-dev 2024-02-18T11:11:36.842 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf /tmp/tmp.qNdAS3jX7mxfsprogs-dev 2024-02-18T11:11:37.072 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-18T11:11:37.073 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-18T11:11:37.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-18T11:11:37.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-18T11:11:37.542 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-18T11:11:37.542 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T11:11:37.543 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T11:11:37.608 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T11:11:37.608 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T11:11:37.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T11:11:41.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.708+0000 7f9f43bbc640 1 Processor -- start 2024-02-18T11:11:41.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.708+0000 7f9f43bbc640 1 -- start start 2024-02-18T11:11:41.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.708+0000 7f9f43bbc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:41.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.708+0000 7f9f43bbc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c149c40 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.708+0000 7f9f43bbc640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c0b5b60 con 0x7f9f3c0bc0a0 2024-02-18T11:11:41.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f43bbc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0b5e40 con 0x7f9f3c06fda0 2024-02-18T11:11:41.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f42159640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9f3c14a0d0 0x7f9f3c14a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45412/0 (socket says 172.21.15.118:45412) 2024-02-18T11:11:41.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f42159640 1 -- 172.21.15.118:0/2600287484 learned_addr learned my addr 172.21.15.118:0/2600287484 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f41157640 1 --2- 172.21.15.118:0/2600287484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183747104 0 0) 0x7f9f3c149c40 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f28003520 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232320123 0 0) 0x7f9f3c0b5b60 con 0x7f9f3c0bc0a0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c149c40 con 0x7f9f3c0bc0a0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 763629306 0 0) 0x7f9f28003520 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f41157640 1 -- 172.21.15.118:0/2600287484 >> v1:172.21.15.164:6789/0 conn(0x7f9f3c0bc0a0 legacy=0x7f9f3c143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f41157640 1 -- 172.21.15.118:0/2600287484 >> v1:172.21.15.118:6789/0 conn(0x7f9f3c14a0d0 legacy=0x7f9f3c14a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.709+0000 7f9f41157640 1 -- 172.21.15.118:0/2600287484 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0b6120 con 0x7f9f3c06fda0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.710+0000 7f9f41157640 1 --2- 172.21.15.118:0/2600287484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c0b5540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097d0 tx=0x7f9f2c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97435b55316d682 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.710+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340019f0 con 0x7f9f3c06fda0 2024-02-18T11:11:41.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.710+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c031580 con 0x7f9f3c06fda0 2024-02-18T11:11:41.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.710+0000 7f9f40956640 1 -- 172.21.15.118:0/2600287484 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c031910 con 0x7f9f3c06fda0 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.711+0000 7f9f43bbc640 1 -- 172.21.15.118:0/2600287484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 msgr2=0x7f9f3c0b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.711+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/2600287484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c0b5540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097d0 tx=0x7f9f2c02b8a0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.711+0000 7f9f43bbc640 1 -- 172.21.15.118:0/2600287484 shutdown_connections 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.711+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/2600287484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c0b5540 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.711+0000 7f9f43bbc640 1 -- 172.21.15.118:0/2600287484 >> 172.21.15.118:0/2600287484 conn(0x7f9f3c0bf330 msgr2=0x7f9f3c0bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.711+0000 7f9f43bbc640 1 -- 172.21.15.118:0/2600287484 shutdown_connections 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.711+0000 7f9f43bbc640 1 -- 172.21.15.118:0/2600287484 wait complete. 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.712+0000 7f9f43bbc640 1 Processor -- start 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.712+0000 7f9f43bbc640 1 -- start start 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.712+0000 7f9f43bbc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.712+0000 7f9f43bbc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f3c0bc0a0 0x7f9f3c1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:41.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.712+0000 7f9f43bbc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c14a0d0 0x7f9f3c13ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f43bbc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c140130 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f43bbc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c1481f0 con 0x7f9f3c0bc0a0 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f43bbc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c149720 con 0x7f9f3c06fda0 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c14a0d0 0x7f9f3c13ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c14a0d0 0x7f9f3c13ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45268/0 (socket says 172.21.15.118:45268) 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 -- 172.21.15.118:0/1567273226 learned_addr learned my addr 172.21.15.118:0/1567273226 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f41157640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f3c0bc0a0 0x7f9f3c1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f41958640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 -- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 msgr2=0x7f9f3c147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 -- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f3c0bc0a0 msgr2=0x7f9f3c1488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f3c0bc0a0 0x7f9f3c1488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 -- 172.21.15.118:0/1567273226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c009400 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f42159640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c14a0d0 0x7f9f3c13ab40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400cc20 tx=0x7f9f3400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:41.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f327fc640 1 -- 172.21.15.118:0/1567273226 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400ce30 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f327fc640 1 -- 172.21.15.118:0/1567273226 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34012400 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f327fc640 1 -- 172.21.15.118:0/1567273226 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34012790 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c148de0 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.713+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c149950 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.714+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c074af0 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.715+0000 7f9f327fc640 1 -- 172.21.15.118:0/1567273226 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9f340128f0 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.715+0000 7f9f327fc640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f2006bca0 0x7f9f2006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:41.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.715+0000 7f9f327fc640 1 -- 172.21.15.118:0/1567273226 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f3408ab30 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.715+0000 7f9f41958640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f2006bca0 0x7f9f2006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:41.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.716+0000 7f9f41958640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f2006bca0 0x7f9f2006e160 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9f380011e0 tx=0x7f9f38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:41.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.720+0000 7f9f327fc640 1 -- 172.21.15.118:0/1567273226 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f34055450 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.899+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f3c148de0 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.900+0000 7f9f327fc640 1 -- 172.21.15.118:0/1567273226 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f9f3c148de0 con 0x7f9f3c14a0d0 2024-02-18T11:11:41.902 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:41.902 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:33.001470+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:01:29.722354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-18T10:01:30.305941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T11:11:41.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f2006bca0 msgr2=0x7f9f2006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f2006bca0 0x7f9f2006e160 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9f380011e0 tx=0x7f9f38009040 comp rx=0 tx=0).stop 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c14a0d0 msgr2=0x7f9f3c13ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c14a0d0 0x7f9f3c13ab40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400cc20 tx=0x7f9f3400a430 comp rx=0 tx=0).stop 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 shutdown_connections 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9f2006bca0 0x7f9f2006e160 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f3c14a0d0 0x7f9f3c13ab40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f3c0bc0a0 0x7f9f3c1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 --2- 172.21.15.118:0/1567273226 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f3c06fda0 0x7f9f3c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 >> 172.21.15.118:0/1567273226 conn(0x7f9f3c0bf330 msgr2=0x7f9f3c0ba4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 shutdown_connections 2024-02-18T11:11:41.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:41.902+0000 7f9f43bbc640 1 -- 172.21.15.118:0/1567273226 wait complete. 2024-02-18T11:11:42.369 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:01:29.722354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:01:30.305941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T11:11:42.370 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T11:11:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.472+0000 7fe528d0d640 1 Processor -- start 2024-02-18T11:11:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.472+0000 7fe528d0d640 1 -- start start 2024-02-18T11:11:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe528d0d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe52406e040 0x7fe5240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe528d0d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe52406e420 0x7fe5240709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:42.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe528d0d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe524070f00 0x7fe52406c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe528d0d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240b3e10 con 0x7fe52406e040 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe528d0d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240b8fe0 con 0x7fe52406e420 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe528d0d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240b9210 con 0x7fe524070f00 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe52259c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe52406e040 0x7fe5240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe52259c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe52406e040 0x7fe5240b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45280/0 (socket says 172.21.15.118:45280) 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe52259c640 1 -- 172.21.15.118:0/2788328348 learned_addr learned my addr 172.21.15.118:0/2788328348 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe522d9d640 1 --2- 172.21.15.118:0/2788328348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe524070f00 0x7fe52406c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.473+0000 7fe51bfff640 1 --2- 172.21.15.118:0/2788328348 >> v2:172.21.15.164:3300/0 conn(0x7fe52406e420 0x7fe5240709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe52259c640 1 -- 172.21.15.118:0/2788328348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe524070f00 msgr2=0x7fe52406c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe52259c640 1 --2- 172.21.15.118:0/2788328348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe524070f00 0x7fe52406c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe52259c640 1 -- 172.21.15.118:0/2788328348 >> v2:172.21.15.164:3300/0 conn(0x7fe52406e420 msgr2=0x7fe5240709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe52259c640 1 --2- 172.21.15.118:0/2788328348 >> v2:172.21.15.164:3300/0 conn(0x7fe52406e420 0x7fe5240709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe52259c640 1 -- 172.21.15.118:0/2788328348 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524071370 con 0x7fe52406e040 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe522d9d640 1 --2- 172.21.15.118:0/2788328348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe524070f00 0x7fe52406c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe51bfff640 1 --2- 172.21.15.118:0/2788328348 >> v2:172.21.15.164:3300/0 conn(0x7fe52406e420 0x7fe5240709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:42.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.491+0000 7fe52259c640 1 --2- 172.21.15.118:0/2788328348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe52406e040 0x7fe5240b8aa0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe5240bab50 tx=0x7fe51402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144aee073576fb23 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:42.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe521d9b640 1 -- 172.21.15.118:0/2788328348 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51402cc60 con 0x7fe52406e040 2024-02-18T11:11:42.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe521d9b640 1 -- 172.21.15.118:0/2788328348 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51402cdc0 con 0x7fe52406e040 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe521d9b640 1 -- 172.21.15.118:0/2788328348 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514034660 con 0x7fe52406e040 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 -- 172.21.15.118:0/2788328348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe52406e040 msgr2=0x7fe5240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2788328348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe52406e040 0x7fe5240b8aa0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe5240bab50 tx=0x7fe51402beb0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 -- 172.21.15.118:0/2788328348 shutdown_connections 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2788328348 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe524070f00 0x7fe52406c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2788328348 >> v2:172.21.15.164:3300/0 conn(0x7fe52406e420 0x7fe5240709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2788328348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe52406e040 0x7fe5240b8aa0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 -- 172.21.15.118:0/2788328348 >> 172.21.15.118:0/2788328348 conn(0x7fe52406adc0 msgr2=0x7fe52406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 -- 172.21.15.118:0/2788328348 shutdown_connections 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.492+0000 7fe528d0d640 1 -- 172.21.15.118:0/2788328348 wait complete. 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 Processor -- start 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 -- start start 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe52406e040 0x7fe524156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe52406e420 0x7fe5240b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe524070f00 0x7fe5241ee110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415b6e0 con 0x7fe524070f00 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe524156650 con 0x7fe52406e040 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe528d0d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52415b8c0 con 0x7fe52406e420 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe522d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe524070f00 0x7fe5241ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe522d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe524070f00 0x7fe5241ee110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45288/0 (socket says 172.21.15.118:45288) 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.494+0000 7fe522d9d640 1 -- 172.21.15.118:0/2571848369 learned_addr learned my addr 172.21.15.118:0/2571848369 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe51bfff640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe52406e420 0x7fe5240b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe52259c640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe52406e040 0x7fe524156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe522d9d640 1 -- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe52406e420 msgr2=0x7fe5240b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe522d9d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe52406e420 0x7fe5240b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe522d9d640 1 -- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe52406e040 msgr2=0x7fe524156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe522d9d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe52406e040 0x7fe524156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe522d9d640 1 -- 172.21.15.118:0/2571848369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51400b580 con 0x7fe524070f00 2024-02-18T11:11:42.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe522d9d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe524070f00 0x7fe5241ee110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe51c007df0 tx=0x7fe51c0124a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:42.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe51affd640 1 -- 172.21.15.118:0/2571848369 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c003990 con 0x7fe524070f00 2024-02-18T11:11:42.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe51affd640 1 -- 172.21.15.118:0/2571848369 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c014040 con 0x7fe524070f00 2024-02-18T11:11:42.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5241f1820 con 0x7fe524070f00 2024-02-18T11:11:42.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe51affd640 1 -- 172.21.15.118:0/2571848369 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c003d10 con 0x7fe524070f00 2024-02-18T11:11:42.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.495+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5241f1de0 con 0x7fe524070f00 2024-02-18T11:11:42.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.496+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe524075150 con 0x7fe524070f00 2024-02-18T11:11:42.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.497+0000 7fe51affd640 1 -- 172.21.15.118:0/2571848369 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe51c004030 con 0x7fe524070f00 2024-02-18T11:11:42.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.497+0000 7fe51affd640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe50406bc70 0x7fe50406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:42.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.497+0000 7fe51affd640 1 -- 172.21.15.118:0/2571848369 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe51c08e380 con 0x7fe524070f00 2024-02-18T11:11:42.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.497+0000 7fe52259c640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe50406bc70 0x7fe50406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:42.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.498+0000 7fe52259c640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe50406bc70 0x7fe50406e130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe514036000 tx=0x7fe514030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:42.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.502+0000 7fe51affd640 1 -- 172.21.15.118:0/2571848369 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe51c058b40 con 0x7fe524070f00 2024-02-18T11:11:42.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.680+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5241f2000 con 0x7fe524070f00 2024-02-18T11:11:42.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.909+0000 7fe51affd640 1 -- 172.21.15.118:0/2571848369 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe51c01d0a0 con 0x7fe524070f00 2024-02-18T11:11:42.910 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T11:11:42.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe50406bc70 msgr2=0x7fe50406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:42.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe50406bc70 0x7fe50406e130 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe514036000 tx=0x7fe514030000 comp rx=0 tx=0).stop 2024-02-18T11:11:42.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe524070f00 msgr2=0x7fe5241ee110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe524070f00 0x7fe5241ee110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe51c007df0 tx=0x7fe51c0124a0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 shutdown_connections 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe50406bc70 0x7fe50406e130 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe524070f00 0x7fe5241ee110 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe52406e420 0x7fe5240b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 --2- 172.21.15.118:0/2571848369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe52406e040 0x7fe524156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 >> 172.21.15.118:0/2571848369 conn(0x7fe52406adc0 msgr2=0x7fe52415ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 shutdown_connections 2024-02-18T11:11:42.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:42.911+0000 7fe528d0d640 1 -- 172.21.15.118:0/2571848369 wait complete. 2024-02-18T11:11:42.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.026+0000 7fce1d12c640 1 Processor -- start 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.026+0000 7fce1d12c640 1 -- start start 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce1d12c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce1806e040 0x7fce180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce1d12c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce180b8fe0 con 0x7fce1806e420 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce1d12c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce180b9210 con 0x7fce180710d0 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce1d12c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce180b3e10 con 0x7fce1806e040 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce16d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce1806e040 0x7fce180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce16d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce1806e040 0x7fce180b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45294/0 (socket says 172.21.15.118:45294) 2024-02-18T11:11:43.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce16d9d640 1 -- 172.21.15.118:0/47603700 learned_addr learned my addr 172.21.15.118:0/47603700 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.027+0000 7fce15d9b640 1 -- 172.21.15.118:0/47603700 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082448794 0 0) 0x7fce180b8fe0 con 0x7fce1806e420 2024-02-18T11:11:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.035+0000 7fce15d9b640 1 -- 172.21.15.118:0/47603700 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce00003500 con 0x7fce1806e420 2024-02-18T11:11:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.035+0000 7fce15d9b640 1 -- 172.21.15.118:0/47603700 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101637991 0 0) 0x7fce180b9210 con 0x7fce180710d0 2024-02-18T11:11:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.035+0000 7fce15d9b640 1 -- 172.21.15.118:0/47603700 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce180b8fe0 con 0x7fce180710d0 2024-02-18T11:11:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.036+0000 7fce16d9d640 1 -- 172.21.15.118:0/47603700 >> v1:172.21.15.164:6789/0 conn(0x7fce180710d0 legacy=0x7fce18163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.036+0000 7fce16d9d640 1 -- 172.21.15.118:0/47603700 >> v1:172.21.15.118:6789/0 conn(0x7fce1806e420 legacy=0x7fce180709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.036+0000 7fce16d9d640 1 -- 172.21.15.118:0/47603700 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180b3160 con 0x7fce1806e040 2024-02-18T11:11:43.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.036+0000 7fce16d9d640 1 --2- 172.21.15.118:0/47603700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180b8aa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009870 tx=0x7fce0c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f8f54b017cefda server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce15d9b640 1 -- 172.21.15.118:0/47603700 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c02f840 con 0x7fce1806e040 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce15d9b640 1 -- 172.21.15.118:0/47603700 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c02f9a0 con 0x7fce1806e040 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce15d9b640 1 -- 172.21.15.118:0/47603700 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c02fd10 con 0x7fce1806e040 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce1d12c640 1 -- 172.21.15.118:0/47603700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 msgr2=0x7fce180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce1d12c640 1 --2- 172.21.15.118:0/47603700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180b8aa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009870 tx=0x7fce0c02ba20 comp rx=0 tx=0).stop 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce1d12c640 1 -- 172.21.15.118:0/47603700 shutdown_connections 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce1d12c640 1 --2- 172.21.15.118:0/47603700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180b8aa0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce1d12c640 1 -- 172.21.15.118:0/47603700 >> 172.21.15.118:0/47603700 conn(0x7fce1806adc0 msgr2=0x7fce1806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce1d12c640 1 -- 172.21.15.118:0/47603700 shutdown_connections 2024-02-18T11:11:43.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.037+0000 7fce1d12c640 1 -- 172.21.15.118:0/47603700 wait complete. 2024-02-18T11:11:43.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 Processor -- start 2024-02-18T11:11:43.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 -- start start 2024-02-18T11:11:43.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180bb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce1806e420 0x7fce181e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce180710d0 0x7fce180b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce180bbe10 con 0x7fce1806e040 2024-02-18T11:11:43.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce180b4490 con 0x7fce180710d0 2024-02-18T11:11:43.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce1d12c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce180b4a10 con 0x7fce1806e420 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce16d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce16d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180bb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45298/0 (socket says 172.21.15.118:45298) 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.039+0000 7fce16d9d640 1 -- 172.21.15.118:0/2787753950 learned_addr learned my addr 172.21.15.118:0/2787753950 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce1759e640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce180710d0 0x7fce180b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce16d9d640 1 -- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce1806e420 msgr2=0x7fce181e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce1659c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce1806e420 0x7fce181e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce16d9d640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce1806e420 0x7fce181e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce16d9d640 1 -- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce180710d0 msgr2=0x7fce180b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce16d9d640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce180710d0 0x7fce180b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce16d9d640 1 -- 172.21.15.118:0/2787753950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c0094d0 con 0x7fce1806e040 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce1759e640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce180710d0 0x7fce180b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce1659c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce1806e420 0x7fce181e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce16d9d640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180bb8d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fce0c000c00 tx=0x7fce0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fcdff7fe640 1 -- 172.21.15.118:0/2787753950 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c037c40 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fcdff7fe640 1 -- 172.21.15.118:0/2787753950 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c037da0 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce180b5a40 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fcdff7fe640 1 -- 172.21.15.118:0/2787753950 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c041640 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.040+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce18150070 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.041+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce18075150 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.041+0000 7fcdff7fe640 1 -- 172.21.15.118:0/2787753950 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fce0c0417a0 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.042+0000 7fcdff7fe640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fce0406bca0 0x7fce0406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.042+0000 7fcdff7fe640 1 -- 172.21.15.118:0/2787753950 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce0c03c070 con 0x7fce1806e040 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.042+0000 7fce1659c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fce0406bca0 0x7fce0406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.042+0000 7fce1659c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fce0406bca0 0x7fce0406e160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce181e34f0 tx=0x7fce08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.050+0000 7fcdff7fe640 1 -- 172.21.15.118:0/2787753950 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce0c0775f0 con 0x7fce1806e040 2024-02-18T11:11:43.230 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.229+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce18074af0 con 0x7fce1806e040 2024-02-18T11:11:43.231 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.230+0000 7fcdff7fe640 1 -- 172.21.15.118:0/2787753950 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce0c07acb0 con 0x7fce1806e040 2024-02-18T11:11:43.231 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T11:11:43.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fce0406bca0 msgr2=0x7fce0406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fce0406bca0 0x7fce0406e160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce181e34f0 tx=0x7fce08009040 comp rx=0 tx=0).stop 2024-02-18T11:11:43.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 msgr2=0x7fce180bb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180bb8d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fce0c000c00 tx=0x7fce0c004730 comp rx=0 tx=0).stop 2024-02-18T11:11:43.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 shutdown_connections 2024-02-18T11:11:43.233 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fce0406bca0 0x7fce0406e160 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce180710d0 0x7fce180b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fce1806e420 0x7fce181e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 --2- 172.21.15.118:0/2787753950 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce1806e040 0x7fce180bb8d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 >> 172.21.15.118:0/2787753950 conn(0x7fce1806adc0 msgr2=0x7fce1806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:43.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 shutdown_connections 2024-02-18T11:11:43.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.232+0000 7fce1d12c640 1 -- 172.21.15.118:0/2787753950 wait complete. 2024-02-18T11:11:43.244 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T11:11:43.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.346+0000 7fed80681640 1 Processor -- start 2024-02-18T11:11:43.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.346+0000 7fed80681640 1 -- start start 2024-02-18T11:11:43.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed80681640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed78072be0 0x7fed7814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed80681640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed7806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed80681640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed780ba280 con 0x7fed780711e0 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed80681640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed780bab50 con 0x7fed78072be0 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed80681640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed780ba680 con 0x7fed780b91e0 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7dc1c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed78072be0 0x7fed7814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7dc1c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed78072be0 0x7fed7814bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45304/0 (socket says 172.21.15.118:45304) 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7dc1c640 1 -- 172.21.15.118:0/1878556471 learned_addr learned my addr 172.21.15.118:0/1878556471 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7ec1e640 1 --2- 172.21.15.118:0/1878556471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed7806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7dc1c640 1 -- 172.21.15.118:0/1878556471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 msgr2=0x7fed7806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7dc1c640 1 --2- 172.21.15.118:0/1878556471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed7806af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7dc1c640 1 -- 172.21.15.118:0/1878556471 >> v1:172.21.15.164:6789/0 conn(0x7fed780711e0 legacy=0x7fed78149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:43.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.347+0000 7fed7dc1c640 1 -- 172.21.15.118:0/1878556471 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed780ba870 con 0x7fed78072be0 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.348+0000 7fed7dc1c640 1 --2- 172.21.15.118:0/1878556471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78072be0 0x7fed7814bed0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fed680098a0 tx=0x7fed6802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699842dcf03c1f71 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.348+0000 7fed7d41b640 1 -- 172.21.15.118:0/1878556471 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68031640 con 0x7fed78072be0 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.348+0000 7fed7d41b640 1 -- 172.21.15.118:0/1878556471 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed680317a0 con 0x7fed78072be0 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.348+0000 7fed7d41b640 1 -- 172.21.15.118:0/1878556471 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68031b30 con 0x7fed78072be0 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 -- 172.21.15.118:0/1878556471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78072be0 msgr2=0x7fed7814bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 --2- 172.21.15.118:0/1878556471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78072be0 0x7fed7814bed0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fed680098a0 tx=0x7fed6802b8f0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 -- 172.21.15.118:0/1878556471 shutdown_connections 2024-02-18T11:11:43.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 --2- 172.21.15.118:0/1878556471 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed7806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 --2- 172.21.15.118:0/1878556471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed78072be0 0x7fed7814bed0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 -- 172.21.15.118:0/1878556471 >> 172.21.15.118:0/1878556471 conn(0x7fed780be420 msgr2=0x7fed780be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:43.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 -- 172.21.15.118:0/1878556471 shutdown_connections 2024-02-18T11:11:43.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.349+0000 7fed80681640 1 -- 172.21.15.118:0/1878556471 wait complete. 2024-02-18T11:11:43.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.350+0000 7fed80681640 1 Processor -- start 2024-02-18T11:11:43.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.350+0000 7fed80681640 1 -- start start 2024-02-18T11:11:43.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.350+0000 7fed80681640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed780711e0 0x7fed781d5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed80681640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78072be0 0x7fed7809de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed80681640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed780a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed80681640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed780a2a80 con 0x7fed780711e0 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed80681640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed781d5b60 con 0x7fed78072be0 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed80681640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed781e6210 con 0x7fed780b91e0 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed780711e0 0x7fed781d5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed780711e0 0x7fed781d5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45308/0 (socket says 172.21.15.118:45308) 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 -- 172.21.15.118:0/2619631656 learned_addr learned my addr 172.21.15.118:0/2619631656 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7dc1c640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78072be0 0x7fed7809de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7ec1e640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed780a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 -- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 msgr2=0x7fed780a38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed780a38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 -- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78072be0 msgr2=0x7fed7809de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78072be0 0x7fed7809de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 -- 172.21.15.118:0/2619631656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed680094d0 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7ec1e640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed780a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7dc1c640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78072be0 0x7fed7809de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed7e41d640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed780711e0 0x7fed781d5620 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c430 tx=0x7fed7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed6effd640 1 -- 172.21.15.118:0/2619631656 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74011790 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed6effd640 1 -- 172.21.15.118:0/2619631656 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed740118f0 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed781e5450 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed6effd640 1 -- 172.21.15.118:0/2619631656 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74011ca0 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.351+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed781e5a10 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.352+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed780b54b0 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.353+0000 7fed6effd640 1 -- 172.21.15.118:0/2619631656 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fed7401c460 con 0x7fed780711e0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.353+0000 7fed6effd640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed5c06bc70 0x7fed5c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.353+0000 7fed7dc1c640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed5c06bc70 0x7fed5c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.353+0000 7fed6effd640 1 -- 172.21.15.118:0/2619631656 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed7408a680 con 0x7fed780711e0 2024-02-18T11:11:43.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.354+0000 7fed7dc1c640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed5c06bc70 0x7fed5c06e130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed68036000 tx=0x7fed6803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.358+0000 7fed6effd640 1 -- 172.21.15.118:0/2619631656 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed74054ef0 con 0x7fed780711e0 2024-02-18T11:11:43.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.531+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed78075150 con 0x7fed780711e0 2024-02-18T11:11:43.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.532+0000 7fed6effd640 1 -- 172.21.15.118:0/2619631656 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed740585b0 con 0x7fed780711e0 2024-02-18T11:11:43.533 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T11:11:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed5c06bc70 msgr2=0x7fed5c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed5c06bc70 0x7fed5c06e130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed68036000 tx=0x7fed6803c040 comp rx=0 tx=0).stop 2024-02-18T11:11:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed780711e0 msgr2=0x7fed781d5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed780711e0 0x7fed781d5620 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c430 tx=0x7fed7400c8f0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 shutdown_connections 2024-02-18T11:11:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed5c06bc70 0x7fed5c06e130 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed780b91e0 0x7fed780a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed78072be0 0x7fed7809de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 --2- 172.21.15.118:0/2619631656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed780711e0 0x7fed781d5620 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 >> 172.21.15.118:0/2619631656 conn(0x7fed780be420 msgr2=0x7fed7814b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 shutdown_connections 2024-02-18T11:11:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.534+0000 7fed80681640 1 -- 172.21.15.118:0/2619631656 wait complete. 2024-02-18T11:11:43.546 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-18T11:11:43.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.646+0000 7f78fad4b640 1 Processor -- start 2024-02-18T11:11:43.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.646+0000 7f78fad4b640 1 -- start start 2024-02-18T11:11:43.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78fad4b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f40a0ce0 0x7f78f40ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78fad4b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78f414cfd0 0x7f78f414d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78fad4b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f40b4f90 con 0x7f78f4143e10 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78fad4b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f4072fe0 con 0x7f78f414cfd0 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78fad4b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f41441f0 con 0x7f78f40a0ce0 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78f92e8640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78f414cfd0 0x7f78f414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78f92e8640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f78f414cfd0 0x7f78f414d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45324/0 (socket says 172.21.15.118:45324) 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78f92e8640 1 -- 172.21.15.118:0/142053255 learned_addr learned my addr 172.21.15.118:0/142053255 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78f92e8640 1 -- 172.21.15.118:0/142053255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f40a0ce0 msgr2=0x7f78f40ba180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78f92e8640 1 --2- 172.21.15.118:0/142053255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f40a0ce0 0x7f78f40ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78f92e8640 1 -- 172.21.15.118:0/142053255 >> v1:172.21.15.164:6789/0 conn(0x7f78f4143e10 legacy=0x7f78f4070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:43.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.647+0000 7f78f92e8640 1 -- 172.21.15.118:0/142053255 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f40716f0 con 0x7f78f414cfd0 2024-02-18T11:11:43.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78f92e8640 1 --2- 172.21.15.118:0/142053255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f414cfd0 0x7f78f414d480 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009e80 tx=0x7f78ec02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312a24b846f9bc90 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78f37fe640 1 -- 172.21.15.118:0/142053255 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec02caf0 con 0x7f78f414cfd0 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78f37fe640 1 -- 172.21.15.118:0/142053255 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec02cc50 con 0x7f78f414cfd0 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78f37fe640 1 -- 172.21.15.118:0/142053255 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0343f0 con 0x7f78f414cfd0 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 -- 172.21.15.118:0/142053255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f414cfd0 msgr2=0x7f78f414d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 --2- 172.21.15.118:0/142053255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f414cfd0 0x7f78f414d480 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009e80 tx=0x7f78ec02bf50 comp rx=0 tx=0).stop 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 -- 172.21.15.118:0/142053255 shutdown_connections 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 --2- 172.21.15.118:0/142053255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f414cfd0 0x7f78f414d480 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 --2- 172.21.15.118:0/142053255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f40a0ce0 0x7f78f40ba180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 -- 172.21.15.118:0/142053255 >> 172.21.15.118:0/142053255 conn(0x7f78f406bcf0 msgr2=0x7f78f406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 -- 172.21.15.118:0/142053255 shutdown_connections 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.648+0000 7f78fad4b640 1 -- 172.21.15.118:0/142053255 wait complete. 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.649+0000 7f78fad4b640 1 Processor -- start 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78fad4b640 1 -- start start 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78fad4b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f40a0ce0 0x7f78f413db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78fad4b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f4143e10 0x7f78f406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78fad4b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f414cfd0 0x7f78f41e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78fad4b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f413e070 con 0x7f78f40a0ce0 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78fad4b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f41418b0 con 0x7f78f4143e10 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78fad4b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f414cde0 con 0x7f78f414cfd0 2024-02-18T11:11:43.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78f8ae7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f40a0ce0 0x7f78f413db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78f8ae7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f40a0ce0 0x7f78f413db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45340/0 (socket says 172.21.15.118:45340) 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.650+0000 7f78f8ae7640 1 -- 172.21.15.118:0/1626768035 learned_addr learned my addr 172.21.15.118:0/1626768035 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f3fff640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f4143e10 0x7f78f406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f92e8640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f414cfd0 0x7f78f41e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f8ae7640 1 -- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f414cfd0 msgr2=0x7f78f41e4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f8ae7640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f414cfd0 0x7f78f41e4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f8ae7640 1 -- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f4143e10 msgr2=0x7f78f406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f8ae7640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f4143e10 0x7f78f406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f8ae7640 1 -- 172.21.15.118:0/1626768035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec009b30 con 0x7f78f40a0ce0 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f3fff640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f4143e10 0x7f78f406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:43.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f8ae7640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f40a0ce0 0x7f78f413db30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f78e800c440 tx=0x7f78e800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f17fa640 1 -- 172.21.15.118:0/1626768035 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8005480 con 0x7f78f40a0ce0 2024-02-18T11:11:43.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f17fa640 1 -- 172.21.15.118:0/1626768035 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e80035f0 con 0x7f78f40a0ce0 2024-02-18T11:11:43.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f406dda0 con 0x7f78f40a0ce0 2024-02-18T11:11:43.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78f17fa640 1 -- 172.21.15.118:0/1626768035 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e80039c0 con 0x7f78f40a0ce0 2024-02-18T11:11:43.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.651+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f413e280 con 0x7f78f40a0ce0 2024-02-18T11:11:43.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.652+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f4074af0 con 0x7f78f40a0ce0 2024-02-18T11:11:43.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.653+0000 7f78f17fa640 1 -- 172.21.15.118:0/1626768035 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f78e8003b20 con 0x7f78f40a0ce0 2024-02-18T11:11:43.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.653+0000 7f78f17fa640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f78d806bc70 0x7f78d806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:43.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.653+0000 7f78f3fff640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f78d806bc70 0x7f78d806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:43.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.653+0000 7f78f17fa640 1 -- 172.21.15.118:0/1626768035 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78e8089ad0 con 0x7f78f40a0ce0 2024-02-18T11:11:43.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.653+0000 7f78f3fff640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f78d806bc70 0x7f78d806e130 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78f40a2910 tx=0x7f78e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:43.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.657+0000 7f78f17fa640 1 -- 172.21.15.118:0/1626768035 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78e8054340 con 0x7f78f40a0ce0 2024-02-18T11:11:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.843+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78f406dd80 con 0x7f78f40a0ce0 2024-02-18T11:11:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.843+0000 7f78f17fa640 1 -- 172.21.15.118:0/1626768035 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f78e8017070 con 0x7f78f40a0ce0 2024-02-18T11:11:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-02-18T11:11:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.845+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f78d806bc70 msgr2=0x7f78d806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.845+0000 7f78fad4b640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f78d806bc70 0x7f78d806e130 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78f40a2910 tx=0x7f78e0008040 comp rx=0 tx=0).stop 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.845+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f40a0ce0 msgr2=0x7f78f413db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.845+0000 7f78fad4b640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f40a0ce0 0x7f78f413db30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f78e800c440 tx=0x7f78e800c900 comp rx=0 tx=0).stop 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 shutdown_connections 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f78d806bc70 0x7f78d806e130 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f78f414cfd0 0x7f78f41e4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78f4143e10 0x7f78f406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 --2- 172.21.15.118:0/1626768035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78f40a0ce0 0x7f78f413db30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 >> 172.21.15.118:0/1626768035 conn(0x7f78f406bcf0 msgr2=0x7f78f413f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 shutdown_connections 2024-02-18T11:11:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:43.846+0000 7f78fad4b640 1 -- 172.21.15.118:0/1626768035 wait complete. 2024-02-18T11:11:43.858 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-18T11:11:43.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:43.859 DEBUG:teuthology.orchestra.run.smithi204:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-18T11:11:43.970 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2024-02-18T11:11:43.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:43.971 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-18T11:11:44.024 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T11:11:44.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.124+0000 7ffa8d593640 1 Processor -- start 2024-02-18T11:11:44.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.124+0000 7ffa8d593640 1 -- start start 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa8d593640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 0x7ffa880b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa8d593640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffa880bace0 0x7ffa880bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa8d593640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa881463a0 con 0x7ffa880bc160 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa8d593640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880bb280 con 0x7ffa880bace0 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa8d593640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880bb560 con 0x7ffa88145fc0 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa877fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ffa880bc160 0x7ffa8806d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45426/0 (socket says 172.21.15.118:45426) 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa877fe640 1 -- 172.21.15.118:0/2071402536 learned_addr learned my addr 172.21.15.118:0/2071402536 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:44.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483711961 0 0) 0x7ffa881463a0 con 0x7ffa880bc160 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa70003520 con 0x7ffa880bc160 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.125+0000 7ffa86ffd640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 0x7ffa880b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa867fc640 1 --2- 172.21.15.118:0/2071402536 >> v2:172.21.15.164:3300/0 conn(0x7ffa880bace0 0x7ffa880bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2238321273 0 0) 0x7ffa70003520 con 0x7ffa880bc160 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 msgr2=0x7ffa880b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 0x7ffa880b9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 >> v2:172.21.15.164:3300/0 conn(0x7ffa880bace0 msgr2=0x7ffa880bbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 --2- 172.21.15.118:0/2071402536 >> v2:172.21.15.164:3300/0 conn(0x7ffa880bace0 0x7ffa880bbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880bb840 con 0x7ffa880bc160 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7ffa800019f0 con 0x7ffa880bc160 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 >> v1:172.21.15.118:6789/0 conn(0x7ffa880bc160 legacy=0x7ffa8806d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa70003970 0x7ffa70003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 0x7ffa700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa70004d00 0x7ffa70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880bb280 con 0x7ffa70004d00 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880bb560 con 0x7ffa70003970 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7000b980 con 0x7ffa88145fc0 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa877fe640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa70004d00 0x7ffa70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa86ffd640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa70003970 0x7ffa70003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa867fc640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 0x7ffa700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa877fe640 1 -- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 msgr2=0x7ffa700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa877fe640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa88145fc0 0x7ffa700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa877fe640 1 -- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa70003970 msgr2=0x7ffa70003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa877fe640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa70003970 0x7ffa70003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.126+0000 7ffa877fe640 1 -- 172.21.15.118:0/2071402536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70003520 con 0x7ffa70004d00 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.127+0000 7ffa877fe640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa70004d00 0x7ffa70005180 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffa880bc5b0 tx=0x7ffa700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7509918fba4283ec server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.127+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80034630 con 0x7ffa70004d00 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.127+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8002f070 con 0x7ffa70004d00 2024-02-18T11:11:44.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.127+0000 7ffa85ffb640 1 -- 172.21.15.118:0/2071402536 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa800349d0 con 0x7ffa70004d00 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.128+0000 7ffa8d593640 1 -- 172.21.15.118:0/2071402536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa70004d00 msgr2=0x7ffa70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.128+0000 7ffa8d593640 1 --2- 172.21.15.118:0/2071402536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa70004d00 0x7ffa70005180 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffa880bc5b0 tx=0x7ffa700057f0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.128+0000 7ffa877fe640 1 -- 172.21.15.118:0/2071402536 reap_dead start 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.128+0000 7ffa8d593640 1 -- 172.21.15.118:0/2071402536 shutdown_connections 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.128+0000 7ffa8d593640 1 -- 172.21.15.118:0/2071402536 >> 172.21.15.118:0/2071402536 conn(0x7ffa880bf330 msgr2=0x7ffa880bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.128+0000 7ffa8d593640 1 -- 172.21.15.118:0/2071402536 shutdown_connections 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.128+0000 7ffa8d593640 1 -- 172.21.15.118:0/2071402536 wait complete. 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.129+0000 7ffa8d593640 1 Processor -- start 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.129+0000 7ffa8d593640 1 -- start start 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa8d593640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa881483f0 0x7ffa880a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa8d593640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa88147ad0 0x7ffa881e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa8d593640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa881e5070 0x7ffa881e54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa8d593640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88146d10 con 0x7ffa881e5070 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa8d593640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88146ff0 con 0x7ffa88147ad0 2024-02-18T11:11:44.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa8d593640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881472d0 con 0x7ffa881483f0 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa881e5070 0x7ffa881e54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa881e5070 0x7ffa881e54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45354/0 (socket says 172.21.15.118:45354) 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 -- 172.21.15.118:0/115611269 learned_addr learned my addr 172.21.15.118:0/115611269 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa867fc640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa88147ad0 0x7ffa881e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 -- 172.21.15.118:0/115611269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa881483f0 msgr2=0x7ffa880a24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa881483f0 0x7ffa880a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 -- 172.21.15.118:0/115611269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa88147ad0 msgr2=0x7ffa881e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa88147ad0 0x7ffa881e4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 -- 172.21.15.118:0/115611269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa881475b0 con 0x7ffa881e5070 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa877fe640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa881e5070 0x7ffa881e54f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ffa8002cc20 tx=0x7ffa80001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.130+0000 7ffa6f7fe640 1 -- 172.21.15.118:0/115611269 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80034840 con 0x7ffa881e5070 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.131+0000 7ffa6f7fe640 1 -- 172.21.15.118:0/115611269 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8002ce90 con 0x7ffa881e5070 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.131+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa880a4370 con 0x7ffa881e5070 2024-02-18T11:11:44.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.131+0000 7ffa6f7fe640 1 -- 172.21.15.118:0/115611269 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80034be0 con 0x7ffa881e5070 2024-02-18T11:11:44.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.131+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa880b9970 con 0x7ffa881e5070 2024-02-18T11:11:44.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.132+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa880bc790 con 0x7ffa881e5070 2024-02-18T11:11:44.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.132+0000 7ffa6f7fe640 1 -- 172.21.15.118:0/115611269 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7ffa80031030 con 0x7ffa881e5070 2024-02-18T11:11:44.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.133+0000 7ffa6f7fe640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffa7406bca0 0x7ffa7406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.133+0000 7ffa6f7fe640 1 -- 172.21.15.118:0/115611269 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa800aca30 con 0x7ffa881e5070 2024-02-18T11:11:44.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.133+0000 7ffa86ffd640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffa7406bca0 0x7ffa7406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.133+0000 7ffa86ffd640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffa7406bca0 0x7ffa7406e160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009a40 tx=0x7ffa7c009320 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.137+0000 7ffa6f7fe640 1 -- 172.21.15.118:0/115611269 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa8007aef0 con 0x7ffa881e5070 2024-02-18T11:11:44.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.347+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa88072c70 con 0x7ffa881e5070 2024-02-18T11:11:44.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.347+0000 7ffa6f7fe640 1 -- 172.21.15.118:0/115611269 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4156 (secure 0 0 0) 0x7ffa80002000 con 0x7ffa881e5070 2024-02-18T11:11:44.349 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:44.349 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4732,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1586932009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1586932009},{"type":"v1","addr":"172.21.15.164:6833","nonce":1586932009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/1218312757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1218312757},{"type":"v1","addr":"172.21.15.118:6836","nonce":1218312757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:01:31.339623+0000","modified":"2024-02-18T10:01:33.344937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6837/2626574740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":2626574740},{"type":"v1","addr":"172.21.15.118:6837","nonce":2626574740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-18T11:11:44.349 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 13 2024-02-18T11:11:44.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffa7406bca0 msgr2=0x7ffa7406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffa7406bca0 0x7ffa7406e160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009a40 tx=0x7ffa7c009320 comp rx=0 tx=0).stop 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa881e5070 msgr2=0x7ffa881e54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa881e5070 0x7ffa881e54f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ffa8002cc20 tx=0x7ffa80001360 comp rx=0 tx=0).stop 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 shutdown_connections 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ffa7406bca0 0x7ffa7406e160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa881e5070 0x7ffa881e54f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa88147ad0 0x7ffa881e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 --2- 172.21.15.118:0/115611269 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa881483f0 0x7ffa880a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 >> 172.21.15.118:0/115611269 conn(0x7ffa880bf330 msgr2=0x7ffa88140290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 shutdown_connections 2024-02-18T11:11:44.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.349+0000 7ffa8d593640 1 -- 172.21.15.118:0/115611269 wait complete. 2024-02-18T11:11:44.361 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T11:11:44.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.461+0000 7f1a27948640 1 Processor -- start 2024-02-18T11:11:44.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.461+0000 7f1a27948640 1 -- start start 2024-02-18T11:11:44.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a27948640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a20146050 0x7f1a200714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a27948640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1a200b9cc0 0x7f1a2014f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a27948640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200ba130 0x7f1a2014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a27948640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2006e0b0 con 0x7f1a20146050 2024-02-18T11:11:44.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a27948640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2006f880 con 0x7f1a200b9cc0 2024-02-18T11:11:44.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a27948640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2006efe0 con 0x7f1a200ba130 2024-02-18T11:11:44.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a20146050 0x7f1a200714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a20146050 0x7f1a200714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45366/0 (socket says 172.21.15.118:45366) 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 -- 172.21.15.118:0/1389982836 learned_addr learned my addr 172.21.15.118:0/1389982836 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a25ee5640 1 --2- 172.21.15.118:0/1389982836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200ba130 0x7f1a2014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a24ee3640 1 --2- 172.21.15.118:0/1389982836 >> v2:172.21.15.164:3300/0 conn(0x7f1a200b9cc0 0x7f1a2014f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 -- 172.21.15.118:0/1389982836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200ba130 msgr2=0x7f1a2014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 --2- 172.21.15.118:0/1389982836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200ba130 0x7f1a2014fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 -- 172.21.15.118:0/1389982836 >> v2:172.21.15.164:3300/0 conn(0x7f1a200b9cc0 msgr2=0x7f1a2014f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 --2- 172.21.15.118:0/1389982836 >> v2:172.21.15.164:3300/0 conn(0x7f1a200b9cc0 0x7f1a2014f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.462+0000 7f1a256e4640 1 -- 172.21.15.118:0/1389982836 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2006f2c0 con 0x7f1a20146050 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a256e4640 1 --2- 172.21.15.118:0/1389982836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a200714a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ba7f0 tx=0x7f1a1002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618598690d9d75a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a17fff640 1 -- 172.21.15.118:0/1389982836 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10031870 con 0x7f1a20146050 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a17fff640 1 -- 172.21.15.118:0/1389982836 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100319d0 con 0x7f1a20146050 2024-02-18T11:11:44.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a17fff640 1 -- 172.21.15.118:0/1389982836 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10031d60 con 0x7f1a20146050 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a27948640 1 -- 172.21.15.118:0/1389982836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 msgr2=0x7f1a200714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a27948640 1 --2- 172.21.15.118:0/1389982836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a200714a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ba7f0 tx=0x7f1a1002b910 comp rx=0 tx=0).stop 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a27948640 1 -- 172.21.15.118:0/1389982836 shutdown_connections 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a27948640 1 --2- 172.21.15.118:0/1389982836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200ba130 0x7f1a2014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a27948640 1 --2- 172.21.15.118:0/1389982836 >> v2:172.21.15.164:3300/0 conn(0x7f1a200b9cc0 0x7f1a2014f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.463+0000 7f1a27948640 1 --2- 172.21.15.118:0/1389982836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a200714a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.464+0000 7f1a27948640 1 -- 172.21.15.118:0/1389982836 >> 172.21.15.118:0/1389982836 conn(0x7f1a2006bcf0 msgr2=0x7f1a2006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.464+0000 7f1a27948640 1 -- 172.21.15.118:0/1389982836 shutdown_connections 2024-02-18T11:11:44.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.464+0000 7f1a27948640 1 -- 172.21.15.118:0/1389982836 wait complete. 2024-02-18T11:11:44.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 Processor -- start 2024-02-18T11:11:44.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 -- start start 2024-02-18T11:11:44.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200b9cc0 0x7f1a201e4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a200ba130 0x7f1a20144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a20144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201e50c0 con 0x7f1a20146050 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201d6770 con 0x7f1a200ba130 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a27948640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20143c80 con 0x7f1a200b9cc0 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a25ee5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a20144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a25ee5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a20144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45380/0 (socket says 172.21.15.118:45380) 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a25ee5640 1 -- 172.21.15.118:0/183164917 learned_addr learned my addr 172.21.15.118:0/183164917 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a256e4640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200b9cc0 0x7f1a201e4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.465+0000 7f1a24ee3640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a200ba130 0x7f1a20144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a25ee5640 1 -- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200b9cc0 msgr2=0x7f1a201e4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a25ee5640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200b9cc0 0x7f1a201e4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a25ee5640 1 -- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a200ba130 msgr2=0x7f1a20144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a25ee5640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a200ba130 0x7f1a20144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a25ee5640 1 -- 172.21.15.118:0/183164917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100094d0 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a256e4640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200b9cc0 0x7f1a201e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a24ee3640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a200ba130 0x7f1a20144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a25ee5640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a20144110 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1a18007e30 tx=0x7f1a1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a15ffb640 1 -- 172.21.15.118:0/183164917 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18014620 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a15ffb640 1 -- 172.21.15.118:0/183164917 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1800ee90 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a15ffb640 1 -- 172.21.15.118:0/183164917 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180149c0 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a200bc300 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.466+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a200b3fb0 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.467+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a20074af0 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.468+0000 7f1a15ffb640 1 -- 172.21.15.118:0/183164917 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f1a18014b20 con 0x7f1a20146050 2024-02-18T11:11:44.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.468+0000 7f1a15ffb640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1a0406bc70 0x7f1a0406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.468+0000 7f1a15ffb640 1 -- 172.21.15.118:0/183164917 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a1808b080 con 0x7f1a20146050 2024-02-18T11:11:44.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.468+0000 7f1a256e4640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1a0406bc70 0x7f1a0406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.469+0000 7f1a256e4640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1a0406bc70 0x7f1a0406e130 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a10036000 tx=0x7f1a1003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.472+0000 7f1a15ffb640 1 -- 172.21.15.118:0/183164917 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1a180558f0 con 0x7f1a20146050 2024-02-18T11:11:44.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.649+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a20143dc0 con 0x7f1a20146050 2024-02-18T11:11:44.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.650+0000 7f1a15ffb640 1 -- 172.21.15.118:0/183164917 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f1a18058fb0 con 0x7f1a20146050 2024-02-18T11:11:44.653 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:44.653 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:33.001470+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:01:29.722354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-18T10:01:30.305941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T11:11:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1a0406bc70 msgr2=0x7f1a0406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1a0406bc70 0x7f1a0406e130 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a10036000 tx=0x7f1a1003c040 comp rx=0 tx=0).stop 2024-02-18T11:11:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 msgr2=0x7f1a20144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a20144110 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1a18007e30 tx=0x7f1a1800e4b0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 shutdown_connections 2024-02-18T11:11:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f1a0406bc70 0x7f1a0406e130 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a20146050 0x7f1a20144110 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a200ba130 0x7f1a20144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 --2- 172.21.15.118:0/183164917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a200b9cc0 0x7f1a201e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 >> 172.21.15.118:0/183164917 conn(0x7f1a2006bcf0 msgr2=0x7f1a200b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:44.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 shutdown_connections 2024-02-18T11:11:44.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.653+0000 7f1a27948640 1 -- 172.21.15.118:0/183164917 wait complete. 2024-02-18T11:11:44.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-18T10:00:43.319694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-18T10:01:29.722354+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-18T10:01:30.305941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-18T11:11:44.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-18T11:11:44.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.767+0000 7fc66c95c640 1 Processor -- start 2024-02-18T11:11:44.768 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.767+0000 7fc66c95c640 1 -- start start 2024-02-18T11:11:44.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66c95c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc66806dac0 0x7fc668070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.772 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66c95c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 0x7fc668148f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66c95c640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680a1950 con 0x7fc6680ba2a0 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66c95c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc668072830 con 0x7fc66806dac0 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66c95c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc668071d50 con 0x7fc668148b40 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc665d9b640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc6680ba2a0 0x7fc668145fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45438/0 (socket says 172.21.15.118:45438) 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc665d9b640 1 -- 172.21.15.118:0/1017831624 learned_addr learned my addr 172.21.15.118:0/1017831624 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505826535 0 0) 0x7fc6680a1950 con 0x7fc6680ba2a0 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc654003520 con 0x7fc6680ba2a0 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc66659c640 1 --2- 172.21.15.118:0/1017831624 >> v2:172.21.15.164:3300/0 conn(0x7fc66806dac0 0x7fc668070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.768+0000 7fc666d9d640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 0x7fc668148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1190629087 0 0) 0x7fc654003520 con 0x7fc6680ba2a0 2024-02-18T11:11:44.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 msgr2=0x7fc668148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 0x7fc668148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 >> v2:172.21.15.164:3300/0 conn(0x7fc66806dac0 msgr2=0x7fc668070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 --2- 172.21.15.118:0/1017831624 >> v2:172.21.15.164:3300/0 conn(0x7fc66806dac0 0x7fc668070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc668072030 con 0x7fc6680ba2a0 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7fc658001670 con 0x7fc6680ba2a0 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 >> v1:172.21.15.118:6789/0 conn(0x7fc6680ba2a0 legacy=0x7fc668145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc654003970 0x7fc654003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6540047c0 0x7fc654004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 0x7fc654005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668072830 con 0x7fc654003970 2024-02-18T11:11:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668071d50 con 0x7fc6540047c0 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65400b980 con 0x7fc668148b40 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66659c640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc654003970 0x7fc654003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc665d9b640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6540047c0 0x7fc654004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc666d9d640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 0x7fc654005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66659c640 1 -- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 msgr2=0x7fc654005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66659c640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 0x7fc654005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66659c640 1 -- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6540047c0 msgr2=0x7fc654004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66659c640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6540047c0 0x7fc654004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc66659c640 1 -- 172.21.15.118:0/1017831624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654003520 con 0x7fc654003970 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.769+0000 7fc666d9d640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc668148b40 0x7fc654005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.770+0000 7fc66659c640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc654003970 0x7fc654003d90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc650009ac0 tx=0x7fc6540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bb53de8e13d208 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.770+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65002c710 con 0x7fc654003970 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.770+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65002c870 con 0x7fc654003970 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.770+0000 7fc66559a640 1 -- 172.21.15.118:0/1017831624 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65002cc00 con 0x7fc654003970 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.771+0000 7fc66c95c640 1 -- 172.21.15.118:0/1017831624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc654003970 msgr2=0x7fc654003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.771+0000 7fc66c95c640 1 --2- 172.21.15.118:0/1017831624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc654003970 0x7fc654003d90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc650009ac0 tx=0x7fc6540057f0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.771+0000 7fc666d9d640 1 -- 172.21.15.118:0/1017831624 reap_dead start 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.771+0000 7fc66c95c640 1 -- 172.21.15.118:0/1017831624 shutdown_connections 2024-02-18T11:11:44.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.771+0000 7fc66c95c640 1 -- 172.21.15.118:0/1017831624 >> 172.21.15.118:0/1017831624 conn(0x7fc6680be420 msgr2=0x7fc6680be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:44.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.771+0000 7fc66c95c640 1 -- 172.21.15.118:0/1017831624 shutdown_connections 2024-02-18T11:11:44.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.771+0000 7fc66c95c640 1 -- 172.21.15.118:0/1017831624 wait complete. 2024-02-18T11:11:44.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.772+0000 7fc66c95c640 1 Processor -- start 2024-02-18T11:11:44.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.772+0000 7fc66c95c640 1 -- start start 2024-02-18T11:11:44.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc654003970 0x7fc6680b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc66806b400 0x7fc6680b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6680b0c00 0x7fc6681e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66806b880 con 0x7fc66806b400 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b1080 con 0x7fc6680b0c00 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b31f0 con 0x7fc654003970 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc66806b400 0x7fc6680b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc66806b400 0x7fc6680b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45402/0 (socket says 172.21.15.118:45402) 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 -- 172.21.15.118:0/3514916824 learned_addr learned my addr 172.21.15.118:0/3514916824 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc666d9d640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6680b0c00 0x7fc6681e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66659c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc654003970 0x7fc6680b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 -- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc654003970 msgr2=0x7fc6680b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc654003970 0x7fc6680b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 -- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6680b0c00 msgr2=0x7fc6681e1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6680b0c00 0x7fc6681e1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 -- 172.21.15.118:0/3514916824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6680b7df0 con 0x7fc66806b400 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc665d9b640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc66806b400 0x7fc6680b06c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc658004f40 tx=0x7fc6580074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc65effd640 1 -- 172.21.15.118:0/3514916824 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800f9c0 con 0x7fc66806b400 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc65effd640 1 -- 172.21.15.118:0/3514916824 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65800fb40 con 0x7fc66806b400 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6680b80d0 con 0x7fc66806b400 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc65effd640 1 -- 172.21.15.118:0/3514916824 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6580133f0 con 0x7fc66806b400 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.773+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6681e1900 con 0x7fc66806b400 2024-02-18T11:11:44.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.774+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc668075150 con 0x7fc66806b400 2024-02-18T11:11:44.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.775+0000 7fc65effd640 1 -- 172.21.15.118:0/3514916824 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fc658013550 con 0x7fc66806b400 2024-02-18T11:11:44.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.775+0000 7fc65effd640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc64806bc70 0x7fc64806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:44.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.775+0000 7fc66659c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc64806bc70 0x7fc64806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:44.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.775+0000 7fc65effd640 1 -- 172.21.15.118:0/3514916824 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc65808a8b0 con 0x7fc66806b400 2024-02-18T11:11:44.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.776+0000 7fc66659c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc64806bc70 0x7fc64806e130 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc650036000 tx=0x7fc650030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:44.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.780+0000 7fc65effd640 1 -- 172.21.15.118:0/3514916824 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc658055090 con 0x7fc66806b400 2024-02-18T11:11:44.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.957+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc668074af0 con 0x7fc66806b400 2024-02-18T11:11:44.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.958+0000 7fc65effd640 1 -- 172.21.15.118:0/3514916824 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc65805de60 con 0x7fc66806b400 2024-02-18T11:11:44.959 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-02-18T11:11:44.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc64806bc70 msgr2=0x7fc64806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc64806bc70 0x7fc64806e130 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc650036000 tx=0x7fc650030000 comp rx=0 tx=0).stop 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc66806b400 msgr2=0x7fc6680b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc66806b400 0x7fc6680b06c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc658004f40 tx=0x7fc6580074f0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 shutdown_connections 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fc64806bc70 0x7fc64806e130 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6680b0c00 0x7fc6681e1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc66806b400 0x7fc6680b06c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 --2- 172.21.15.118:0/3514916824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc654003970 0x7fc6680b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 >> 172.21.15.118:0/3514916824 conn(0x7fc6680be420 msgr2=0x7fc6681479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 shutdown_connections 2024-02-18T11:11:44.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:44.960+0000 7fc66c95c640 1 -- 172.21.15.118:0/3514916824 wait complete. 2024-02-18T11:11:44.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-18T11:11:45.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.074+0000 7f499a5f4640 1 Processor -- start 2024-02-18T11:11:45.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.074+0000 7f499a5f4640 1 -- start start 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f499a5f4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49940ba2a0 0x7f4994145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f499a5f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49941464f0 0x7f4994148b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f499a5f4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940a1950 con 0x7f499406dac0 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f499a5f4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4994072830 con 0x7f49940ba2a0 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f499a5f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4994071d50 con 0x7f49941464f0 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f49937fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49940ba2a0 0x7f4994145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f49937fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49940ba2a0 0x7f4994145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45414/0 (socket says 172.21.15.118:45414) 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f49937fe640 1 -- 172.21.15.118:0/480883645 learned_addr learned my addr 172.21.15.118:0/480883645 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f49937fe640 1 -- 172.21.15.118:0/480883645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49941464f0 msgr2=0x7f4994148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f49937fe640 1 --2- 172.21.15.118:0/480883645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49941464f0 0x7f4994148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f49937fe640 1 -- 172.21.15.118:0/480883645 >> v1:172.21.15.118:6789/0 conn(0x7f499406dac0 legacy=0x7f4994070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.075+0000 7f49937fe640 1 -- 172.21.15.118:0/480883645 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994072030 con 0x7f49940ba2a0 2024-02-18T11:11:45.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.076+0000 7f49937fe640 1 --2- 172.21.15.118:0/480883645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49940ba2a0 0x7f4994145fb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4984009870 tx=0x7f498402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66d7524fe993822 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.076+0000 7f4992ffd640 1 -- 172.21.15.118:0/480883645 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498402f840 con 0x7f49940ba2a0 2024-02-18T11:11:45.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.076+0000 7f4992ffd640 1 -- 172.21.15.118:0/480883645 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498402f9a0 con 0x7f49940ba2a0 2024-02-18T11:11:45.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.076+0000 7f4992ffd640 1 -- 172.21.15.118:0/480883645 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498402fd30 con 0x7f49940ba2a0 2024-02-18T11:11:45.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 -- 172.21.15.118:0/480883645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49940ba2a0 msgr2=0x7f4994145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 --2- 172.21.15.118:0/480883645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49940ba2a0 0x7f4994145fb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4984009870 tx=0x7f498402ba20 comp rx=0 tx=0).stop 2024-02-18T11:11:45.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 -- 172.21.15.118:0/480883645 shutdown_connections 2024-02-18T11:11:45.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 --2- 172.21.15.118:0/480883645 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49941464f0 0x7f4994148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 --2- 172.21.15.118:0/480883645 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49940ba2a0 0x7f4994145fb0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 -- 172.21.15.118:0/480883645 >> 172.21.15.118:0/480883645 conn(0x7f49940be420 msgr2=0x7f49940be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:45.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 -- 172.21.15.118:0/480883645 shutdown_connections 2024-02-18T11:11:45.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.077+0000 7f499a5f4640 1 -- 172.21.15.118:0/480883645 wait complete. 2024-02-18T11:11:45.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.078+0000 7f499a5f4640 1 Processor -- start 2024-02-18T11:11:45.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.078+0000 7f499a5f4640 1 -- start start 2024-02-18T11:11:45.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f499a5f4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f499406dac0 0x7f499406ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f499a5f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49940ba2a0 0x7f499409f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f499a5f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49941464f0 0x7f49941e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f499a5f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499406b390 con 0x7f49941464f0 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f499a5f4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499414cab0 con 0x7f499406dac0 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f499a5f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499414c480 con 0x7f49940ba2a0 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49941464f0 0x7f49941e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49941464f0 0x7f49941e54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45430/0 (socket says 172.21.15.118:45430) 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 -- 172.21.15.118:0/2066939615 learned_addr learned my addr 172.21.15.118:0/2066939615 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4993fff640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f499406dac0 0x7f499406ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f49937fe640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49940ba2a0 0x7f499409f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 -- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49940ba2a0 msgr2=0x7f499409f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49940ba2a0 0x7f499409f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 -- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f499406dac0 msgr2=0x7f499406ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f499406dac0 0x7f499406ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 -- 172.21.15.118:0/2066939615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840094d0 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4993fff640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f499406dac0 0x7f499406ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4998b91640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49941464f0 0x7f49941e54a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f498c00b970 tx=0x7f498c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4990ff9640 1 -- 172.21.15.118:0/2066939615 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00cb40 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4990ff9640 1 -- 172.21.15.118:0/2066939615 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c00ccc0 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499409eb30 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.079+0000 7f4990ff9640 1 -- 172.21.15.118:0/2066939615 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c014680 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.080+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499406b630 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.081+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4994075150 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.081+0000 7f4990ff9640 1 -- 172.21.15.118:0/2066939615 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f498c01d3b0 con 0x7f49941464f0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.081+0000 7f4990ff9640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f498006bc70 0x7f498006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.082+0000 7f4993fff640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f498006bc70 0x7f498006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.082+0000 7f4990ff9640 1 -- 172.21.15.118:0/2066939615 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f498c08a660 con 0x7f49941464f0 2024-02-18T11:11:45.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.082+0000 7f4993fff640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f498006bc70 0x7f498006e130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4988001700 tx=0x7f4988009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.089+0000 7f4990ff9640 1 -- 172.21.15.118:0/2066939615 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f498c054ed0 con 0x7f49941464f0 2024-02-18T11:11:45.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.267+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f499414cc20 con 0x7f49941464f0 2024-02-18T11:11:45.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.268+0000 7f4990ff9640 1 -- 172.21.15.118:0/2066939615 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f498c058590 con 0x7f49941464f0 2024-02-18T11:11:45.272 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-02-18T11:11:45.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f498006bc70 msgr2=0x7f498006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f498006bc70 0x7f498006e130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4988001700 tx=0x7f4988009040 comp rx=0 tx=0).stop 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49941464f0 msgr2=0x7f49941e54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49941464f0 0x7f49941e54a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f498c00b970 tx=0x7f498c00be30 comp rx=0 tx=0).stop 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 shutdown_connections 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f498006bc70 0x7f498006e130 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49941464f0 0x7f49941e54a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f49940ba2a0 0x7f499409f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 --2- 172.21.15.118:0/2066939615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f499406dac0 0x7f499406ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 >> 172.21.15.118:0/2066939615 conn(0x7f49940be420 msgr2=0x7f49940a21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 shutdown_connections 2024-02-18T11:11:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.270+0000 7f499a5f4640 1 -- 172.21.15.118:0/2066939615 wait complete. 2024-02-18T11:11:45.282 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-18T11:11:45.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.383+0000 7fa5afc81640 1 Processor -- start 2024-02-18T11:11:45.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5afc81640 1 -- start start 2024-02-18T11:11:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5afc81640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5a80711e0 0x7fa5a814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5afc81640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa5a8072be0 0x7fa5a80b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5afc81640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a806af80 0x7fa5a8149050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5afc81640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a80bab50 con 0x7fa5a80711e0 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5afc81640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a80ba680 con 0x7fa5a8072be0 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5afc81640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a806b3f0 con 0x7fa5a806af80 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5ada1d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5a80711e0 0x7fa5a814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5ada1d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5a80711e0 0x7fa5a814bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45436/0 (socket says 172.21.15.118:45436) 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.384+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2299661038 learned_addr learned my addr 172.21.15.118:0/2299661038 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2299661038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a806af80 msgr2=0x7fa5a8149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5ada1d640 1 --2- 172.21.15.118:0/2299661038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a806af80 0x7fa5a8149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2299661038 >> v2:172.21.15.164:3300/0 conn(0x7fa5a8072be0 msgr2=0x7fa5a80b91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5ad21c640 1 --2- 172.21.15.118:0/2299661038 >> v2:172.21.15.164:3300/0 conn(0x7fa5a8072be0 0x7fa5a80b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5ada1d640 1 --2- 172.21.15.118:0/2299661038 >> v2:172.21.15.164:3300/0 conn(0x7fa5a8072be0 0x7fa5a80b91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2299661038 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80ba280 con 0x7fa5a80711e0 2024-02-18T11:11:45.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5ada1d640 1 --2- 172.21.15.118:0/2299661038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a80711e0 0x7fa5a814bed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80be1f0 tx=0x7fa5a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef5b91fd0c396b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5aca1b640 1 -- 172.21.15.118:0/2299661038 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a002ca70 con 0x7fa5a80711e0 2024-02-18T11:11:45.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.385+0000 7fa5aca1b640 1 -- 172.21.15.118:0/2299661038 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a002cbd0 con 0x7fa5a80711e0 2024-02-18T11:11:45.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5aca1b640 1 -- 172.21.15.118:0/2299661038 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00343f0 con 0x7fa5a80711e0 2024-02-18T11:11:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 -- 172.21.15.118:0/2299661038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a80711e0 msgr2=0x7fa5a814bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2299661038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a80711e0 0x7fa5a814bed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80be1f0 tx=0x7fa5a002bed0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 -- 172.21.15.118:0/2299661038 shutdown_connections 2024-02-18T11:11:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2299661038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a806af80 0x7fa5a8149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2299661038 >> v2:172.21.15.164:3300/0 conn(0x7fa5a8072be0 0x7fa5a80b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2299661038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a80711e0 0x7fa5a814bed0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 -- 172.21.15.118:0/2299661038 >> 172.21.15.118:0/2299661038 conn(0x7fa5a80be420 msgr2=0x7fa5a80be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 -- 172.21.15.118:0/2299661038 shutdown_connections 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.386+0000 7fa5afc81640 1 -- 172.21.15.118:0/2299661038 wait complete. 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.387+0000 7fa5afc81640 1 Processor -- start 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.387+0000 7fa5afc81640 1 -- start start 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5afc81640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a806af80 0x7fa5a814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5afc81640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5a80711e0 0x7fa5a80b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5afc81640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a8072be0 0x7fa5a81e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5afc81640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81500b0 con 0x7fa5a806af80 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5afc81640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80b2940 con 0x7fa5a80711e0 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5afc81640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80b3de0 con 0x7fa5a8072be0 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a806af80 0x7fa5a814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a806af80 0x7fa5a814fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45448/0 (socket says 172.21.15.118:45448) 2024-02-18T11:11:45.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2723261163 learned_addr learned my addr 172.21.15.118:0/2723261163 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2723261163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a8072be0 msgr2=0x7fa5a81e49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a8072be0 0x7fa5a81e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2723261163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5a80711e0 msgr2=0x7fa5a80b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5a80711e0 0x7fa5a80b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 -- 172.21.15.118:0/2723261163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0009b30 con 0x7fa5a806af80 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa5ada1d640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a806af80 0x7fa5a814fb70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000f80 tx=0x7fa5a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.388+0000 7fa59e7fc640 1 -- 172.21.15.118:0/2723261163 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a003e450 con 0x7fa5a806af80 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.389+0000 7fa59e7fc640 1 -- 172.21.15.118:0/2723261163 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a003e5f0 con 0x7fa5a806af80 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.389+0000 7fa59e7fc640 1 -- 172.21.15.118:0/2723261163 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a003e9a0 con 0x7fa5a806af80 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.389+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a80b4f70 con 0x7fa5a806af80 2024-02-18T11:11:45.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.389+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a80b25d0 con 0x7fa5a806af80 2024-02-18T11:11:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.390+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a8075150 con 0x7fa5a806af80 2024-02-18T11:11:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.390+0000 7fa59e7fc640 1 -- 172.21.15.118:0/2723261163 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fa5a003eb00 con 0x7fa5a806af80 2024-02-18T11:11:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.390+0000 7fa59e7fc640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa58c06bc70 0x7fa58c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.390+0000 7fa5ad21c640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa58c06bc70 0x7fa58c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.390+0000 7fa59e7fc640 1 -- 172.21.15.118:0/2723261163 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5a00ad5e0 con 0x7fa5a806af80 2024-02-18T11:11:45.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.391+0000 7fa5ad21c640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa58c06bc70 0x7fa58c06e130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa5a809efe0 tx=0x7fa598008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.398+0000 7fa59e7fc640 1 -- 172.21.15.118:0/2723261163 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5a0077e50 con 0x7fa5a806af80 2024-02-18T11:11:45.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.576+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5a80b2760 con 0x7fa5a806af80 2024-02-18T11:11:45.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.576+0000 7fa59e7fc640 1 -- 172.21.15.118:0/2723261163 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa5a003edb0 con 0x7fa5a806af80 2024-02-18T11:11:45.578 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa58c06bc70 msgr2=0x7fa58c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa58c06bc70 0x7fa58c06e130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa5a809efe0 tx=0x7fa598008040 comp rx=0 tx=0).stop 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a806af80 msgr2=0x7fa5a814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a806af80 0x7fa5a814fb70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000f80 tx=0x7fa5a0004a40 comp rx=0 tx=0).stop 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 shutdown_connections 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa58c06bc70 0x7fa58c06e130 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa5a8072be0 0x7fa5a81e49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5a80711e0 0x7fa5a80b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 --2- 172.21.15.118:0/2723261163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5a806af80 0x7fa5a814fb70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 >> 172.21.15.118:0/2723261163 conn(0x7fa5a80be420 msgr2=0x7fa5a814b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:45.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 shutdown_connections 2024-02-18T11:11:45.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.578+0000 7fa5afc81640 1 -- 172.21.15.118:0/2723261163 wait complete. 2024-02-18T11:11:45.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T11:11:45.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.689+0000 7fba98083640 1 Processor -- start 2024-02-18T11:11:45.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba98083640 1 -- start start 2024-02-18T11:11:45.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba98083640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fba900b9f30 0x7fba90142860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba98083640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b5240 0x7fba90142da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba98083640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba9006d950 0x7fba9006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba98083640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9006ec00 con 0x7fba9006d950 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba98083640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba90149760 con 0x7fba900b9f30 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba98083640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900bab50 con 0x7fba900b5240 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.690+0000 7fba96620640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba9006d950 0x7fba9006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba96620640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fba9006d950 0x7fba9006dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45454/0 (socket says 172.21.15.118:45454) 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba96620640 1 -- 172.21.15.118:0/3855101293 learned_addr learned my addr 172.21.15.118:0/3855101293 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba95e1f640 1 --2- 172.21.15.118:0/3855101293 >> v2:172.21.15.164:3300/0 conn(0x7fba900b9f30 0x7fba90142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba9561e640 1 --2- 172.21.15.118:0/3855101293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b5240 0x7fba90142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba96620640 1 -- 172.21.15.118:0/3855101293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b5240 msgr2=0x7fba90142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba96620640 1 --2- 172.21.15.118:0/3855101293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b5240 0x7fba90142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba96620640 1 -- 172.21.15.118:0/3855101293 >> v2:172.21.15.164:3300/0 conn(0x7fba900b9f30 msgr2=0x7fba90142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba96620640 1 --2- 172.21.15.118:0/3855101293 >> v2:172.21.15.164:3300/0 conn(0x7fba900b9f30 0x7fba90142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.691+0000 7fba96620640 1 -- 172.21.15.118:0/3855101293 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9006e2c0 con 0x7fba9006d950 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.692+0000 7fba96620640 1 --2- 172.21.15.118:0/3855101293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba9006d950 0x7fba9006dd80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fba900709f0 tx=0x7fba8802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ee7e2b43848666 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.692+0000 7fba94e1d640 1 -- 172.21.15.118:0/3855101293 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8802ca70 con 0x7fba9006d950 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.692+0000 7fba94e1d640 1 -- 172.21.15.118:0/3855101293 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8802cbd0 con 0x7fba9006d950 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.692+0000 7fba94e1d640 1 -- 172.21.15.118:0/3855101293 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba880343f0 con 0x7fba9006d950 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 -- 172.21.15.118:0/3855101293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba9006d950 msgr2=0x7fba9006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 --2- 172.21.15.118:0/3855101293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba9006d950 0x7fba9006dd80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fba900709f0 tx=0x7fba8802bed0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 -- 172.21.15.118:0/3855101293 shutdown_connections 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 --2- 172.21.15.118:0/3855101293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba9006d950 0x7fba9006dd80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 --2- 172.21.15.118:0/3855101293 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b5240 0x7fba90142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 --2- 172.21.15.118:0/3855101293 >> v2:172.21.15.164:3300/0 conn(0x7fba900b9f30 0x7fba90142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 -- 172.21.15.118:0/3855101293 >> 172.21.15.118:0/3855101293 conn(0x7fba9006bcf0 msgr2=0x7fba9006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 -- 172.21.15.118:0/3855101293 shutdown_connections 2024-02-18T11:11:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.693+0000 7fba98083640 1 -- 172.21.15.118:0/3855101293 wait complete. 2024-02-18T11:11:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 Processor -- start 2024-02-18T11:11:45.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 -- start start 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba9006d950 0x7fba901e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba900b5240 0x7fba901d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b9f30 0x7fba90147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba901d09d0 con 0x7fba900b5240 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90147950 con 0x7fba9006d950 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba98083640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba90072370 con 0x7fba900b9f30 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.694+0000 7fba9561e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba900b5240 0x7fba901d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba900b5240 0x7fba901d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45458/0 (socket says 172.21.15.118:45458) 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 -- 172.21.15.118:0/2614324746 learned_addr learned my addr 172.21.15.118:0/2614324746 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba95e1f640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba9006d950 0x7fba901e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba96620640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b9f30 0x7fba90147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 -- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b9f30 msgr2=0x7fba90147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b9f30 0x7fba90147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 -- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba9006d950 msgr2=0x7fba901e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba9006d950 0x7fba901e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 -- 172.21.15.118:0/2614324746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009b30 con 0x7fba900b5240 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba95e1f640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba9006d950 0x7fba901e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba9561e640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba900b5240 0x7fba901d0490 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fba8000d830 tx=0x7fba8000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba867fc640 1 -- 172.21.15.118:0/2614324746 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000b6c0 con 0x7fba900b5240 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba867fc640 1 -- 172.21.15.118:0/2614324746 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000b820 con 0x7fba900b5240 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba90140340 con 0x7fba900b5240 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba867fc640 1 -- 172.21.15.118:0/2614324746 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000bbb0 con 0x7fba900b5240 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.695+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba90147660 con 0x7fba900b5240 2024-02-18T11:11:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.696+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90074af0 con 0x7fba900b5240 2024-02-18T11:11:45.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.697+0000 7fba867fc640 1 -- 172.21.15.118:0/2614324746 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fba8001e460 con 0x7fba900b5240 2024-02-18T11:11:45.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.697+0000 7fba867fc640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fba7406bc70 0x7fba7406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:45.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.697+0000 7fba867fc640 1 -- 172.21.15.118:0/2614324746 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba8008af20 con 0x7fba900b5240 2024-02-18T11:11:45.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.697+0000 7fba95e1f640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fba7406bc70 0x7fba7406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:45.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.697+0000 7fba95e1f640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fba7406bc70 0x7fba7406e130 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006fd0 tx=0x7fba8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:45.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.701+0000 7fba867fc640 1 -- 172.21.15.118:0/2614324746 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba80055700 con 0x7fba900b5240 2024-02-18T11:11:45.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.914+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba901d4f60 con 0x7fba900b5240 2024-02-18T11:11:45.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.914+0000 7fba867fc640 1 -- 172.21.15.118:0/2614324746 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4156 (secure 0 0 0) 0x7fba80058dc0 con 0x7fba900b5240 2024-02-18T11:11:45.916 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:45.916 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4732,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1586932009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1586932009},{"type":"v1","addr":"172.21.15.164:6833","nonce":1586932009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/1218312757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1218312757},{"type":"v1","addr":"172.21.15.118:6836","nonce":1218312757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:01:31.339623+0000","modified":"2024-02-18T10:01:33.344937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6837/2626574740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":2626574740},{"type":"v1","addr":"172.21.15.118:6837","nonce":2626574740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-18T11:11:45.916 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 13 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fba7406bc70 msgr2=0x7fba7406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fba7406bc70 0x7fba7406e130 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fba8c006fd0 tx=0x7fba8c008040 comp rx=0 tx=0).stop 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba900b5240 msgr2=0x7fba901d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba900b5240 0x7fba901d0490 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fba8000d830 tx=0x7fba8000dcf0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 shutdown_connections 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fba7406bc70 0x7fba7406e130 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fba900b9f30 0x7fba90147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fba900b5240 0x7fba901d0490 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 --2- 172.21.15.118:0/2614324746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba9006d950 0x7fba901e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:45.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.916+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 >> 172.21.15.118:0/2614324746 conn(0x7fba9006bcf0 msgr2=0x7fba9013c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:45.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.917+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 shutdown_connections 2024-02-18T11:11:45.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:45.917+0000 7fba98083640 1 -- 172.21.15.118:0/2614324746 wait complete. 2024-02-18T11:11:45.928 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.028+0000 7f161fcf4640 1 Processor -- start 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.028+0000 7f161fcf4640 1 -- start start 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.028+0000 7f161fcf4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1618071f80 0x7f1618072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.028+0000 7f161fcf4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618145c50 0x7f16181460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.028+0000 7f161fcf4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1618072bd0 con 0x7f16180ba1a0 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.028+0000 7f161fcf4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161806e0b0 con 0x7f1618071f80 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.028+0000 7f161fcf4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1618070fe0 con 0x7f1618145c50 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161da90640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1618071f80 0x7f1618072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161da90640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1618071f80 0x7f1618072690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45470/0 (socket says 172.21.15.118:45470) 2024-02-18T11:11:46.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161da90640 1 -- 172.21.15.118:0/4183960587 learned_addr learned my addr 172.21.15.118:0/4183960587 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161e291640 1 --2- 172.21.15.118:0/4183960587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618145c50 0x7f16181460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161da90640 1 -- 172.21.15.118:0/4183960587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618145c50 msgr2=0x7f16181460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161da90640 1 --2- 172.21.15.118:0/4183960587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618145c50 0x7f16181460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161da90640 1 -- 172.21.15.118:0/4183960587 >> v1:172.21.15.164:6789/0 conn(0x7f16180ba1a0 legacy=0x7f161806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161da90640 1 -- 172.21.15.118:0/4183960587 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618072e50 con 0x7f1618071f80 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.029+0000 7f161e291640 1 --2- 172.21.15.118:0/4183960587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618145c50 0x7f16181460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161da90640 1 --2- 172.21.15.118:0/4183960587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f1618072690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1614009870 tx=0x7f161402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17501501b7e67225 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161ca8e640 1 -- 172.21.15.118:0/4183960587 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161402f840 con 0x7f1618071f80 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161ca8e640 1 -- 172.21.15.118:0/4183960587 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161402f9a0 con 0x7f1618071f80 2024-02-18T11:11:46.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161ca8e640 1 -- 172.21.15.118:0/4183960587 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161402fd30 con 0x7f1618071f80 2024-02-18T11:11:46.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 -- 172.21.15.118:0/4183960587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 msgr2=0x7f1618072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 --2- 172.21.15.118:0/4183960587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f1618072690 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1614009870 tx=0x7f161402ba20 comp rx=0 tx=0).stop 2024-02-18T11:11:46.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 -- 172.21.15.118:0/4183960587 shutdown_connections 2024-02-18T11:11:46.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 --2- 172.21.15.118:0/4183960587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1618145c50 0x7f16181460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 --2- 172.21.15.118:0/4183960587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f1618072690 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 -- 172.21.15.118:0/4183960587 >> 172.21.15.118:0/4183960587 conn(0x7f161806bcf0 msgr2=0x7f161806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 -- 172.21.15.118:0/4183960587 shutdown_connections 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.030+0000 7f161fcf4640 1 -- 172.21.15.118:0/4183960587 wait complete. 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.031+0000 7f161fcf4640 1 Processor -- start 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.031+0000 7f161fcf4640 1 -- start start 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161fcf4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f16180b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161fcf4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16180ba1a0 0x7f161814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161fcf4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1618145c50 0x7f161809eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161fcf4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161814f460 con 0x7f1618071f80 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161fcf4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161814cb20 con 0x7f1618145c50 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161fcf4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180a0980 con 0x7f16180ba1a0 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f16180b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f16180b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45486/0 (socket says 172.21.15.118:45486) 2024-02-18T11:11:46.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 -- 172.21.15.118:0/2270696641 learned_addr learned my addr 172.21.15.118:0/2270696641 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161e291640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1618145c50 0x7f161809eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161d28f640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16180ba1a0 0x7f161814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 -- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16180ba1a0 msgr2=0x7f161814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16180ba1a0 0x7f161814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 -- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1618145c50 msgr2=0x7f161809eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1618145c50 0x7f161809eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161da90640 1 -- 172.21.15.118:0/2270696641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140094d0 con 0x7f1618071f80 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.032+0000 7f161e291640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1618145c50 0x7f161809eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.033+0000 7f161da90640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f16180b55c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1614000c00 tx=0x7f1614004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.033+0000 7f160e7fc640 1 -- 172.21.15.118:0/2270696641 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614037c40 con 0x7f1618071f80 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.033+0000 7f160e7fc640 1 -- 172.21.15.118:0/2270696641 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614037da0 con 0x7f1618071f80 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.033+0000 7f160e7fc640 1 -- 172.21.15.118:0/2270696641 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614041640 con 0x7f1618071f80 2024-02-18T11:11:46.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.033+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16181e4940 con 0x7f1618071f80 2024-02-18T11:11:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.033+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16181e4f00 con 0x7f1618071f80 2024-02-18T11:11:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.034+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1618074af0 con 0x7f1618071f80 2024-02-18T11:11:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.034+0000 7f160e7fc640 1 -- 172.21.15.118:0/2270696641 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f16140417a0 con 0x7f1618071f80 2024-02-18T11:11:46.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.035+0000 7f160e7fc640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f15fc06bc70 0x7f15fc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.035+0000 7f160e7fc640 1 -- 172.21.15.118:0/2270696641 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f161403c070 con 0x7f1618071f80 2024-02-18T11:11:46.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.035+0000 7f161d28f640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f15fc06bc70 0x7f15fc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.035+0000 7f161d28f640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f15fc06bc70 0x7f15fc06e130 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1608007fd0 tx=0x7f1608009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.039+0000 7f160e7fc640 1 -- 172.21.15.118:0/2270696641 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1614077d30 con 0x7f1618071f80 2024-02-18T11:11:46.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.217+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16180a3480 con 0x7f1618071f80 2024-02-18T11:11:46.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.218+0000 7f160e7fc640 1 -- 172.21.15.118:0/2270696641 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f161407b3f0 con 0x7f1618071f80 2024-02-18T11:11:46.220 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:46.220 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:33.001470+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:01:29.722354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-18T10:01:30.305941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f15fc06bc70 msgr2=0x7f15fc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f15fc06bc70 0x7f15fc06e130 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1608007fd0 tx=0x7f1608009040 comp rx=0 tx=0).stop 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 msgr2=0x7f16180b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f16180b55c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1614000c00 tx=0x7f1614004730 comp rx=0 tx=0).stop 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 shutdown_connections 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f15fc06bc70 0x7f15fc06e130 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1618145c50 0x7f161809eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16180ba1a0 0x7f161814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 --2- 172.21.15.118:0/2270696641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1618071f80 0x7f16180b55c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 >> 172.21.15.118:0/2270696641 conn(0x7f161806bcf0 msgr2=0x7f16180a1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 shutdown_connections 2024-02-18T11:11:46.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.220+0000 7f161fcf4640 1 -- 172.21.15.118:0/2270696641 wait complete. 2024-02-18T11:11:46.232 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-18T11:11:46.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T11:11:46.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.332+0000 7f5a119d0640 1 Processor -- start 2024-02-18T11:11:46.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.332+0000 7f5a119d0640 1 -- start start 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a119d0640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5a0c071f80 0x7f5a0c072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a119d0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c0ba1a0 0x7f5a0c06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a119d0640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a0c06f0b0 0x7f5a0c145c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a119d0640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c06e0b0 con 0x7f5a0c06f0b0 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a119d0640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c072bd0 con 0x7f5a0c071f80 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a119d0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c070fe0 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a0c06f0b0 0x7f5a0c145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a0c06f0b0 0x7f5a0c145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45502/0 (socket says 172.21.15.118:45502) 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/679481383 learned_addr learned my addr 172.21.15.118:0/679481383 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0affd640 1 --2- 172.21.15.118:0/679481383 >> v2:172.21.15.164:3300/0 conn(0x7f5a0c071f80 0x7f5a0c072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/679481383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c0ba1a0 msgr2=0x7f5a0c06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0a7fc640 1 --2- 172.21.15.118:0/679481383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c0ba1a0 0x7f5a0c06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 --2- 172.21.15.118:0/679481383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c0ba1a0 0x7f5a0c06eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/679481383 >> v2:172.21.15.164:3300/0 conn(0x7f5a0c071f80 msgr2=0x7f5a0c072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 --2- 172.21.15.118:0/679481383 >> v2:172.21.15.164:3300/0 conn(0x7f5a0c071f80 0x7f5a0c072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/679481383 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c072e50 con 0x7f5a0c06f0b0 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.333+0000 7f5a0affd640 1 --2- 172.21.15.118:0/679481383 >> v2:172.21.15.164:3300/0 conn(0x7f5a0c071f80 0x7f5a0c072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.334+0000 7f5a0b7fe640 1 --2- 172.21.15.118:0/679481383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c06f0b0 0x7f5a0c145c50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c06cf20 tx=0x7f5a0402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff71f44726f50b54 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.334+0000 7f5a09ffb640 1 -- 172.21.15.118:0/679481383 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0402cb00 con 0x7f5a0c06f0b0 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.334+0000 7f5a09ffb640 1 -- 172.21.15.118:0/679481383 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0402cc60 con 0x7f5a0c06f0b0 2024-02-18T11:11:46.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.334+0000 7f5a09ffb640 1 -- 172.21.15.118:0/679481383 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040343f0 con 0x7f5a0c06f0b0 2024-02-18T11:11:46.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.334+0000 7f5a119d0640 1 -- 172.21.15.118:0/679481383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c06f0b0 msgr2=0x7f5a0c145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.334+0000 7f5a119d0640 1 --2- 172.21.15.118:0/679481383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c06f0b0 0x7f5a0c145c50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c06cf20 tx=0x7f5a0402bf60 comp rx=0 tx=0).stop 2024-02-18T11:11:46.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.335+0000 7f5a119d0640 1 -- 172.21.15.118:0/679481383 shutdown_connections 2024-02-18T11:11:46.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.335+0000 7f5a119d0640 1 --2- 172.21.15.118:0/679481383 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c06f0b0 0x7f5a0c145c50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.335+0000 7f5a119d0640 1 --2- 172.21.15.118:0/679481383 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c0ba1a0 0x7f5a0c06eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.335+0000 7f5a119d0640 1 --2- 172.21.15.118:0/679481383 >> v2:172.21.15.164:3300/0 conn(0x7f5a0c071f80 0x7f5a0c072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.335+0000 7f5a119d0640 1 -- 172.21.15.118:0/679481383 >> 172.21.15.118:0/679481383 conn(0x7f5a0c06bcf0 msgr2=0x7f5a0c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.335+0000 7f5a119d0640 1 -- 172.21.15.118:0/679481383 shutdown_connections 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.335+0000 7f5a119d0640 1 -- 172.21.15.118:0/679481383 wait complete. 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 Processor -- start 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 -- start start 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a0c06f0b0 0x7f5a0c14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c071f80 0x7f5a0c14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c0ba1a0 0x7f5a0c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c14e7e0 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c14f770 con 0x7f5a0c06f0b0 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.336+0000 7f5a119d0640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c14eb30 con 0x7f5a0c071f80 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c0ba1a0 0x7f5a0c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0affd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a0c06f0b0 0x7f5a0c14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c0ba1a0 0x7f5a0c14da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45514/0 (socket says 172.21.15.118:45514) 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/1227579932 learned_addr learned my addr 172.21.15.118:0/1227579932 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0a7fc640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c071f80 0x7f5a0c14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/1227579932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c071f80 msgr2=0x7f5a0c14d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c071f80 0x7f5a0c14d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/1227579932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a0c06f0b0 msgr2=0x7f5a0c14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a0c06f0b0 0x7f5a0c14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 -- 172.21.15.118:0/1227579932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04009b30 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a0b7fe640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c0ba1a0 0x7f5a0c14da20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5a04036040 tx=0x7f5a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a03fff640 1 -- 172.21.15.118:0/1227579932 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04009510 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a03fff640 1 -- 172.21.15.118:0/1227579932 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0403e450 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0c14ed80 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a03fff640 1 -- 172.21.15.118:0/1227579932 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0403e800 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.337+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0c1e1ab0 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.338+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0c074af0 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.339+0000 7f5a03fff640 1 -- 172.21.15.118:0/1227579932 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f5a0403e960 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.339+0000 7f5a03fff640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f59ec06bc70 0x7f59ec06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.339+0000 7f5a0affd640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f59ec06bc70 0x7f59ec06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.339+0000 7f5a03fff640 1 -- 172.21.15.118:0/1227579932 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a040ad5e0 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.340+0000 7f5a0affd640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f59ec06bc70 0x7f59ec06e130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f59f4006b10 tx=0x7f59f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.343+0000 7f5a03fff640 1 -- 172.21.15.118:0/1227579932 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a04077f90 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.558+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a0c0a3480 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.559+0000 7f5a03fff640 1 -- 172.21.15.118:0/1227579932 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4156 (secure 0 0 0) 0x7f5a0407b650 con 0x7f5a0c0ba1a0 2024-02-18T11:11:46.560 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:46.560 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4732,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1586932009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1586932009},{"type":"v1","addr":"172.21.15.164:6833","nonce":1586932009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/1218312757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1218312757},{"type":"v1","addr":"172.21.15.118:6836","nonce":1218312757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:01:31.339623+0000","modified":"2024-02-18T10:01:33.344937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6837/2626574740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":2626574740},{"type":"v1","addr":"172.21.15.118:6837","nonce":2626574740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-18T11:11:46.560 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 13 2024-02-18T11:11:46.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f59ec06bc70 msgr2=0x7f59ec06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f59ec06bc70 0x7f59ec06e130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f59f4006b10 tx=0x7f59f4008040 comp rx=0 tx=0).stop 2024-02-18T11:11:46.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c0ba1a0 msgr2=0x7f5a0c14da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c0ba1a0 0x7f5a0c14da20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5a04036040 tx=0x7f5a04004a40 comp rx=0 tx=0).stop 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 shutdown_connections 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f59ec06bc70 0x7f59ec06e130 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a0c0ba1a0 0x7f5a0c14da20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a0c071f80 0x7f5a0c14d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 --2- 172.21.15.118:0/1227579932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a0c06f0b0 0x7f5a0c14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 >> 172.21.15.118:0/1227579932 conn(0x7f5a0c06bcf0 msgr2=0x7f5a0c1434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 shutdown_connections 2024-02-18T11:11:46.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.561+0000 7f5a119d0640 1 -- 172.21.15.118:0/1227579932 wait complete. 2024-02-18T11:11:46.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T11:11:46.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.674+0000 7f1454da1640 1 Processor -- start 2024-02-18T11:11:46.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.674+0000 7f1454da1640 1 -- start start 2024-02-18T11:11:46.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1454da1640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14500bc0a0 0x7f14500b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1454da1640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f145006fda0 0x7f1450143b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1454da1640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1450149c40 con 0x7f1450144040 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1454da1640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500b5b60 con 0x7f145006fda0 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1454da1640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14500b5e40 con 0x7f14500bc0a0 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1447fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f145006fda0 0x7f1450143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1447fff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f145006fda0 0x7f1450143b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45526/0 (socket says 172.21.15.118:45526) 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1447fff640 1 -- 172.21.15.118:0/1586543628 learned_addr learned my addr 172.21.15.118:0/1586543628 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1447fff640 1 -- 172.21.15.118:0/1586543628 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14500bc0a0 msgr2=0x7f14500b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1447fff640 1 --2- 172.21.15.118:0/1586543628 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14500bc0a0 0x7f14500b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1447fff640 1 -- 172.21.15.118:0/1586543628 >> v1:172.21.15.164:6789/0 conn(0x7f1450144040 legacy=0x7f145014a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:46.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.675+0000 7f1447fff640 1 -- 172.21.15.118:0/1586543628 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500b6120 con 0x7f145006fda0 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1447fff640 1 --2- 172.21.15.118:0/1586543628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006fda0 0x7f1450143b00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1438009870 tx=0x7f143802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d50ac03e170d39 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f144dd9b640 1 -- 172.21.15.118:0/1586543628 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438031640 con 0x7f145006fda0 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f144dd9b640 1 -- 172.21.15.118:0/1586543628 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14380317a0 con 0x7f145006fda0 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f144dd9b640 1 -- 172.21.15.118:0/1586543628 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438031b30 con 0x7f145006fda0 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 -- 172.21.15.118:0/1586543628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006fda0 msgr2=0x7f1450143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 --2- 172.21.15.118:0/1586543628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006fda0 0x7f1450143b00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1438009870 tx=0x7f143802b8f0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 -- 172.21.15.118:0/1586543628 shutdown_connections 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 --2- 172.21.15.118:0/1586543628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f145006fda0 0x7f1450143b00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 --2- 172.21.15.118:0/1586543628 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14500bc0a0 0x7f14500b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 -- 172.21.15.118:0/1586543628 >> 172.21.15.118:0/1586543628 conn(0x7f14500bf330 msgr2=0x7f14500bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 -- 172.21.15.118:0/1586543628 shutdown_connections 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.676+0000 7f1454da1640 1 -- 172.21.15.118:0/1586543628 wait complete. 2024-02-18T11:11:46.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 Processor -- start 2024-02-18T11:11:46.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 -- start start 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f145006fda0 0x7f14501e1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500bc0a0 0x7f14501e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450144040 0x7f14500be730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14500bec70 con 0x7f1450144040 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14501e4d70 con 0x7f14500bc0a0 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f1454da1640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145006c880 con 0x7f145006fda0 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f144ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450144040 0x7f14500be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f144ed9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450144040 0x7f14500be730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45528/0 (socket says 172.21.15.118:45528) 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.678+0000 7f144ed9d640 1 -- 172.21.15.118:0/1980365795 learned_addr learned my addr 172.21.15.118:0/1980365795 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:46.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f1447fff640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500bc0a0 0x7f14501e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f144e59c640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f145006fda0 0x7f14501e1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f144ed9d640 1 -- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f145006fda0 msgr2=0x7f14501e1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f144ed9d640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f145006fda0 0x7f14501e1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f144ed9d640 1 -- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500bc0a0 msgr2=0x7f14501e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f144ed9d640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500bc0a0 0x7f14501e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f144ed9d640 1 -- 172.21.15.118:0/1980365795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380094d0 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f144ed9d640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450144040 0x7f14500be730 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f144800b990 tx=0x7f144800bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f1446ffd640 1 -- 172.21.15.118:0/1980365795 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800caa0 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f1446ffd640 1 -- 172.21.15.118:0/1980365795 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800cc00 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14501e5030 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f1446ffd640 1 -- 172.21.15.118:0/1980365795 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448014440 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.679+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145006c120 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.680+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14501e5550 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.681+0000 7f1446ffd640 1 -- 172.21.15.118:0/1980365795 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f144801d3b0 con 0x7f1450144040 2024-02-18T11:11:46.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.681+0000 7f1446ffd640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143006bc70 0x7f143006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:46.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.681+0000 7f1446ffd640 1 -- 172.21.15.118:0/1980365795 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f144808a590 con 0x7f1450144040 2024-02-18T11:11:46.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.681+0000 7f144e59c640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143006bc70 0x7f143006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:46.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.681+0000 7f144e59c640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143006bc70 0x7f143006e130 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1440009990 tx=0x7f1440009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:46.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.685+0000 7f1446ffd640 1 -- 172.21.15.118:0/1980365795 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14501e5550 con 0x7f1450144040 2024-02-18T11:11:46.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.899+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14501e5550 con 0x7f1450144040 2024-02-18T11:11:46.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.900+0000 7f1446ffd640 1 -- 172.21.15.118:0/1980365795 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4156 (secure 0 0 0) 0x7f14501e5550 con 0x7f1450144040 2024-02-18T11:11:46.904 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:46.904 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4732,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1586932009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1586932009},{"type":"v1","addr":"172.21.15.164:6833","nonce":1586932009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/1218312757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1218312757},{"type":"v1","addr":"172.21.15.118:6836","nonce":1218312757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-18T10:01:31.339623+0000","modified":"2024-02-18T10:01:33.344937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6837/2626574740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":2626574740},{"type":"v1","addr":"172.21.15.118:6837","nonce":2626574740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-18T11:11:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 13 2024-02-18T11:11:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143006bc70 msgr2=0x7f143006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143006bc70 0x7f143006e130 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1440009990 tx=0x7f1440009110 comp rx=0 tx=0).stop 2024-02-18T11:11:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450144040 msgr2=0x7f14500be730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450144040 0x7f14500be730 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f144800b990 tx=0x7f144800bd90 comp rx=0 tx=0).stop 2024-02-18T11:11:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 shutdown_connections 2024-02-18T11:11:46.905 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f143006bc70 0x7f143006e130 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1450144040 0x7f14500be730 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14500bc0a0 0x7f14501e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 --2- 172.21.15.118:0/1980365795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f145006fda0 0x7f14501e1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:46.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 >> 172.21.15.118:0/1980365795 conn(0x7f14500bf330 msgr2=0x7f14500a39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:46.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 shutdown_connections 2024-02-18T11:11:46.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:46.902+0000 7f1454da1640 1 -- 172.21.15.118:0/1980365795 wait complete. 2024-02-18T11:11:46.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T11:11:47.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfea1c7640 1 Processor -- start 2024-02-18T11:11:47.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfea1c7640 1 -- start start 2024-02-18T11:11:47.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfea1c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe40b93f0 0x7fbfe4072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfea1c7640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40b9810 con 0x7fbfe406e090 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfea1c7640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40ba440 con 0x7fbfe4148900 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfea1c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4072a40 con 0x7fbfe40b93f0 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfe37fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbfe406e090 0x7fbfe4142960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45452/0 (socket says 172.21.15.118:45452) 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.014+0000 7fbfe37fe640 1 -- 172.21.15.118:0/2635903796 learned_addr learned my addr 172.21.15.118:0/2635903796 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe2ffd640 1 --2- 172.21.15.118:0/2635903796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe40b93f0 0x7fbfe4072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285958521 0 0) 0x7fbfd4001110 con 0x7fbfe406e090 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfcc003520 con 0x7fbfe406e090 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081276649 0 0) 0x7fbfe40ba440 con 0x7fbfe4148900 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd4001110 con 0x7fbfe4148900 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe2ffd640 1 -- 172.21.15.118:0/2635903796 >> v1:172.21.15.164:6789/0 conn(0x7fbfe4148900 legacy=0x7fbfe4153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe2ffd640 1 -- 172.21.15.118:0/2635903796 >> v1:172.21.15.118:6789/0 conn(0x7fbfe406e090 legacy=0x7fbfe4142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1457725094 0 0) 0x7fbfcc003520 con 0x7fbfe406e090 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.015+0000 7fbfe2ffd640 1 -- 172.21.15.118:0/2635903796 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4143070 con 0x7fbfe40b93f0 2024-02-18T11:11:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfe2ffd640 1 --2- 172.21.15.118:0/2635903796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe40b93f0 0x7fbfe4072500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80097d0 tx=0x7fbfd802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4130928ab341b4a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4001800 con 0x7fbfe40b93f0 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8031580 con 0x7fbfe40b93f0 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfe27fc640 1 -- 172.21.15.118:0/2635903796 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8031910 con 0x7fbfe40b93f0 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfea1c7640 1 -- 172.21.15.118:0/2635903796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe40b93f0 msgr2=0x7fbfe4072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/2635903796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe40b93f0 0x7fbfe4072500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80097d0 tx=0x7fbfd802b8a0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfea1c7640 1 -- 172.21.15.118:0/2635903796 shutdown_connections 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/2635903796 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe40b93f0 0x7fbfe4072500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.016+0000 7fbfea1c7640 1 -- 172.21.15.118:0/2635903796 >> 172.21.15.118:0/2635903796 conn(0x7fbfe40bb1d0 msgr2=0x7fbfe40bb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.017+0000 7fbfea1c7640 1 -- 172.21.15.118:0/2635903796 shutdown_connections 2024-02-18T11:11:47.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.017+0000 7fbfea1c7640 1 -- 172.21.15.118:0/2635903796 wait complete. 2024-02-18T11:11:47.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.017+0000 7fbfea1c7640 1 Processor -- start 2024-02-18T11:11:47.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfea1c7640 1 -- start start 2024-02-18T11:11:47.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfea1c7640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe406e090 0x7fbfe41478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfea1c7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfe40b93f0 0x7fbfe41d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfea1c7640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe4148900 0x7fbfe406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfea1c7640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4147e30 con 0x7fbfe40b93f0 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfea1c7640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe41e58b0 con 0x7fbfe4148900 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfea1c7640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe41e5420 con 0x7fbfe406e090 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfe2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfe40b93f0 0x7fbfe41d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfe2ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfe40b93f0 0x7fbfe41d3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45536/0 (socket says 172.21.15.118:45536) 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.018+0000 7fbfe2ffd640 1 -- 172.21.15.118:0/1064374318 learned_addr learned my addr 172.21.15.118:0/1064374318 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe37fe640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe406e090 0x7fbfe41478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe3fff640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe4148900 0x7fbfe406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe2ffd640 1 -- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe406e090 msgr2=0x7fbfe41478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe2ffd640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe406e090 0x7fbfe41478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe2ffd640 1 -- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe4148900 msgr2=0x7fbfe406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe2ffd640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe4148900 0x7fbfe406abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe2ffd640 1 -- 172.21.15.118:0/1064374318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009400 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe3fff640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe4148900 0x7fbfe406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfe2ffd640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfe40b93f0 0x7fbfe41d3d80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8034040 tx=0x7fbfd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfcbfff640 1 -- 172.21.15.118:0/1064374318 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8004030 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfcbfff640 1 -- 172.21.15.118:0/1064374318 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd80041b0 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfcbfff640 1 -- 172.21.15.118:0/1064374318 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8003610 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe4148210 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.019+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe41e4dd0 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.020+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe4074af0 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.020+0000 7fbfcbfff640 1 -- 172.21.15.118:0/1064374318 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fbfd8043070 con 0x7fbfe40b93f0 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.021+0000 7fbfcbfff640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbfd006bc70 0x7fbfd006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.021+0000 7fbfcbfff640 1 -- 172.21.15.118:0/1064374318 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfd80ac400 con 0x7fbfe40b93f0 2024-02-18T11:11:47.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.021+0000 7fbfe37fe640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbfd006bc70 0x7fbfd006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.021+0000 7fbfe37fe640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbfd006bc70 0x7fbfd006e130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4001390 tx=0x7fbfd40012c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.025+0000 7fbfcbfff640 1 -- 172.21.15.118:0/1064374318 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbfd8076d90 con 0x7fbfe40b93f0 2024-02-18T11:11:47.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.221+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfe41e5560 con 0x7fbfe40b93f0 2024-02-18T11:11:47.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.223+0000 7fbfcbfff640 1 -- 172.21.15.118:0/1064374318 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7fbfd807a450 con 0x7fbfe40b93f0 2024-02-18T11:11:47.224 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:47.224 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T10:01:33.001470+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-18T10:01:29.722354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-18T10:01:30.305941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T11:11:47.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.224+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbfd006bc70 msgr2=0x7fbfd006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.224+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbfd006bc70 0x7fbfd006e130 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4001390 tx=0x7fbfd40012c0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.224+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfe40b93f0 msgr2=0x7fbfe41d3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.226 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.224+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfe40b93f0 0x7fbfe41d3d80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8034040 tx=0x7fbfd80046c0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 shutdown_connections 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbfd006bc70 0x7fbfd006e130 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbfe4148900 0x7fbfe406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfe40b93f0 0x7fbfe41d3d80 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 --2- 172.21.15.118:0/1064374318 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbfe406e090 0x7fbfe41478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 >> 172.21.15.118:0/1064374318 conn(0x7fbfe40bb1d0 msgr2=0x7fbfe4148d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 shutdown_connections 2024-02-18T11:11:47.227 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.225+0000 7fbfea1c7640 1 -- 172.21.15.118:0/1064374318 wait complete. 2024-02-18T11:11:47.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-18T11:11:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.338+0000 7f9c8fe8d640 1 Processor -- start 2024-02-18T11:11:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.338+0000 7f9c8fe8d640 1 -- start start 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8fe8d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c8806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8fe8d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c8806ce30 0x7f9c8806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8fe8d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8806dd50 con 0x7f9c8814bcd0 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8fe8d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c880ba440 con 0x7f9c8806ce30 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8fe8d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880bc500 con 0x7f9c8814c900 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8e42a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c8806ce30 0x7f9c8806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8e42a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9c8806ce30 0x7f9c8806d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45550/0 (socket says 172.21.15.118:45550) 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8e42a640 1 -- 172.21.15.118:0/1869924010 learned_addr learned my addr 172.21.15.118:0/1869924010 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:47.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8dc29640 1 --2- 172.21.15.118:0/1869924010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c8806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8e42a640 1 -- 172.21.15.118:0/1869924010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 msgr2=0x7f9c8806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8e42a640 1 --2- 172.21.15.118:0/1869924010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c8806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8e42a640 1 -- 172.21.15.118:0/1869924010 >> v1:172.21.15.118:6789/0 conn(0x7f9c8814bcd0 legacy=0x7f9c880bbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.339+0000 7f9c8e42a640 1 -- 172.21.15.118:0/1869924010 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8806d800 con 0x7f9c8806ce30 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.340+0000 7f9c8e42a640 1 --2- 172.21.15.118:0/1869924010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c8806d2c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009e50 tx=0x7f9c8002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b1c08462e5cfcf server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.340+0000 7f9c8cc27640 1 -- 172.21.15.118:0/1869924010 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8002cb00 con 0x7f9c8806ce30 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.340+0000 7f9c8cc27640 1 -- 172.21.15.118:0/1869924010 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8002cc60 con 0x7f9c8806ce30 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.340+0000 7f9c8cc27640 1 -- 172.21.15.118:0/1869924010 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800343f0 con 0x7f9c8806ce30 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1869924010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 msgr2=0x7f9c8806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1869924010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c8806d2c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009e50 tx=0x7f9c8002bf60 comp rx=0 tx=0).stop 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1869924010 shutdown_connections 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1869924010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c8806d2c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1869924010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c8806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1869924010 >> 172.21.15.118:0/1869924010 conn(0x7f9c880bf330 msgr2=0x7f9c880bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1869924010 shutdown_connections 2024-02-18T11:11:47.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.341+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1869924010 wait complete. 2024-02-18T11:11:47.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 Processor -- start 2024-02-18T11:11:47.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 -- start start 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c881d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c8814bcd0 0x7f9c880b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c881d6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881d5800 con 0x7f9c8806ce30 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880b6690 con 0x7f9c8814bcd0 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8fe8d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880b8620 con 0x7f9c8814c900 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8dc29640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c881d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8dc29640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c881d52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45554/0 (socket says 172.21.15.118:45554) 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.342+0000 7f9c8dc29640 1 -- 172.21.15.118:0/1550909908 learned_addr learned my addr 172.21.15.118:0/1550909908 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8e42a640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c881d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8dc29640 1 -- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 msgr2=0x7f9c881d6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8dc29640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c881d6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8d428640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c8814bcd0 0x7f9c880b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8dc29640 1 -- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c8814bcd0 msgr2=0x7f9c880b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8dc29640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c8814bcd0 0x7f9c880b8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8dc29640 1 -- 172.21.15.118:0/1550909908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009b30 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8dc29640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c881d52c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800d5f0 tx=0x7f9c7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c7e7fc640 1 -- 172.21.15.118:0/1550909908 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780125f0 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c7e7fc640 1 -- 172.21.15.118:0/1550909908 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c78012750 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c881d59e0 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c7e7fc640 1 -- 172.21.15.118:0/1550909908 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78012b00 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.343+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c880b88e0 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.344+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c880b8a70 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.345+0000 7f9c7e7fc640 1 -- 172.21.15.118:0/1550909908 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9c78012c60 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.345+0000 7f9c7e7fc640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9c6c06bca0 0x7f9c6c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.345+0000 7f9c7e7fc640 1 -- 172.21.15.118:0/1550909908 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c7808ab90 con 0x7f9c8806ce30 2024-02-18T11:11:47.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.345+0000 7f9c8d428640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9c6c06bca0 0x7f9c6c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.345+0000 7f9c8d428640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9c6c06bca0 0x7f9c6c06e160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9c881d9140 tx=0x7f9c84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.349+0000 7f9c7e7fc640 1 -- 172.21.15.118:0/1550909908 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c78055400 con 0x7f9c8806ce30 2024-02-18T11:11:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.561+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9c88074af0 con 0x7f9c8806ce30 2024-02-18T11:11:47.583 INFO:tasks.ceph.mon.a.smithi118.stderr:2024-02-18T11:11:47.582+0000 7f48a027e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-18T11:11:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.583+0000 7f9c7e7fc640 1 -- 172.21.15.118:0/1550909908 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9c78058ac0 con 0x7f9c8806ce30 2024-02-18T11:11:47.584 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9c6c06bca0 msgr2=0x7f9c6c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9c6c06bca0 0x7f9c6c06e160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9c881d9140 tx=0x7f9c84009040 comp rx=0 tx=0).stop 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 msgr2=0x7f9c881d52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c881d52c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800d5f0 tx=0x7f9c7800dab0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 shutdown_connections 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9c6c06bca0 0x7f9c6c06e160 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c8814c900 0x7f9c881d6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c8814bcd0 0x7f9c880b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 --2- 172.21.15.118:0/1550909908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c8806ce30 0x7f9c881d52c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.587+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 >> 172.21.15.118:0/1550909908 conn(0x7f9c880bf330 msgr2=0x7f9c880b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:47.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.588+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 shutdown_connections 2024-02-18T11:11:47.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.588+0000 7f9c8fe8d640 1 -- 172.21.15.118:0/1550909908 wait complete. 2024-02-18T11:11:47.595 INFO:tasks.ceph.mds.a.smithi118.stderr: -4464> 2024-02-18T11:11:32.658+0000 7fd71beff640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51365) UID: 0 2024-02-18T11:11:47.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-18T11:11:47.671 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-02-18T11:11:47.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.703+0000 7fbc399f4640 1 Processor -- start 2024-02-18T11:11:47.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.703+0000 7fbc399f4640 1 -- start start 2024-02-18T11:11:47.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc399f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc34070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc399f4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc34072a70 0x7fbc3414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc399f4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc340b9960 con 0x7fbc3406fdb0 2024-02-18T11:11:47.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc399f4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3406b8b0 con 0x7fbc34072a70 2024-02-18T11:11:47.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc399f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3406b2f0 con 0x7fbc34143e40 2024-02-18T11:11:47.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc327fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc34072a70 0x7fbc3414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc327fc640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc34072a70 0x7fbc3414a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45582/0 (socket says 172.21.15.118:45582) 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc327fc640 1 -- 172.21.15.118:0/2238367200 learned_addr learned my addr 172.21.15.118:0/2238367200 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc32ffd640 1 --2- 172.21.15.118:0/2238367200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc34070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc327fc640 1 -- 172.21.15.118:0/2238367200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 msgr2=0x7fbc34070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc327fc640 1 --2- 172.21.15.118:0/2238367200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc34070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc327fc640 1 -- 172.21.15.118:0/2238367200 >> v1:172.21.15.118:6789/0 conn(0x7fbc3406fdb0 legacy=0x7fbc3414cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc327fc640 1 -- 172.21.15.118:0/2238367200 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3406b5d0 con 0x7fbc34072a70 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.704+0000 7fbc32ffd640 1 --2- 172.21.15.118:0/2238367200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc34070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:47.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.705+0000 7fbc327fc640 1 --2- 172.21.15.118:0/2238367200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc3414a0a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009870 tx=0x7fbc2802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4237c0a82bb4f315 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.705+0000 7fbc31ffb640 1 -- 172.21.15.118:0/2238367200 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2802f840 con 0x7fbc34072a70 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.705+0000 7fbc31ffb640 1 -- 172.21.15.118:0/2238367200 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2802f9a0 con 0x7fbc34072a70 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.705+0000 7fbc31ffb640 1 -- 172.21.15.118:0/2238367200 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2802fd30 con 0x7fbc34072a70 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 -- 172.21.15.118:0/2238367200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 msgr2=0x7fbc3414a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 --2- 172.21.15.118:0/2238367200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc3414a0a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009870 tx=0x7fbc2802ba20 comp rx=0 tx=0).stop 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 -- 172.21.15.118:0/2238367200 shutdown_connections 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 --2- 172.21.15.118:0/2238367200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc3414a0a0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 --2- 172.21.15.118:0/2238367200 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc34070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 -- 172.21.15.118:0/2238367200 >> 172.21.15.118:0/2238367200 conn(0x7fbc340ba410 msgr2=0x7fbc3406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 -- 172.21.15.118:0/2238367200 shutdown_connections 2024-02-18T11:11:47.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.706+0000 7fbc399f4640 1 -- 172.21.15.118:0/2238367200 wait complete. 2024-02-18T11:11:47.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.707+0000 7fbc399f4640 1 Processor -- start 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.707+0000 7fbc399f4640 1 -- start start 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc399f4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc3406fdb0 0x7fbc341489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc399f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc341d3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc399f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc340b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc399f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc34148f10 con 0x7fbc34072a70 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc399f4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc341d39b0 con 0x7fbc3406fdb0 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc399f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340b3f70 con 0x7fbc34143e40 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc341d3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc341d3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45596/0 (socket says 172.21.15.118:45596) 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 -- 172.21.15.118:0/3941886056 learned_addr learned my addr 172.21.15.118:0/3941886056 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc32ffd640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc3406fdb0 0x7fbc341489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc337fe640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc340b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 -- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 msgr2=0x7fbc340b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc340b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 -- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc3406fdb0 msgr2=0x7fbc341489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc3406fdb0 0x7fbc341489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 -- 172.21.15.118:0/3941886056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280094d0 con 0x7fbc34072a70 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc32ffd640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc3406fdb0 0x7fbc341489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc337fe640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc340b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc327fc640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc341d3470 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc1bfff640 1 -- 172.21.15.118:0/3941886056 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2802f810 con 0x7fbc34072a70 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc1bfff640 1 -- 172.21.15.118:0/3941886056 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28041400 con 0x7fbc34072a70 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc1bfff640 1 -- 172.21.15.118:0/3941886056 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280417d0 con 0x7fbc34072a70 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.708+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc341d3bf0 con 0x7fbc34072a70 2024-02-18T11:11:47.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.709+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc340b35d0 con 0x7fbc34072a70 2024-02-18T11:11:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.710+0000 7fbc1bfff640 1 -- 172.21.15.118:0/3941886056 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fbc28041930 con 0x7fbc34072a70 2024-02-18T11:11:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.710+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3406b9f0 con 0x7fbc34072a70 2024-02-18T11:11:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.710+0000 7fbc1bfff640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbc2006bc70 0x7fbc2006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.710+0000 7fbc1bfff640 1 -- 172.21.15.118:0/3941886056 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbc2803c070 con 0x7fbc34072a70 2024-02-18T11:11:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.710+0000 7fbc32ffd640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbc2006bc70 0x7fbc2006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.711+0000 7fbc32ffd640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbc2006bc70 0x7fbc2006e130 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00a990 tx=0x7fbc2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:47.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.714+0000 7fbc1bfff640 1 -- 172.21.15.118:0/3941886056 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc28077f90 con 0x7fbc34072a70 2024-02-18T11:11:47.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:47.924+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbc34075150 con 0x7fbc34072a70 2024-02-18T11:11:48.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.593+0000 7fbc1bfff640 1 -- 172.21.15.118:0/3941886056 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc2807b650 con 0x7fbc34072a70 2024-02-18T11:11:48.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbc2006bc70 msgr2=0x7fbc2006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbc2006bc70 0x7fbc2006e130 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00a990 tx=0x7fbc2c008040 comp rx=0 tx=0).stop 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 msgr2=0x7fbc341d3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc341d3470 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc28004730 comp rx=0 tx=0).stop 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 shutdown_connections 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fbc2006bc70 0x7fbc2006e130 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbc34143e40 0x7fbc340b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc34072a70 0x7fbc341d3470 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 --2- 172.21.15.118:0/3941886056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc3406fdb0 0x7fbc341489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 >> 172.21.15.118:0/3941886056 conn(0x7fbc340ba410 msgr2=0x7fbc340b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 shutdown_connections 2024-02-18T11:11:48.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.595+0000 7fbc399f4640 1 -- 172.21.15.118:0/3941886056 wait complete. 2024-02-18T11:11:48.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-18T11:11:48.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.711+0000 7f0edbb77640 1 Processor -- start 2024-02-18T11:11:48.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.711+0000 7f0edbb77640 1 -- start start 2024-02-18T11:11:48.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0edbb77640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ed40a14c0 0x7f0ed40be690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:48.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0edbb77640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0ed40beff0 0x7f0ed406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:48.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0edbb77640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed4145720 0x7f0ed4145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0edbb77640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed41460b0 con 0x7f0ed40beff0 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0edbb77640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40bebd0 con 0x7f0ed40a14c0 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0edbb77640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed414bcc0 con 0x7f0ed4145720 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0ed40beff0 0x7f0ed406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0ed40beff0 0x7f0ed406eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35806/0 (socket says 172.21.15.118:35806) 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 -- 172.21.15.118:0/1615290564 learned_addr learned my addr 172.21.15.118:0/1615290564 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 -- 172.21.15.118:0/1615290564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed4145720 msgr2=0x7f0ed4145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 --2- 172.21.15.118:0/1615290564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed4145720 0x7f0ed4145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 -- 172.21.15.118:0/1615290564 >> v2:172.21.15.164:3300/0 conn(0x7f0ed40a14c0 msgr2=0x7f0ed40be690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 --2- 172.21.15.118:0/1615290564 >> v2:172.21.15.164:3300/0 conn(0x7f0ed40a14c0 0x7f0ed40be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.712+0000 7f0ed9112640 1 -- 172.21.15.118:0/1615290564 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed414bfa0 con 0x7f0ed40beff0 2024-02-18T11:11:48.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.713+0000 7f0ed9112640 1 --2- 172.21.15.118:0/1615290564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed406eac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40bd040 tx=0x7f0ec402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4447083e15f7c61 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.713+0000 7f0ed8911640 1 -- 172.21.15.118:0/1615290564 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4030860 con 0x7f0ed40beff0 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.713+0000 7f0ed8911640 1 -- 172.21.15.118:0/1615290564 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec40309c0 con 0x7f0ed40beff0 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.713+0000 7f0ed8911640 1 -- 172.21.15.118:0/1615290564 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4030d50 con 0x7f0ed40beff0 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.713+0000 7f0edbb77640 1 -- 172.21.15.118:0/1615290564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 msgr2=0x7f0ed406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.713+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1615290564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed406eac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40bd040 tx=0x7f0ec402b9a0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.713+0000 7f0edbb77640 1 -- 172.21.15.118:0/1615290564 shutdown_connections 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.714+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1615290564 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed4145720 0x7f0ed4145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.714+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1615290564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed406eac0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.714+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1615290564 >> v2:172.21.15.164:3300/0 conn(0x7f0ed40a14c0 0x7f0ed40be690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.714+0000 7f0edbb77640 1 -- 172.21.15.118:0/1615290564 >> 172.21.15.118:0/1615290564 conn(0x7f0ed40bf510 msgr2=0x7f0ed40bf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.714+0000 7f0edbb77640 1 -- 172.21.15.118:0/1615290564 shutdown_connections 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.714+0000 7f0edbb77640 1 -- 172.21.15.118:0/1615290564 wait complete. 2024-02-18T11:11:48.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 Processor -- start 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 -- start start 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed40a14c0 0x7f0ed414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed41e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed4145720 0x7f0ed40b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed414d950 con 0x7f0ed40beff0 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed414cd70 con 0x7f0ed4145720 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0edbb77640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed414cfc0 con 0x7f0ed40a14c0 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0ed9112640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed41e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0ed9112640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed41e1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35808/0 (socket says 172.21.15.118:35808) 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0ed9112640 1 -- 172.21.15.118:0/1585183096 learned_addr learned my addr 172.21.15.118:0/1585183096 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0eda114640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed4145720 0x7f0ed40b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.715+0000 7f0ed9913640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed40a14c0 0x7f0ed414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0ed9112640 1 -- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed40a14c0 msgr2=0x7f0ed414d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0ed9112640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed40a14c0 0x7f0ed414d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0ed9112640 1 -- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed4145720 msgr2=0x7f0ed40b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0ed9112640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed4145720 0x7f0ed40b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0ed9112640 1 -- 172.21.15.118:0/1585183096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40094d0 con 0x7f0ed40beff0 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0ed9112640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed41e1c70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4000c00 tx=0x7f0ec4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0eca7fc640 1 -- 172.21.15.118:0/1585183096 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4039d40 con 0x7f0ed40beff0 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0eca7fc640 1 -- 172.21.15.118:0/1585183096 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4043400 con 0x7f0ed40beff0 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0eca7fc640 1 -- 172.21.15.118:0/1585183096 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4039ea0 con 0x7f0ed40beff0 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed41e21b0 con 0x7f0ed40beff0 2024-02-18T11:11:48.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.716+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed41e52f0 con 0x7f0ed40beff0 2024-02-18T11:11:48.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.717+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed406f1d0 con 0x7f0ed40beff0 2024-02-18T11:11:48.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.717+0000 7f0eca7fc640 1 -- 172.21.15.118:0/1585183096 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f0ec40437b0 con 0x7f0ed40beff0 2024-02-18T11:11:48.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.718+0000 7f0eca7fc640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0eb806bc70 0x7f0eb806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:48.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.718+0000 7f0eca7fc640 1 -- 172.21.15.118:0/1585183096 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0ec403e070 con 0x7f0ed40beff0 2024-02-18T11:11:48.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.718+0000 7f0ed9913640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0eb806bc70 0x7f0eb806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:48.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.718+0000 7f0ed9913640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0eb806bc70 0x7f0eb806e130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009890 tx=0x7f0ed0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:48.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.722+0000 7f0eca7fc640 1 -- 172.21.15.118:0/1585183096 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ec4078240 con 0x7f0ed40beff0 2024-02-18T11:11:48.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:48.897+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ed4074af0 con 0x7f0ed40beff0 2024-02-18T11:11:49.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.598+0000 7f0eca7fc640 1 -- 172.21.15.118:0/1585183096 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0ec40340d0 con 0x7f0ed40beff0 2024-02-18T11:11:49.599 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-02-18T11:11:49.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0eb806bc70 msgr2=0x7f0eb806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:49.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0eb806bc70 0x7f0eb806e130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009890 tx=0x7f0ed0008040 comp rx=0 tx=0).stop 2024-02-18T11:11:49.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 msgr2=0x7f0ed41e1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:49.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed41e1c70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4000c00 tx=0x7f0ec4004730 comp rx=0 tx=0).stop 2024-02-18T11:11:49.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 shutdown_connections 2024-02-18T11:11:49.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f0eb806bc70 0x7f0eb806e130 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ed4145720 0x7f0ed40b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ed40beff0 0x7f0ed41e1c70 secure :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4000c00 tx=0x7f0ec4004730 comp rx=0 tx=0).stop 2024-02-18T11:11:49.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 --2- 172.21.15.118:0/1585183096 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ed40a14c0 0x7f0ed414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 >> 172.21.15.118:0/1585183096 conn(0x7f0ed40bf510 msgr2=0x7f0ed406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:49.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 shutdown_connections 2024-02-18T11:11:49.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.602+0000 7f0edbb77640 1 -- 172.21.15.118:0/1585183096 wait complete. 2024-02-18T11:11:49.617 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-18T11:11:49.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.722+0000 7f77e6979640 1 Processor -- start 2024-02-18T11:11:49.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.722+0000 7f77e6979640 1 -- start start 2024-02-18T11:11:49.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.722+0000 7f77e6979640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f77e0145c50 0x7f77e01460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:49.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.722+0000 7f77e6979640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f77e00ba0b0 0x7f77e00ba540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.722+0000 7f77e6979640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e00baa80 con 0x7f77e00bb730 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.722+0000 7f77e6979640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00bd4c0 con 0x7f77e0145c50 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.722+0000 7f77e6979640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00bd7a0 con 0x7f77e00ba0b0 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77df7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f77e0145c50 0x7f77e01460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77df7fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f77e0145c50 0x7f77e01460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35820/0 (socket says 172.21.15.118:35820) 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77df7fe640 1 -- 172.21.15.118:0/1094918777 learned_addr learned my addr 172.21.15.118:0/1094918777 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77e4f16640 1 --2- 172.21.15.118:0/1094918777 >> v2:172.21.15.164:3300/0 conn(0x7f77e00ba0b0 0x7f77e00ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77df7fe640 1 -- 172.21.15.118:0/1094918777 >> v2:172.21.15.164:3300/0 conn(0x7f77e00ba0b0 msgr2=0x7f77e00ba540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77df7fe640 1 --2- 172.21.15.118:0/1094918777 >> v2:172.21.15.164:3300/0 conn(0x7f77e00ba0b0 0x7f77e00ba540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77df7fe640 1 -- 172.21.15.118:0/1094918777 >> v1:172.21.15.164:6789/0 conn(0x7f77e00bb730 legacy=0x7f77e00bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.723+0000 7f77df7fe640 1 -- 172.21.15.118:0/1094918777 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00bda80 con 0x7f77e0145c50 2024-02-18T11:11:49.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77df7fe640 1 --2- 172.21.15.118:0/1094918777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e0145c50 0x7f77e01460a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f77e00b94a0 tx=0x7f77d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8d58d70b527388 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77deffd640 1 -- 172.21.15.118:0/1094918777 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0030860 con 0x7f77e0145c50 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77deffd640 1 -- 172.21.15.118:0/1094918777 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00309c0 con 0x7f77e0145c50 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77deffd640 1 -- 172.21.15.118:0/1094918777 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0030d50 con 0x7f77e0145c50 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 -- 172.21.15.118:0/1094918777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e0145c50 msgr2=0x7f77e01460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 --2- 172.21.15.118:0/1094918777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e0145c50 0x7f77e01460a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f77e00b94a0 tx=0x7f77d002b9a0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 -- 172.21.15.118:0/1094918777 shutdown_connections 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 --2- 172.21.15.118:0/1094918777 >> v2:172.21.15.164:3300/0 conn(0x7f77e00ba0b0 0x7f77e00ba540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 --2- 172.21.15.118:0/1094918777 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e0145c50 0x7f77e01460a0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 -- 172.21.15.118:0/1094918777 >> 172.21.15.118:0/1094918777 conn(0x7f77e00bea10 msgr2=0x7f77e00badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 -- 172.21.15.118:0/1094918777 shutdown_connections 2024-02-18T11:11:49.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.724+0000 7f77e6979640 1 -- 172.21.15.118:0/1094918777 wait complete. 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.725+0000 7f77e6979640 1 Processor -- start 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.725+0000 7f77e6979640 1 -- start start 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77e6979640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77e00ba0b0 0x7f77e00b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77e6979640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00bb730 0x7f77e00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77e6979640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77e0145c50 0x7f77e00b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77e6979640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00b56b0 con 0x7f77e00bb730 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77e6979640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00b5990 con 0x7f77e00ba0b0 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77e6979640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00b8360 con 0x7f77e0145c50 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00bb730 0x7f77e00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00bb730 0x7f77e00b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35830/0 (socket says 172.21.15.118:35830) 2024-02-18T11:11:49.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 -- 172.21.15.118:0/1193808258 learned_addr learned my addr 172.21.15.118:0/1193808258 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77dffff640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77e00ba0b0 0x7f77e00b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77e4f16640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77e0145c50 0x7f77e00b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 -- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77e0145c50 msgr2=0x7f77e00b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77e0145c50 0x7f77e00b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 -- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77e00ba0b0 msgr2=0x7f77e00b7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77e00ba0b0 0x7f77e00b7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77df7fe640 1 -- 172.21.15.118:0/1193808258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094d0 con 0x7f77e00bb730 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.726+0000 7f77dffff640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77e00ba0b0 0x7f77e00b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.727+0000 7f77df7fe640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00bb730 0x7f77e00b5e20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000c00 tx=0x7f77d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.727+0000 7f77dcff9640 1 -- 172.21.15.118:0/1193808258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d003e070 con 0x7f77e00bb730 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.727+0000 7f77dcff9640 1 -- 172.21.15.118:0/1193808258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0039a60 con 0x7f77e00bb730 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.727+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e009fe00 con 0x7f77e00bb730 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.727+0000 7f77dcff9640 1 -- 172.21.15.118:0/1193808258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0039df0 con 0x7f77e00bb730 2024-02-18T11:11:49.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.727+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e00b73c0 con 0x7f77e00bb730 2024-02-18T11:11:49.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.728+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e00b5b20 con 0x7f77e00bb730 2024-02-18T11:11:49.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.728+0000 7f77dcff9640 1 -- 172.21.15.118:0/1193808258 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f77d004b400 con 0x7f77e00bb730 2024-02-18T11:11:49.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.729+0000 7f77dcff9640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77cc06bca0 0x7f77cc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:49.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.729+0000 7f77dcff9640 1 -- 172.21.15.118:0/1193808258 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f77d00acd90 con 0x7f77e00bb730 2024-02-18T11:11:49.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.729+0000 7f77dffff640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77cc06bca0 0x7f77cc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:49.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.729+0000 7f77dffff640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77cc06bca0 0x7f77cc06e160 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77d4001700 tx=0x7f77d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:49.737 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.736+0000 7f77dcff9640 1 -- 172.21.15.118:0/1193808258 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f77d0077780 con 0x7f77e00bb730 2024-02-18T11:11:49.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:49.911+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77e00b75b0 con 0x7f77e00bb730 2024-02-18T11:11:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.604+0000 7f77dcff9640 1 -- 172.21.15.118:0/1193808258 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f77d00340d0 con 0x7f77e00bb730 2024-02-18T11:11:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.606+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77cc06bca0 msgr2=0x7f77cc06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.606+0000 7f77e6979640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77cc06bca0 0x7f77cc06e160 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77d4001700 tx=0x7f77d4009040 comp rx=0 tx=0).stop 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00bb730 msgr2=0x7f77e00b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00bb730 0x7f77e00b5e20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000c00 tx=0x7f77d00046c0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 shutdown_connections 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f77cc06bca0 0x7f77cc06e160 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77e0145c50 0x7f77e00b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f77e00bb730 0x7f77e00b5e20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 --2- 172.21.15.118:0/1193808258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77e00ba0b0 0x7f77e00b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 >> 172.21.15.118:0/1193808258 conn(0x7f77e00bea10 msgr2=0x7f77e006bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 shutdown_connections 2024-02-18T11:11:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.607+0000 7f77e6979640 1 -- 172.21.15.118:0/1193808258 wait complete. 2024-02-18T11:11:50.626 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-02-18T11:11:50.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.774+0000 7f430511e640 1 Processor -- start 2024-02-18T11:11:50.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.774+0000 7f430511e640 1 -- start start 2024-02-18T11:11:50.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.775+0000 7f430511e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f430014d790 0x7f4300150650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:50.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.775+0000 7f430511e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f43000a0ce0 0x7f4300150b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:50.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.775+0000 7f430511e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430014db70 con 0x7f4300072090 2024-02-18T11:11:50.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.775+0000 7f430511e640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43000a1e70 con 0x7f43000a0ce0 2024-02-18T11:11:50.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.775+0000 7f430511e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4300153e20 con 0x7f430014d790 2024-02-18T11:11:50.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.776+0000 7f42fe59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f43000a0ce0 0x7f4300150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:50.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.776+0000 7f42fe59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f43000a0ce0 0x7f4300150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35842/0 (socket says 172.21.15.118:35842) 2024-02-18T11:11:50.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.776+0000 7f42fe59c640 1 -- 172.21.15.118:0/18093080 learned_addr learned my addr 172.21.15.118:0/18093080 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:50.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.776+0000 7f42fed9d640 1 --2- 172.21.15.118:0/18093080 >> v2:172.21.15.164:3300/0 conn(0x7f430014d790 0x7f4300150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:50.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.777+0000 7f42fe59c640 1 -- 172.21.15.118:0/18093080 >> v2:172.21.15.164:3300/0 conn(0x7f430014d790 msgr2=0x7f4300150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:50.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.777+0000 7f42fe59c640 1 --2- 172.21.15.118:0/18093080 >> v2:172.21.15.164:3300/0 conn(0x7f430014d790 0x7f4300150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.777+0000 7f42fe59c640 1 -- 172.21.15.118:0/18093080 >> v1:172.21.15.164:6789/0 conn(0x7f4300072090 legacy=0x7f4300072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.777+0000 7f42fe59c640 1 -- 172.21.15.118:0/18093080 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300154100 con 0x7f43000a0ce0 2024-02-18T11:11:50.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.778+0000 7f42fe59c640 1 --2- 172.21.15.118:0/18093080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f4300150b90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f430006ffc0 tx=0x7f42f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a8353709dd4010 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:50.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.778+0000 7f42fdd9b640 1 -- 172.21.15.118:0/18093080 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0030860 con 0x7f43000a0ce0 2024-02-18T11:11:50.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.778+0000 7f42fdd9b640 1 -- 172.21.15.118:0/18093080 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f00309c0 con 0x7f43000a0ce0 2024-02-18T11:11:50.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.779+0000 7f430511e640 1 -- 172.21.15.118:0/18093080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 msgr2=0x7f4300150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.779+0000 7f430511e640 1 --2- 172.21.15.118:0/18093080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f4300150b90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f430006ffc0 tx=0x7f42f002b9a0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.780+0000 7f430511e640 1 -- 172.21.15.118:0/18093080 shutdown_connections 2024-02-18T11:11:50.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.780+0000 7f430511e640 1 --2- 172.21.15.118:0/18093080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f4300150b90 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.780+0000 7f430511e640 1 --2- 172.21.15.118:0/18093080 >> v2:172.21.15.164:3300/0 conn(0x7f430014d790 0x7f4300150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.780+0000 7f430511e640 1 -- 172.21.15.118:0/18093080 >> 172.21.15.118:0/18093080 conn(0x7f43000a11c0 msgr2=0x7f43000a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:50.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.780+0000 7f430511e640 1 -- 172.21.15.118:0/18093080 shutdown_connections 2024-02-18T11:11:50.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.780+0000 7f430511e640 1 -- 172.21.15.118:0/18093080 wait complete. 2024-02-18T11:11:50.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.782+0000 7f430511e640 1 Processor -- start 2024-02-18T11:11:50.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.782+0000 7f430511e640 1 -- start start 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f430511e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300072090 0x7f430014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f430511e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f43000b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f430511e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f430014d790 0x7f43001f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f430511e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43001ee7a0 con 0x7f43000a0ce0 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f430511e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4300146a70 con 0x7f430014d790 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f430511e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43001ee0e0 con 0x7f4300072090 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f43000b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f43000b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35844/0 (socket says 172.21.15.118:35844) 2024-02-18T11:11:50.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f42fe59c640 1 -- 172.21.15.118:0/2071089072 learned_addr learned my addr 172.21.15.118:0/2071089072 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.783+0000 7f42ff59e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f430014d790 0x7f43001f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42fed9d640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300072090 0x7f430014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42fe59c640 1 -- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300072090 msgr2=0x7f430014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42fe59c640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300072090 0x7f430014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42fe59c640 1 -- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f430014d790 msgr2=0x7f43001f1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42fe59c640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f430014d790 0x7f43001f1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42fe59c640 1 -- 172.21.15.118:0/2071089072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00094d0 con 0x7f43000a0ce0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42ff59e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f430014d790 0x7f43001f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42fe59c640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f43000b5ba0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42e77fe640 1 -- 172.21.15.118:0/2071089072 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0043400 con 0x7f43000a0ce0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42e77fe640 1 -- 172.21.15.118:0/2071089072 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0043560 con 0x7f43000a0ce0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f42e77fe640 1 -- 172.21.15.118:0/2071089072 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0043400 con 0x7f43000a0ce0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43001ee3c0 con 0x7f43000a0ce0 2024-02-18T11:11:50.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.784+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43001eebc0 con 0x7f43000a0ce0 2024-02-18T11:11:50.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.786+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e0005290 con 0x7f43000a0ce0 2024-02-18T11:11:50.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.787+0000 7f42e77fe640 1 -- 172.21.15.118:0/2071089072 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f42f0030b00 con 0x7f43000a0ce0 2024-02-18T11:11:50.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.788+0000 7f42e77fe640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f42ec06bd30 0x7f42ec06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:50.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.788+0000 7f42e77fe640 1 -- 172.21.15.118:0/2071089072 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f42f003e070 con 0x7f43000a0ce0 2024-02-18T11:11:50.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.788+0000 7f42fed9d640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f42ec06bd30 0x7f42ec06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:50.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.789+0000 7f42fed9d640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f42ec06bd30 0x7f42ec06e1f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42f80073f0 tx=0x7f42f800d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:50.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.796+0000 7f42e77fe640 1 -- 172.21.15.118:0/2071089072 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42f0077c60 con 0x7f43000a0ce0 2024-02-18T11:11:50.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.991+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f42e0005810 con 0x7f43000a0ce0 2024-02-18T11:11:50.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.995+0000 7f42e77fe640 1 -- 172.21.15.118:0/2071089072 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f42f007b320 con 0x7f43000a0ce0 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f42ec06bd30 msgr2=0x7f42ec06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f42ec06bd30 0x7f42ec06e1f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42f80073f0 tx=0x7f42f800d040 comp rx=0 tx=0).stop 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 msgr2=0x7f43000b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f43000b5ba0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f0004730 comp rx=0 tx=0).stop 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 shutdown_connections 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f42ec06bd30 0x7f42ec06e1f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f430014d790 0x7f43001f1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43000a0ce0 0x7f43000b5ba0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 --2- 172.21.15.118:0/2071089072 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300072090 0x7f430014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 >> 172.21.15.118:0/2071089072 conn(0x7f43000a11c0 msgr2=0x7f430006cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 shutdown_connections 2024-02-18T11:11:50.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:50.997+0000 7f430511e640 1 -- 172.21.15.118:0/2071089072 wait complete. 2024-02-18T11:11:51.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-02-18T11:11:51.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.108+0000 7fde4abc2640 1 Processor -- start 2024-02-18T11:11:51.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.108+0000 7fde4abc2640 1 -- start start 2024-02-18T11:11:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.108+0000 7fde4abc2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde44142f70 0x7fde4406d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.108+0000 7fde4abc2640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde440b5240 0x7fde4406de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.108+0000 7fde4abc2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde44149760 con 0x7fde440b9f30 2024-02-18T11:11:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.108+0000 7fde4abc2640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4406ec00 con 0x7fde440b5240 2024-02-18T11:11:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.108+0000 7fde4abc2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde440bab50 con 0x7fde44142f70 2024-02-18T11:11:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde4915f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde440b5240 0x7fde4406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:51.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde4915f640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fde440b5240 0x7fde4406de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35858/0 (socket says 172.21.15.118:35858) 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde4915f640 1 -- 172.21.15.118:0/2244229961 learned_addr learned my addr 172.21.15.118:0/2244229961 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde43fff640 1 --2- 172.21.15.118:0/2244229961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde44142f70 0x7fde4406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde4915f640 1 -- 172.21.15.118:0/2244229961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde44142f70 msgr2=0x7fde4406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde4915f640 1 --2- 172.21.15.118:0/2244229961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde44142f70 0x7fde4406d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde4915f640 1 -- 172.21.15.118:0/2244229961 >> v1:172.21.15.164:6789/0 conn(0x7fde440b9f30 legacy=0x7fde44142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde4915f640 1 -- 172.21.15.118:0/2244229961 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44148e30 con 0x7fde440b5240 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.109+0000 7fde43fff640 1 --2- 172.21.15.118:0/2244229961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde44142f70 0x7fde4406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde4915f640 1 --2- 172.21.15.118:0/2244229961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde440b5240 0x7fde4406de90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3268f43cc75287a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde437fe640 1 -- 172.21.15.118:0/2244229961 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c02ca70 con 0x7fde440b5240 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde437fe640 1 -- 172.21.15.118:0/2244229961 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c02cbd0 con 0x7fde440b5240 2024-02-18T11:11:51.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde437fe640 1 -- 172.21.15.118:0/2244229961 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0343f0 con 0x7fde440b5240 2024-02-18T11:11:51.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde4abc2640 1 -- 172.21.15.118:0/2244229961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde440b5240 msgr2=0x7fde4406de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde4abc2640 1 --2- 172.21.15.118:0/2244229961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde440b5240 0x7fde4406de90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c02bed0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde4abc2640 1 -- 172.21.15.118:0/2244229961 shutdown_connections 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde4abc2640 1 --2- 172.21.15.118:0/2244229961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde440b5240 0x7fde4406de90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde4abc2640 1 --2- 172.21.15.118:0/2244229961 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde44142f70 0x7fde4406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.110+0000 7fde4abc2640 1 -- 172.21.15.118:0/2244229961 >> 172.21.15.118:0/2244229961 conn(0x7fde4406bcf0 msgr2=0x7fde4406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.111+0000 7fde4abc2640 1 -- 172.21.15.118:0/2244229961 shutdown_connections 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.111+0000 7fde4abc2640 1 -- 172.21.15.118:0/2244229961 wait complete. 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.112+0000 7fde4abc2640 1 Processor -- start 2024-02-18T11:11:51.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.112+0000 7fde4abc2640 1 -- start start 2024-02-18T11:11:51.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4abc2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde440b5240 0x7fde44072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:51.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4abc2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde440b9f30 0x7fde440b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:51.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4abc2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde44142f70 0x7fde440b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4abc2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde44072f90 con 0x7fde44142f70 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4abc2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440b6b40 con 0x7fde440b5240 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4abc2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde440b73a0 con 0x7fde440b9f30 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4915f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde44142f70 0x7fde440b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4915f640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde44142f70 0x7fde440b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35870/0 (socket says 172.21.15.118:35870) 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4915f640 1 -- 172.21.15.118:0/536744670 learned_addr learned my addr 172.21.15.118:0/536744670 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde4895e640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde440b5240 0x7fde44072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.113+0000 7fde43fff640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde440b9f30 0x7fde440b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4915f640 1 -- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde440b9f30 msgr2=0x7fde440b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4915f640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde440b9f30 0x7fde440b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4915f640 1 -- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde440b5240 msgr2=0x7fde44072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4915f640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde440b5240 0x7fde44072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4915f640 1 -- 172.21.15.118:0/536744670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c009b30 con 0x7fde44142f70 2024-02-18T11:11:51.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4895e640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde440b5240 0x7fde44072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde43fff640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde440b9f30 0x7fde440b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4915f640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde44142f70 0x7fde440b56b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde417fa640 1 -- 172.21.15.118:0/536744670 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03e450 con 0x7fde44142f70 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde417fa640 1 -- 172.21.15.118:0/536744670 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c03e5d0 con 0x7fde44142f70 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde440b8440 con 0x7fde44142f70 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde417fa640 1 -- 172.21.15.118:0/536744670 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c03e980 con 0x7fde44142f70 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.114+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440b6d50 con 0x7fde44142f70 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.115+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde44074af0 con 0x7fde44142f70 2024-02-18T11:11:51.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.115+0000 7fde417fa640 1 -- 172.21.15.118:0/536744670 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fde3c03eae0 con 0x7fde44142f70 2024-02-18T11:11:51.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.116+0000 7fde417fa640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fde2806bc70 0x7fde2806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:51.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.116+0000 7fde417fa640 1 -- 172.21.15.118:0/536744670 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fde3c0ad660 con 0x7fde44142f70 2024-02-18T11:11:51.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.116+0000 7fde4895e640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fde2806bc70 0x7fde2806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:51.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.116+0000 7fde4895e640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fde2806bc70 0x7fde2806e130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fde38001730 tx=0x7fde38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:51.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.120+0000 7fde417fa640 1 -- 172.21.15.118:0/536744670 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde3c078140 con 0x7fde44142f70 2024-02-18T11:11:51.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.357+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7fde440b74e0 con 0x7fde44142f70 2024-02-18T11:11:51.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.605+0000 7fde417fa640 1 -- 172.21.15.118:0/536744670 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v2183) v1 ==== 163+0+0 (secure 0 0 0) 0x7fde3c07b800 con 0x7fde44142f70 2024-02-18T11:11:51.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fde2806bc70 msgr2=0x7fde2806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:51.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fde2806bc70 0x7fde2806e130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fde38001730 tx=0x7fde38009040 comp rx=0 tx=0).stop 2024-02-18T11:11:51.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde44142f70 msgr2=0x7fde440b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:51.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde44142f70 0x7fde440b56b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009e50 tx=0x7fde3c004a40 comp rx=0 tx=0).stop 2024-02-18T11:11:51.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 shutdown_connections 2024-02-18T11:11:51.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fde2806bc70 0x7fde2806e130 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde44142f70 0x7fde440b56b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fde440b9f30 0x7fde440b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 --2- 172.21.15.118:0/536744670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fde440b5240 0x7fde44072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:51.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 >> 172.21.15.118:0/536744670 conn(0x7fde4406bcf0 msgr2=0x7fde440b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:51.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 shutdown_connections 2024-02-18T11:11:51.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:51.607+0000 7fde4abc2640 1 -- 172.21.15.118:0/536744670 wait complete. 2024-02-18T11:11:51.633 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... FAIL 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner: 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa/tasks/cephfs/test_fscrypt.py", line 59, in test_fscrypt_dummy_encryption_with_quick_group 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner: 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner:Ran 1 test in 4237.572s 2024-02-18T11:11:51.634 INFO:tasks.cephfs_test_runner: 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner: 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa/tasks/cephfs/test_fscrypt.py", line 59, in test_fscrypt_dummy_encryption_with_quick_group 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2024-02-18T11:11:51.635 INFO:tasks.cephfs_test_runner: 2024-02-18T11:11:51.635 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-18T11:11:51.927 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fe1a25b6364d4f77915a6b0ec49446ab Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1c920afa8316ea21877f3186850254947531ea22/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-02-18T11:11:51.928 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-02-18T11:11:51.938 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-18T11:11:51.948 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-18T11:11:51.948 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-02-18T11:11:51.948 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-18T11:11:52.006 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053815,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498784k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249388k,nr_inodes=812347,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498784k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-18T11:11:52.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:52.006 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2024-02-18T11:11:52.172 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-18T11:11:52.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:52.174 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-18T11:11:52.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-18T11:11:52.275 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2024-02-18T11:11:52.389 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-18T11:11:52.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-18T11:11:52.398 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T11:11:52.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.497+0000 7f158aa5b640 1 Processor -- start 2024-02-18T11:11:52.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.497+0000 7f158aa5b640 1 -- start start 2024-02-18T11:11:52.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f158aa5b640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f158406bbe0 0x7f1584149300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f158aa5b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15840bd2b0 0x7f158414bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f158aa5b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15840b4e10 con 0x7f1584149840 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f158aa5b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840bdc20 con 0x7f15840bd2b0 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f158aa5b640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15840bc5c0 con 0x7f158406bbe0 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f15837fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15840bd2b0 0x7f158414bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f15837fe640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15840bd2b0 0x7f158414bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35884/0 (socket says 172.21.15.118:35884) 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f15837fe640 1 -- 172.21.15.118:0/2999873423 learned_addr learned my addr 172.21.15.118:0/2999873423 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f1583fff640 1 --2- 172.21.15.118:0/2999873423 >> v2:172.21.15.164:3300/0 conn(0x7f158406bbe0 0x7f1584149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f15837fe640 1 -- 172.21.15.118:0/2999873423 >> v2:172.21.15.164:3300/0 conn(0x7f158406bbe0 msgr2=0x7f1584149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:52.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f15837fe640 1 --2- 172.21.15.118:0/2999873423 >> v2:172.21.15.164:3300/0 conn(0x7f158406bbe0 0x7f1584149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f15837fe640 1 -- 172.21.15.118:0/2999873423 >> v1:172.21.15.164:6789/0 conn(0x7f1584149840 legacy=0x7f158414f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.498+0000 7f15837fe640 1 -- 172.21.15.118:0/2999873423 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840b4b50 con 0x7f15840bd2b0 2024-02-18T11:11:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.499+0000 7f15837fe640 1 --2- 172.21.15.118:0/2999873423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15840bd2b0 0x7f158414bfd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f15840740b0 tx=0x7f157402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7546e2f52ca2fc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.499+0000 7f1582ffd640 1 -- 172.21.15.118:0/2999873423 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15740317e0 con 0x7f15840bd2b0 2024-02-18T11:11:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.499+0000 7f1582ffd640 1 -- 172.21.15.118:0/2999873423 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1574031940 con 0x7f15840bd2b0 2024-02-18T11:11:52.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.499+0000 7f1582ffd640 1 -- 172.21.15.118:0/2999873423 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1574031cd0 con 0x7f15840bd2b0 2024-02-18T11:11:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 -- 172.21.15.118:0/2999873423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15840bd2b0 msgr2=0x7f158414bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 --2- 172.21.15.118:0/2999873423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15840bd2b0 0x7f158414bfd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f15840740b0 tx=0x7f157402b880 comp rx=0 tx=0).stop 2024-02-18T11:11:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 -- 172.21.15.118:0/2999873423 shutdown_connections 2024-02-18T11:11:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 --2- 172.21.15.118:0/2999873423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15840bd2b0 0x7f158414bfd0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 --2- 172.21.15.118:0/2999873423 >> v2:172.21.15.164:3300/0 conn(0x7f158406bbe0 0x7f1584149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 -- 172.21.15.118:0/2999873423 >> 172.21.15.118:0/2999873423 conn(0x7f15840c18e0 msgr2=0x7f15840c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 -- 172.21.15.118:0/2999873423 shutdown_connections 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.500+0000 7f158aa5b640 1 -- 172.21.15.118:0/2999873423 wait complete. 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.501+0000 7f158aa5b640 1 Processor -- start 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.501+0000 7f158aa5b640 1 -- start start 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f158aa5b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f158406bbe0 0x7f15840b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f158aa5b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15840bd2b0 0x7f15840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f158aa5b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1584149840 0x7f158414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f158aa5b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158414ebe0 con 0x7f1584149840 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f158aa5b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15841e2180 con 0x7f15840bd2b0 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f158aa5b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15841e2460 con 0x7f158406bbe0 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1584149840 0x7f158414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1584149840 0x7f158414ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35896/0 (socket says 172.21.15.118:35896) 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 -- 172.21.15.118:0/136185331 learned_addr learned my addr 172.21.15.118:0/136185331 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f15837fe640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15840bd2b0 0x7f15840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1583fff640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f158406bbe0 0x7f15840b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 -- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f158406bbe0 msgr2=0x7f15840b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f158406bbe0 0x7f15840b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 -- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15840bd2b0 msgr2=0x7f15840a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15840bd2b0 0x7f15840a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 -- 172.21.15.118:0/136185331 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740094d0 con 0x7f1584149840 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1588ff8640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1584149840 0x7f158414ef90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f157c00b990 tx=0x7f157c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1580ff9640 1 -- 172.21.15.118:0/136185331 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c00cba0 con 0x7f1584149840 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f1580ff9640 1 -- 172.21.15.118:0/136185331 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00cd00 con 0x7f1584149840 2024-02-18T11:11:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.502+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15841e2740 con 0x7f1584149840 2024-02-18T11:11:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.503+0000 7f1580ff9640 1 -- 172.21.15.118:0/136185331 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c014680 con 0x7f1584149840 2024-02-18T11:11:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.503+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15840b8e90 con 0x7f1584149840 2024-02-18T11:11:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.504+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15841e2980 con 0x7f1584149840 2024-02-18T11:11:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.504+0000 7f1580ff9640 1 -- 172.21.15.118:0/136185331 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f157c0147e0 con 0x7f1584149840 2024-02-18T11:11:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.504+0000 7f1580ff9640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f157006bc70 0x7f157006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.505+0000 7f1583fff640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f157006bc70 0x7f157006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.505+0000 7f1580ff9640 1 -- 172.21.15.118:0/136185331 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f157c08a430 con 0x7f1584149840 2024-02-18T11:11:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.505+0000 7f1583fff640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f157006bc70 0x7f157006e130 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f157800a970 tx=0x7f1578008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:52.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.509+0000 7f1580ff9640 1 -- 172.21.15.118:0/136185331 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f15841e2980 con 0x7f1584149840 2024-02-18T11:11:52.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.680+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15841e22f0 con 0x7f157006bc70 2024-02-18T11:11:52.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.681+0000 7f1580ff9640 1 -- 172.21.15.118:0/136185331 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13595 (secure 0 0 0) 0x7f15841e22f0 con 0x7f157006bc70 2024-02-18T11:11:52.682 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:52.683 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T11:11:52.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f157006bc70 msgr2=0x7f157006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f157006bc70 0x7f157006e130 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f157800a970 tx=0x7f1578008040 comp rx=0 tx=0).stop 2024-02-18T11:11:52.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1584149840 msgr2=0x7f158414ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1584149840 0x7f158414ef90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f157c00b990 tx=0x7f157c00be50 comp rx=0 tx=0).stop 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 shutdown_connections 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f157006bc70 0x7f157006e130 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1584149840 0x7f158414ef90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f15840bd2b0 0x7f15840a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 --2- 172.21.15.118:0/136185331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f158406bbe0 0x7f15840b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 >> 172.21.15.118:0/136185331 conn(0x7f15840c18e0 msgr2=0x7f158414a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 shutdown_connections 2024-02-18T11:11:52.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.683+0000 7f158aa5b640 1 -- 172.21.15.118:0/136185331 wait complete. 2024-02-18T11:11:52.695 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":2162,"stamp":"2024-02-18T11:11:52.453975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":10140552,"kb_used_data":723308,"kb_used_omap":12,"kb_used_meta":9400691,"kb_avail":744834168,"statfs":{"total":773094113280,"available":762710188032,"internally_reserved":0,"allocated":740667392,"data_stored":738800757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":9626308144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":85,"apply_latency_ms":85,"commit_latency_ns":85000000,"apply_latency_ns":85000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-803634110,"num_objects":-1485,"num_object_clones":0,"num_object_copies":-2970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1485,"num_whiteouts":0,"num_read":-50765,"num_read_kb":-54618151,"num_write":-1441902,"num_write_kb":-59935093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001068"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-18T11:09:02.626424+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T11:09:02.626424+0000","last_peered":"2024-02-18T11:09:02.626424+0000","last_clean":"2024-02-18T11:09:02.626424+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T11:09:02.626424+0000","last_undegraded":"2024-02-18T11:09:02.626424+0000","last_fullsized":"2024-02-18T11:09:02.626424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575702,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425944,"kb_used_data":149008,"kb_used_omap":1,"kb_used_meta":1276926,"kb_avail":92945896,"statfs":{"total":96636764160,"available":95176597504,"internally_reserved":0,"allocated":152584192,"data_stored":152359811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1307572682},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":831852,"kb_used_data":74336,"kb_used_omap":1,"kb_used_meta":757502,"kb_avail":93539988,"statfs":{"total":96636764160,"available":95784947712,"internally_reserved":0,"allocated":76120064,"data_stored":75889056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":775682502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575703,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1567336,"kb_used_data":213920,"kb_used_omap":1,"kb_used_meta":1353406,"kb_avail":92804504,"statfs":{"total":96636764160,"available":95031812096,"internally_reserved":0,"allocated":219054080,"data_stored":218832140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1385888197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575704,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1367820,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1367422,"kb_avail":93004020,"statfs":{"total":96636764160,"available":95236116480,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1400240581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1434512,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1434110,"kb_avail":92937328,"statfs":{"total":96636764160,"available":95167823872,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1468529095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575705,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":992272,"kb_used_data":162632,"kb_used_omap":1,"kb_used_meta":829630,"kb_avail":93379568,"statfs":{"total":96636764160,"available":95620677632,"internally_reserved":0,"allocated":166535168,"data_stored":166316722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":849541573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575705,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1694368,"kb_used_data":121680,"kb_used_omap":1,"kb_used_meta":1556222,"kb_avail":92677472,"statfs":{"total":96636764160,"available":94901731328,"internally_reserved":0,"allocated":124600320,"data_stored":124358493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1593571781},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575706,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":826448,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":825470,"kb_avail":93545392,"statfs":{"total":96636764160,"available":95790481408,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":845281733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T11:11:52.696 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T11:11:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.798+0000 7f73195bc640 1 Processor -- start 2024-02-18T11:11:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.798+0000 7f73195bc640 1 -- start start 2024-02-18T11:11:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73195bc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 0x7f73140bf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73195bc640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731414be60 con 0x7f73140bd240 2024-02-18T11:11:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73195bc640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731414c140 con 0x7f731406bc20 2024-02-18T11:11:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73195bc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140bdbb0 con 0x7f731414c940 2024-02-18T11:11:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73127fc640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f73140bd240 0x7f73141545e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47114/0 (socket says 172.21.15.118:47114) 2024-02-18T11:11:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73127fc640 1 -- 172.21.15.118:0/1680897116 learned_addr learned my addr 172.21.15.118:0/1680897116 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:52.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73137fe640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 0x7f73140bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859380957 0 0) 0x7f731414be60 con 0x7f73140bd240 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72fc003520 con 0x7f73140bd240 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2704688332 0 0) 0x7f72fc003520 con 0x7f73140bd240 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 msgr2=0x7f73140bf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 0x7f73140bf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 >> v1:172.21.15.164:6789/0 conn(0x7f731406bc20 legacy=0x7f73140bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731414c420 con 0x7f73140bd240 2024-02-18T11:11:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f7304001670 con 0x7f73140bd240 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 >> v1:172.21.15.118:6789/0 conn(0x7f73140bd240 legacy=0x7f73141545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72fc0039a0 0x7f72fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0047c0 0x7f72fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 0x7f72fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140bdbb0 con 0x7f72fc0039a0 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc00bae0 con 0x7f72fc0047c0 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc00bca0 con 0x7f731414c940 2024-02-18T11:11:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f7312ffd640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72fc0039a0 0x7f72fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73127fc640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0047c0 0x7f72fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.799+0000 7f73137fe640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 0x7f72fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7312ffd640 1 -- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 msgr2=0x7f72fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7312ffd640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f731414c940 0x7f72fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7312ffd640 1 -- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0047c0 msgr2=0x7f72fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7312ffd640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f72fc0047c0 0x7f72fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7312ffd640 1 -- 172.21.15.118:0/1680897116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc003520 con 0x7f72fc0039a0 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7312ffd640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72fc0039a0 0x7f72fc003dc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7308001750 tx=0x7f72fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd562d0b73f94af0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080052d0 con 0x7f72fc0039a0 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730802e050 con 0x7f72fc0039a0 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.800+0000 7f7311ffb640 1 -- 172.21.15.118:0/1680897116 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080035f0 con 0x7f72fc0039a0 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.801+0000 7f73195bc640 1 -- 172.21.15.118:0/1680897116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72fc0039a0 msgr2=0x7f72fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.801+0000 7f73195bc640 1 --2- 172.21.15.118:0/1680897116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72fc0039a0 0x7f72fc003dc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7308001750 tx=0x7f72fc0057f0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.801+0000 7f73137fe640 1 -- 172.21.15.118:0/1680897116 reap_dead start 2024-02-18T11:11:52.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.801+0000 7f73195bc640 1 -- 172.21.15.118:0/1680897116 shutdown_connections 2024-02-18T11:11:52.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.801+0000 7f73195bc640 1 -- 172.21.15.118:0/1680897116 >> 172.21.15.118:0/1680897116 conn(0x7f73140c1850 msgr2=0x7f73140c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:52.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.801+0000 7f73195bc640 1 -- 172.21.15.118:0/1680897116 shutdown_connections 2024-02-18T11:11:52.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.801+0000 7f73195bc640 1 -- 172.21.15.118:0/1680897116 wait complete. 2024-02-18T11:11:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.803+0000 7f73195bc640 1 Processor -- start 2024-02-18T11:11:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.803+0000 7f73195bc640 1 -- start start 2024-02-18T11:11:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc0039a0 0x7f73141e2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7314142170 0x7f73141442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7314144820 0x7f73141e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73141e1d40 con 0x7f7314142170 2024-02-18T11:11:52.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140bc880 con 0x7f7314144820 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7314142650 con 0x7f72fc0039a0 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7314142170 0x7f73141442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7314142170 0x7f73141442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35912/0 (socket says 172.21.15.118:35912) 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 -- 172.21.15.118:0/812286145 learned_addr learned my addr 172.21.15.118:0/812286145 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73137fe640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7314144820 0x7f73141e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f7312ffd640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc0039a0 0x7f73141e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 -- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc0039a0 msgr2=0x7f73141e2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc0039a0 0x7f73141e2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 -- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7314144820 msgr2=0x7f73141e52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7314144820 0x7f73141e52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 -- 172.21.15.118:0/812286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314142930 con 0x7f7314142170 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73137fe640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7314144820 0x7f73141e52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73127fc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7314142170 0x7f73141442e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7304001b40 tx=0x7f7304007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f72fb7fe640 1 -- 172.21.15.118:0/812286145 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304001610 con 0x7f7314142170 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f72fb7fe640 1 -- 172.21.15.118:0/812286145 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730400f940 con 0x7f7314142170 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73141e1fe0 con 0x7f7314142170 2024-02-18T11:11:52.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f72fb7fe640 1 -- 172.21.15.118:0/812286145 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400fcf0 con 0x7f7314142170 2024-02-18T11:11:52.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.804+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73140ba350 con 0x7f7314142170 2024-02-18T11:11:52.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.806+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7314142b20 con 0x7f7314142170 2024-02-18T11:11:52.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.806+0000 7f72fb7fe640 1 -- 172.21.15.118:0/812286145 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f730401d460 con 0x7f7314142170 2024-02-18T11:11:52.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.806+0000 7f72fb7fe640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f730006bc70 0x7f730006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:52.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.807+0000 7f7312ffd640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f730006bc70 0x7f730006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:52.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.807+0000 7f72fb7fe640 1 -- 172.21.15.118:0/812286145 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f730408a550 con 0x7f7314142170 2024-02-18T11:11:52.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.807+0000 7f7312ffd640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f730006bc70 0x7f730006e130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7308033000 tx=0x7f7308009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:52.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.811+0000 7f72fb7fe640 1 -- 172.21.15.118:0/812286145 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7304055030 con 0x7f7314142170 2024-02-18T11:11:52.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.982+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f731406c000 con 0x7f730006bc70 2024-02-18T11:11:52.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.983+0000 7f72fb7fe640 1 -- 172.21.15.118:0/812286145 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13595 (secure 0 0 0) 0x7f7308007a30 con 0x7f730006bc70 2024-02-18T11:11:52.984 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:52.984 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T11:11:52.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.984+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f730006bc70 msgr2=0x7f730006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.984+0000 7f73195bc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f730006bc70 0x7f730006e130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7308033000 tx=0x7f7308009030 comp rx=0 tx=0).stop 2024-02-18T11:11:52.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.984+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7314142170 msgr2=0x7f73141442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:52.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.984+0000 7f73195bc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7314142170 0x7f73141442e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7304001b40 tx=0x7f7304007720 comp rx=0 tx=0).stop 2024-02-18T11:11:52.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 shutdown_connections 2024-02-18T11:11:52.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f730006bc70 0x7f730006e130 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7314144820 0x7f73141e52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7314142170 0x7f73141442e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 --2- 172.21.15.118:0/812286145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f72fc0039a0 0x7f73141e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:52.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 >> 172.21.15.118:0/812286145 conn(0x7f73140c1850 msgr2=0x7f73140a17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:52.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 shutdown_connections 2024-02-18T11:11:52.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:52.985+0000 7f73195bc640 1 -- 172.21.15.118:0/812286145 wait complete. 2024-02-18T11:11:52.997 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":2162,"stamp":"2024-02-18T11:11:52.453975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":10140552,"kb_used_data":723308,"kb_used_omap":12,"kb_used_meta":9400691,"kb_avail":744834168,"statfs":{"total":773094113280,"available":762710188032,"internally_reserved":0,"allocated":740667392,"data_stored":738800757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":9626308144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":85,"apply_latency_ms":85,"commit_latency_ns":85000000,"apply_latency_ns":85000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-803634110,"num_objects":-1485,"num_object_clones":0,"num_object_copies":-2970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1485,"num_whiteouts":0,"num_read":-50765,"num_read_kb":-54618151,"num_write":-1441902,"num_write_kb":-59935093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001068"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-18T11:09:02.626424+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T11:09:02.626424+0000","last_peered":"2024-02-18T11:09:02.626424+0000","last_clean":"2024-02-18T11:09:02.626424+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T11:09:02.626424+0000","last_undegraded":"2024-02-18T11:09:02.626424+0000","last_fullsized":"2024-02-18T11:09:02.626424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575702,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425944,"kb_used_data":149008,"kb_used_omap":1,"kb_used_meta":1276926,"kb_avail":92945896,"statfs":{"total":96636764160,"available":95176597504,"internally_reserved":0,"allocated":152584192,"data_stored":152359811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1307572682},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":831852,"kb_used_data":74336,"kb_used_omap":1,"kb_used_meta":757502,"kb_avail":93539988,"statfs":{"total":96636764160,"available":95784947712,"internally_reserved":0,"allocated":76120064,"data_stored":75889056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":775682502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575703,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1567336,"kb_used_data":213920,"kb_used_omap":1,"kb_used_meta":1353406,"kb_avail":92804504,"statfs":{"total":96636764160,"available":95031812096,"internally_reserved":0,"allocated":219054080,"data_stored":218832140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1385888197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575704,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1367820,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1367422,"kb_avail":93004020,"statfs":{"total":96636764160,"available":95236116480,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1400240581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1434512,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1434110,"kb_avail":92937328,"statfs":{"total":96636764160,"available":95167823872,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1468529095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575705,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":992272,"kb_used_data":162632,"kb_used_omap":1,"kb_used_meta":829630,"kb_avail":93379568,"statfs":{"total":96636764160,"available":95620677632,"internally_reserved":0,"allocated":166535168,"data_stored":166316722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":849541573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575705,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1694368,"kb_used_data":121680,"kb_used_omap":1,"kb_used_meta":1556222,"kb_avail":92677472,"statfs":{"total":96636764160,"available":94901731328,"internally_reserved":0,"allocated":124600320,"data_stored":124358493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1593571781},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575706,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":826448,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":825470,"kb_avail":93545392,"statfs":{"total":96636764160,"available":95790481408,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":845281733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T11:11:52.997 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-18T11:11:52.998 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T11:11:53.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.096+0000 7ff78714b640 1 Processor -- start 2024-02-18T11:11:53.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.096+0000 7ff78714b640 1 -- start start 2024-02-18T11:11:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff78714b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7800ba1a0 0x7ff78006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff78714b640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780070fe0 con 0x7ff780071f80 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff78714b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff780072e50 con 0x7ff78006f0b0 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff78714b640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78006e0b0 con 0x7ff7800ba1a0 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff77ffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7800ba1a0 0x7ff78006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff77ffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff7800ba1a0 0x7ff78006eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35926/0 (socket says 172.21.15.118:35926) 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff77ffff640 1 -- 172.21.15.118:0/2002409192 learned_addr learned my addr 172.21.15.118:0/2002409192 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff77ffff640 1 -- 172.21.15.118:0/2002409192 >> v1:172.21.15.164:6789/0 conn(0x7ff78006f0b0 legacy=0x7ff780145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff77ffff640 1 -- 172.21.15.118:0/2002409192 >> v1:172.21.15.118:6789/0 conn(0x7ff780071f80 legacy=0x7ff780072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.097+0000 7ff77ffff640 1 -- 172.21.15.118:0/2002409192 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780071280 con 0x7ff7800ba1a0 2024-02-18T11:11:53.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff77ffff640 1 --2- 172.21.15.118:0/2002409192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7800ba1a0 0x7ff78006eb70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009870 tx=0x7ff76c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0332a627d93a8f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:53.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff77f7fe640 1 -- 172.21.15.118:0/2002409192 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c02f840 con 0x7ff7800ba1a0 2024-02-18T11:11:53.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff77f7fe640 1 -- 172.21.15.118:0/2002409192 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c02f9a0 con 0x7ff7800ba1a0 2024-02-18T11:11:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff77f7fe640 1 -- 172.21.15.118:0/2002409192 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c02fd30 con 0x7ff7800ba1a0 2024-02-18T11:11:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff78714b640 1 -- 172.21.15.118:0/2002409192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7800ba1a0 msgr2=0x7ff78006eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff78714b640 1 --2- 172.21.15.118:0/2002409192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7800ba1a0 0x7ff78006eb70 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009870 tx=0x7ff76c02ba20 comp rx=0 tx=0).stop 2024-02-18T11:11:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff78714b640 1 -- 172.21.15.118:0/2002409192 shutdown_connections 2024-02-18T11:11:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff78714b640 1 --2- 172.21.15.118:0/2002409192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff7800ba1a0 0x7ff78006eb70 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff78714b640 1 -- 172.21.15.118:0/2002409192 >> 172.21.15.118:0/2002409192 conn(0x7ff78006bcf0 msgr2=0x7ff78006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:53.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff78714b640 1 -- 172.21.15.118:0/2002409192 shutdown_connections 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.098+0000 7ff78714b640 1 -- 172.21.15.118:0/2002409192 wait complete. 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.099+0000 7ff78714b640 1 Processor -- start 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.099+0000 7ff78714b640 1 -- start start 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff78714b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff78006f0b0 0x7ff780149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff78714b640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff780071f80 0x7ff7801e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff78714b640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7800ba1a0 0x7ff7801e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff78714b640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801e5690 con 0x7ff78006f0b0 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff78714b640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801e5970 con 0x7ff780071f80 2024-02-18T11:11:53.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff78714b640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7801e5c50 con 0x7ff7800ba1a0 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff784ee7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff78006f0b0 0x7ff780149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff784ee7640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff78006f0b0 0x7ff780149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35938/0 (socket says 172.21.15.118:35938) 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.100+0000 7ff784ee7640 1 -- 172.21.15.118:0/378484349 learned_addr learned my addr 172.21.15.118:0/378484349 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff7856e8640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7800ba1a0 0x7ff7801e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff77ffff640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff780071f80 0x7ff7801e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff784ee7640 1 -- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7800ba1a0 msgr2=0x7ff7801e23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff784ee7640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7800ba1a0 0x7ff7801e23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff784ee7640 1 -- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff780071f80 msgr2=0x7ff7801e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff784ee7640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff780071f80 0x7ff7801e1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff784ee7640 1 -- 172.21.15.118:0/378484349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0094d0 con 0x7ff78006f0b0 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff784ee7640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff78006f0b0 0x7ff780149e40 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff77400c450 tx=0x7ff77400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff77d7fa640 1 -- 172.21.15.118:0/378484349 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740052d0 con 0x7ff78006f0b0 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff77d7fa640 1 -- 172.21.15.118:0/378484349 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774005430 con 0x7ff78006f0b0 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff77d7fa640 1 -- 172.21.15.118:0/378484349 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774012870 con 0x7ff78006f0b0 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7801e5f30 con 0x7ff78006f0b0 2024-02-18T11:11:53.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.101+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7801e5290 con 0x7ff78006f0b0 2024-02-18T11:11:53.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.102+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7801e6120 con 0x7ff78006f0b0 2024-02-18T11:11:53.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.102+0000 7ff77d7fa640 1 -- 172.21.15.118:0/378484349 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7ff7740129d0 con 0x7ff78006f0b0 2024-02-18T11:11:53.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.103+0000 7ff77d7fa640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff76406bc70 0x7ff76406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.103+0000 7ff77d7fa640 1 -- 172.21.15.118:0/378484349 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff774089f70 con 0x7ff78006f0b0 2024-02-18T11:11:53.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.103+0000 7ff77ffff640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff76406bc70 0x7ff76406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.103+0000 7ff77ffff640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff76406bc70 0x7ff76406e130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff76c036000 tx=0x7ff76c039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:53.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.107+0000 7ff77d7fa640 1 -- 172.21.15.118:0/378484349 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7740bd8c0 con 0x7ff78006f0b0 2024-02-18T11:11:53.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.278+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7801e5480 con 0x7ff76406bc70 2024-02-18T11:11:53.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.279+0000 7ff77d7fa640 1 -- 172.21.15.118:0/378484349 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13595 (secure 0 0 0) 0x7ff7801e5480 con 0x7ff76406bc70 2024-02-18T11:11:53.280 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:53.280 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T11:11:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff76406bc70 msgr2=0x7ff76406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff76406bc70 0x7ff76406e130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff76c036000 tx=0x7ff76c039040 comp rx=0 tx=0).stop 2024-02-18T11:11:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff78006f0b0 msgr2=0x7ff780149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff78006f0b0 0x7ff780149e40 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff77400c450 tx=0x7ff77400c910 comp rx=0 tx=0).stop 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 shutdown_connections 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7ff76406bc70 0x7ff76406e130 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7800ba1a0 0x7ff7801e23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff780071f80 0x7ff7801e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 --2- 172.21.15.118:0/378484349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff78006f0b0 0x7ff780149e40 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 >> 172.21.15.118:0/378484349 conn(0x7ff78006bcf0 msgr2=0x7ff7800724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 shutdown_connections 2024-02-18T11:11:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.281+0000 7ff78714b640 1 -- 172.21.15.118:0/378484349 wait complete. 2024-02-18T11:11:53.293 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":2162,"stamp":"2024-02-18T11:11:52.453975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":10140552,"kb_used_data":723308,"kb_used_omap":12,"kb_used_meta":9400691,"kb_avail":744834168,"statfs":{"total":773094113280,"available":762710188032,"internally_reserved":0,"allocated":740667392,"data_stored":738800757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":9626308144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":85,"apply_latency_ms":85,"commit_latency_ns":85000000,"apply_latency_ns":85000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-803634110,"num_objects":-1485,"num_object_clones":0,"num_object_copies":-2970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1485,"num_whiteouts":0,"num_read":-50765,"num_read_kb":-54618151,"num_write":-1441902,"num_write_kb":-59935093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001068"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-18T11:09:02.626424+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T11:09:02.626424+0000","last_peered":"2024-02-18T11:09:02.626424+0000","last_clean":"2024-02-18T11:09:02.626424+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T11:09:02.626424+0000","last_undegraded":"2024-02-18T11:09:02.626424+0000","last_fullsized":"2024-02-18T11:09:02.626424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575702,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425944,"kb_used_data":149008,"kb_used_omap":1,"kb_used_meta":1276926,"kb_avail":92945896,"statfs":{"total":96636764160,"available":95176597504,"internally_reserved":0,"allocated":152584192,"data_stored":152359811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1307572682},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":831852,"kb_used_data":74336,"kb_used_omap":1,"kb_used_meta":757502,"kb_avail":93539988,"statfs":{"total":96636764160,"available":95784947712,"internally_reserved":0,"allocated":76120064,"data_stored":75889056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":775682502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575703,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1567336,"kb_used_data":213920,"kb_used_omap":1,"kb_used_meta":1353406,"kb_avail":92804504,"statfs":{"total":96636764160,"available":95031812096,"internally_reserved":0,"allocated":219054080,"data_stored":218832140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1385888197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575704,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1367820,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1367422,"kb_avail":93004020,"statfs":{"total":96636764160,"available":95236116480,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1400240581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1434512,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1434110,"kb_avail":92937328,"statfs":{"total":96636764160,"available":95167823872,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1468529095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575705,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":992272,"kb_used_data":162632,"kb_used_omap":1,"kb_used_meta":829630,"kb_avail":93379568,"statfs":{"total":96636764160,"available":95620677632,"internally_reserved":0,"allocated":166535168,"data_stored":166316722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":849541573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575705,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1694368,"kb_used_data":121680,"kb_used_omap":1,"kb_used_meta":1556222,"kb_avail":92677472,"statfs":{"total":96636764160,"available":94901731328,"internally_reserved":0,"allocated":124600320,"data_stored":124358493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1593571781},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575706,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":826448,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":825470,"kb_avail":93545392,"statfs":{"total":96636764160,"available":95790481408,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":845281733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T11:11:53.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-18T11:11:53.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.393+0000 7f9ab74d4640 1 Processor -- start 2024-02-18T11:11:53.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.393+0000 7f9ab74d4640 1 -- start start 2024-02-18T11:11:53.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab74d4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9ab0071f80 0x7f9ab0072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab74d4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab00ba1a0 0x7f9ab006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab74d4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab0072bd0 con 0x7f9ab006f0b0 2024-02-18T11:11:53.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab74d4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab006e0b0 con 0x7f9ab0071f80 2024-02-18T11:11:53.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab74d4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0070fe0 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab5a71640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9ab006f0b0 0x7f9ab0145c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47118/0 (socket says 172.21.15.118:47118) 2024-02-18T11:11:53.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab5a71640 1 -- 172.21.15.118:0/3783644227 learned_addr learned my addr 172.21.15.118:0/3783644227 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:53.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab4a6f640 1 --2- 172.21.15.118:0/3783644227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab00ba1a0 0x7f9ab006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab5270640 1 --2- 172.21.15.118:0/3783644227 >> v2:172.21.15.164:3300/0 conn(0x7f9ab0071f80 0x7f9ab0072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9aa7fff640 1 -- 172.21.15.118:0/3783644227 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639053018 0 0) 0x7f9ab0072bd0 con 0x7f9ab006f0b0 2024-02-18T11:11:53.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9aa7fff640 1 -- 172.21.15.118:0/3783644227 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c003520 con 0x7f9ab006f0b0 2024-02-18T11:11:53.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab4a6f640 1 -- 172.21.15.118:0/3783644227 >> v2:172.21.15.164:3300/0 conn(0x7f9ab0071f80 msgr2=0x7f9ab0072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:53.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab4a6f640 1 --2- 172.21.15.118:0/3783644227 >> v2:172.21.15.164:3300/0 conn(0x7f9ab0071f80 0x7f9ab0072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9aa7fff640 1 -- 172.21.15.118:0/3783644227 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 400786993 0 0) 0x7f9a9c003520 con 0x7f9ab006f0b0 2024-02-18T11:11:53.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab4a6f640 1 -- 172.21.15.118:0/3783644227 >> v1:172.21.15.118:6789/0 conn(0x7f9ab006f0b0 legacy=0x7f9ab0145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab4a6f640 1 -- 172.21.15.118:0/3783644227 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0072e50 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.394+0000 7f9ab5270640 1 --2- 172.21.15.118:0/3783644227 >> v2:172.21.15.164:3300/0 conn(0x7f9ab0071f80 0x7f9ab0072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T11:11:53.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.395+0000 7f9ab4a6f640 1 --2- 172.21.15.118:0/3783644227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab00ba1a0 0x7f9ab006eb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0097a0 tx=0x7f9aac02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ade77491b5b8226 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:53.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.395+0000 7f9aa7fff640 1 -- 172.21.15.118:0/3783644227 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac02f050 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.395+0000 7f9aa7fff640 1 -- 172.21.15.118:0/3783644227 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac031500 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.395+0000 7f9aa7fff640 1 -- 172.21.15.118:0/3783644227 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80019f0 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 -- 172.21.15.118:0/3783644227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab00ba1a0 msgr2=0x7f9ab006eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/3783644227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab00ba1a0 0x7f9ab006eb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0097a0 tx=0x7f9aac02b820 comp rx=0 tx=0).stop 2024-02-18T11:11:53.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 -- 172.21.15.118:0/3783644227 shutdown_connections 2024-02-18T11:11:53.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/3783644227 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab00ba1a0 0x7f9ab006eb70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/3783644227 >> v2:172.21.15.164:3300/0 conn(0x7f9ab0071f80 0x7f9ab0072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 -- 172.21.15.118:0/3783644227 >> 172.21.15.118:0/3783644227 conn(0x7f9ab006bcf0 msgr2=0x7f9ab006c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 -- 172.21.15.118:0/3783644227 shutdown_connections 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.396+0000 7f9ab74d4640 1 -- 172.21.15.118:0/3783644227 wait complete. 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.397+0000 7f9ab74d4640 1 Processor -- start 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.397+0000 7f9ab74d4640 1 -- start start 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ab006f0b0 0x7f9ab009ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab0071f80 0x7f9ab00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab00ba1a0 0x7f9ab009f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab009f130 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00b6170 con 0x7f9ab006f0b0 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab01e2120 con 0x7f9ab0071f80 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab00ba1a0 0x7f9ab009f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab00ba1a0 0x7f9ab009f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35946/0 (socket says 172.21.15.118:35946) 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 -- 172.21.15.118:0/1888996649 learned_addr learned my addr 172.21.15.118:0/1888996649 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5270640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ab006f0b0 0x7f9ab009ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab4a6f640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab0071f80 0x7f9ab00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 -- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab0071f80 msgr2=0x7f9ab00b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab0071f80 0x7f9ab00b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 -- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ab006f0b0 msgr2=0x7f9ab009ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ab006f0b0 0x7f9ab009ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 -- 172.21.15.118:0/1888996649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0009400 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5270640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ab006f0b0 0x7f9ab009ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab5a71640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab00ba1a0 0x7f9ab009f9c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8001830 tx=0x7f9aa800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9aa5ffb640 1 -- 172.21.15.118:0/1888996649 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8012400 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9aa5ffb640 1 -- 172.21.15.118:0/1888996649 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8012560 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac009400 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9aa5ffb640 1 -- 172.21.15.118:0/1888996649 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8012910 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.398+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab01e26e0 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.399+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab0067f40 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.400+0000 7f9aa5ffb640 1 -- 172.21.15.118:0/1888996649 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f9aa8012a70 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.400+0000 7f9aa5ffb640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a9406bc70 0x7f9a9406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.400+0000 7f9aa5ffb640 1 -- 172.21.15.118:0/1888996649 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9aa808acc0 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.400+0000 7f9ab5270640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a9406bc70 0x7f9a9406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:53.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.401+0000 7f9ab5270640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a9406bc70 0x7f9a9406e130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009d20 tx=0x7f9aa0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:53.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.405+0000 7f9aa5ffb640 1 -- 172.21.15.118:0/1888996649 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9aa8055720 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.579+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ab0074af0 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.580+0000 7f9aa5ffb640 1 -- 172.21.15.118:0/1888996649 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13046 (secure 0 0 0) 0x7f9aa8058de0 con 0x7f9ab00ba1a0 2024-02-18T11:11:53.581 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:53.581 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":34,"fsid":"96fc967a-d47f-4a89-a97a-6d7920f41e97","created":"2024-02-18T10:00:31.154069+0000","modified":"2024-02-18T11:11:50.599663+0000","last_up_change":"2024-02-18T10:00:41.464642+0000","last_in_change":"2024-02-18T10:00:33.325587+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-18T10:00:43.319694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1037ff2-f634-40ec-b542-0cf47fac647c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6809","nonce":2287683675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6811","nonce":2287683675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6815","nonce":2287683675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":2287683675},{"type":"v1","addr":"172.21.15.118:6813","nonce":2287683675}]},"public_addr":"172.21.15.118:6809/2287683675","cluster_addr":"172.21.15.118:6811/2287683675","heartbeat_back_addr":"172.21.15.118:6815/2287683675","heartbeat_front_addr":"172.21.15.118:6813/2287683675","state":["exists","up"]},{"osd":1,"uuid":"9411247d-c4cb-4f99-a9cc-a10cabe38c6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6818","nonce":2284297691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6823","nonce":2284297691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6829","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6831","nonce":2284297691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":2284297691},{"type":"v1","addr":"172.21.15.118:6827","nonce":2284297691}]},"public_addr":"172.21.15.118:6818/2284297691","cluster_addr":"172.21.15.118:6823/2284297691","heartbeat_back_addr":"172.21.15.118:6831/2284297691","heartbeat_front_addr":"172.21.15.118:6827/2284297691","state":["exists","up"]},{"osd":2,"uuid":"5d278b57-76cc-404b-aa94-6b9a71ea914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6819","nonce":1225011872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6822","nonce":1225011872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6830","nonce":1225011872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":1225011872},{"type":"v1","addr":"172.21.15.118:6826","nonce":1225011872}]},"public_addr":"172.21.15.118:6819/1225011872","cluster_addr":"172.21.15.118:6822/1225011872","heartbeat_back_addr":"172.21.15.118:6830/1225011872","heartbeat_front_addr":"172.21.15.118:6826/1225011872","state":["exists","up"]},{"osd":3,"uuid":"c63e7360-facb-478a-9de2-f80aa16f8d28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6801","nonce":28144523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6803","nonce":28144523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6807","nonce":28144523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":28144523},{"type":"v1","addr":"172.21.15.118:6805","nonce":28144523}]},"public_addr":"172.21.15.118:6801/28144523","cluster_addr":"172.21.15.118:6803/28144523","heartbeat_back_addr":"172.21.15.118:6807/28144523","heartbeat_front_addr":"172.21.15.118:6805/28144523","state":["exists","up"]},{"osd":4,"uuid":"5bc769c9-e741-4ec2-b5d2-9f8f46eb7e66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6804","nonce":748502063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6808","nonce":748502063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6815","nonce":748502063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":748502063},{"type":"v1","addr":"172.21.15.164:6812","nonce":748502063}]},"public_addr":"172.21.15.164:6804/748502063","cluster_addr":"172.21.15.164:6808/748502063","heartbeat_back_addr":"172.21.15.164:6815/748502063","heartbeat_front_addr":"172.21.15.164:6812/748502063","state":["exists","up"]},{"osd":5,"uuid":"c876ac02-f509-4d3b-998a-9a12446b2082","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6801","nonce":2574652314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6805","nonce":2574652314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6813","nonce":2574652314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":2574652314},{"type":"v1","addr":"172.21.15.164:6809","nonce":2574652314}]},"public_addr":"172.21.15.164:6801/2574652314","cluster_addr":"172.21.15.164:6805/2574652314","heartbeat_back_addr":"172.21.15.164:6813/2574652314","heartbeat_front_addr":"172.21.15.164:6809/2574652314","state":["exists","up"]},{"osd":6,"uuid":"515631d7-2cc4-4dd0-9181-6f0c82f76121","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6817","nonce":3123231040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6819","nonce":3123231040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6823","nonce":3123231040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3123231040},{"type":"v1","addr":"172.21.15.164:6821","nonce":3123231040}]},"public_addr":"172.21.15.164:6817/3123231040","cluster_addr":"172.21.15.164:6819/3123231040","heartbeat_back_addr":"172.21.15.164:6823/3123231040","heartbeat_front_addr":"172.21.15.164:6821/3123231040","state":["exists","up"]},{"osd":7,"uuid":"234bf955-4743-4aaa-b275-aac0db07376f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6825","nonce":3262371118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6827","nonce":3262371118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6831","nonce":3262371118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3262371118},{"type":"v1","addr":"172.21.15.164:6829","nonce":3262371118}]},"public_addr":"172.21.15.164:6825/3262371118","cluster_addr":"172.21.15.164:6827/3262371118","heartbeat_back_addr":"172.21.15.164:6831/3262371118","heartbeat_front_addr":"172.21.15.164:6829/3262371118","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.516084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.427362+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.473276+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.423134+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.433580+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.410163+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-18T10:00:38.476052+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.118:6837/2626574740":"2024-02-19T11:11:47.562670+0000","172.21.15.118:6835/2626574740":"2024-02-19T11:11:47.562670+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a9406bc70 msgr2=0x7f9a9406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a9406bc70 0x7f9a9406e130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009d20 tx=0x7f9aa0008040 comp rx=0 tx=0).stop 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab00ba1a0 msgr2=0x7f9ab009f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab00ba1a0 0x7f9ab009f9c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8001830 tx=0x7f9aa800a430 comp rx=0 tx=0).stop 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 shutdown_connections 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f9a9406bc70 0x7f9a9406e130 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ab00ba1a0 0x7f9ab009f9c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9ab0071f80 0x7f9ab00b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 --2- 172.21.15.118:0/1888996649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ab006f0b0 0x7f9ab009ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:53.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 >> 172.21.15.118:0/1888996649 conn(0x7f9ab006bcf0 msgr2=0x7f9ab00a1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:53.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 shutdown_connections 2024-02-18T11:11:53.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:53.582+0000 7f9ab74d4640 1 -- 172.21.15.118:0/1888996649 wait complete. 2024-02-18T11:11:54.595 INFO:tasks.ceph:Scrubbing osd.0 2024-02-18T11:11:54.596 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:54.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.701+0000 7efe2bf7a640 1 Processor -- start 2024-02-18T11:11:54.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.701+0000 7efe2bf7a640 1 -- start start 2024-02-18T11:11:54.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe2bf7a640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe240b5150 0x7efe240bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe2bf7a640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7efe24149110 0x7efe24149520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe2bf7a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2414bee0 con 0x7efe2414cb40 2024-02-18T11:11:54.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe2bf7a640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240ba640 con 0x7efe240b5150 2024-02-18T11:11:54.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe2bf7a640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240b9a20 con 0x7efe24149110 2024-02-18T11:11:54.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe29515640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe240b5150 0x7efe240bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe29515640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe240b5150 0x7efe240bb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35956/0 (socket says 172.21.15.118:35956) 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe29515640 1 -- 172.21.15.118:0/1954007794 learned_addr learned my addr 172.21.15.118:0/1954007794 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe29515640 1 -- 172.21.15.118:0/1954007794 >> v2:172.21.15.164:3300/0 conn(0x7efe24149110 msgr2=0x7efe24149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe2a517640 1 --2- 172.21.15.118:0/1954007794 >> v2:172.21.15.164:3300/0 conn(0x7efe24149110 0x7efe24149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe29515640 1 --2- 172.21.15.118:0/1954007794 >> v2:172.21.15.164:3300/0 conn(0x7efe24149110 0x7efe24149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe29515640 1 -- 172.21.15.118:0/1954007794 >> v1:172.21.15.164:6789/0 conn(0x7efe2414cb40 legacy=0x7efe240b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.702+0000 7efe29515640 1 -- 172.21.15.118:0/1954007794 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240b9460 con 0x7efe240b5150 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.703+0000 7efe29515640 1 --2- 172.21.15.118:0/1954007794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe240bb4c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7efe240bab80 tx=0x7efe2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e6ac5f14e3ce25 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.703+0000 7efe28d14640 1 -- 172.21.15.118:0/1954007794 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20031870 con 0x7efe240b5150 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.703+0000 7efe28d14640 1 -- 172.21.15.118:0/1954007794 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe200319d0 con 0x7efe240b5150 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.703+0000 7efe28d14640 1 -- 172.21.15.118:0/1954007794 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20031d60 con 0x7efe240b5150 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 -- 172.21.15.118:0/1954007794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 msgr2=0x7efe240bb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 --2- 172.21.15.118:0/1954007794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe240bb4c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7efe240bab80 tx=0x7efe2002b910 comp rx=0 tx=0).stop 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 -- 172.21.15.118:0/1954007794 shutdown_connections 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 --2- 172.21.15.118:0/1954007794 >> v2:172.21.15.164:3300/0 conn(0x7efe24149110 0x7efe24149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 --2- 172.21.15.118:0/1954007794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe240bb4c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 -- 172.21.15.118:0/1954007794 >> 172.21.15.118:0/1954007794 conn(0x7efe240bea10 msgr2=0x7efe240badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:54.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 -- 172.21.15.118:0/1954007794 shutdown_connections 2024-02-18T11:11:54.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.704+0000 7efe2bf7a640 1 -- 172.21.15.118:0/1954007794 wait complete. 2024-02-18T11:11:54.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 Processor -- start 2024-02-18T11:11:54.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 -- start start 2024-02-18T11:11:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe2406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe24149110 0x7efe240a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe2414cb40 0x7efe240a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe241483f0 con 0x7efe240b5150 2024-02-18T11:11:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe241471e0 con 0x7efe24149110 2024-02-18T11:11:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe2bf7a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe24148920 con 0x7efe2414cb40 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.705+0000 7efe29d16640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe2406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe2406bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35966/0 (socket says 172.21.15.118:35966) 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 -- 172.21.15.118:0/956312204 learned_addr learned my addr 172.21.15.118:0/956312204 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29515640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe24149110 0x7efe240a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe2a517640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe2414cb40 0x7efe240a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 -- 172.21.15.118:0/956312204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe2414cb40 msgr2=0x7efe240a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe2414cb40 0x7efe240a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 -- 172.21.15.118:0/956312204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe24149110 msgr2=0x7efe240a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe24149110 0x7efe240a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 -- 172.21.15.118:0/956312204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200094d0 con 0x7efe240b5150 2024-02-18T11:11:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29515640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe24149110 0x7efe240a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe29d16640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe2406bc70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efe1400b450 tx=0x7efe1400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14011890 con 0x7efe240b5150 2024-02-18T11:11:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe140119f0 con 0x7efe240b5150 2024-02-18T11:11:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe24148640 con 0x7efe240b5150 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14011da0 con 0x7efe240b5150 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.706+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2406abe0 con 0x7efe240b5150 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.707+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe240bad90 con 0x7efe240b5150 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7efe1401a400 con 0x7efe240b5150 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe1a7fc640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe0806bc70 0x7efe0806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe29515640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe0806bc70 0x7efe0806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efe1408ad60 con 0x7efe240b5150 2024-02-18T11:11:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe1a7fc640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7efe08071b30 0x7efe08073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 --> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe08074600 con 0x7efe08071b30 2024-02-18T11:11:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe1408b1b0 con 0x7efe240b5150 2024-02-18T11:11:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe2a517640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7efe08071b30 0x7efe08073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.708+0000 7efe29515640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe0806bc70 0x7efe0806e130 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efe20036000 tx=0x7efe2003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.709+0000 7efe2a517640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7efe08071b30 0x7efe08073f50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.709+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== osd.0 v2:172.21.15.118:6808/2287683675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efe08074600 con 0x7efe08071b30 2024-02-18T11:11:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.722+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 --> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efe24148bf0 con 0x7efe08071b30 2024-02-18T11:11:54.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.722+0000 7efe1a7fc640 1 -- 172.21.15.118:0/956312204 <== osd.0 v2:172.21.15.118:6808/2287683675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efe1c00e470 con 0x7efe08071b30 2024-02-18T11:11:54.724 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:54.724 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:54.725 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:54.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7efe08071b30 msgr2=0x7efe08073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6808/2287683675,v1:172.21.15.118:6809/2287683675] conn(0x7efe08071b30 0x7efe08073f50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe0806bc70 msgr2=0x7efe0806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe0806bc70 0x7efe0806e130 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efe20036000 tx=0x7efe2003c040 comp rx=0 tx=0).stop 2024-02-18T11:11:54.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 msgr2=0x7efe2406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 --2- 172.21.15.118:0/956312204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe240b5150 0x7efe2406bc70 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efe1400b450 tx=0x7efe1400b910 comp rx=0 tx=0).stop 2024-02-18T11:11:54.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2a517640 1 -- 172.21.15.118:0/956312204 reap_dead start 2024-02-18T11:11:54.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 shutdown_connections 2024-02-18T11:11:54.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 >> 172.21.15.118:0/956312204 conn(0x7efe240bea10 msgr2=0x7efe240baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:54.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 shutdown_connections 2024-02-18T11:11:54.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.723+0000 7efe2bf7a640 1 -- 172.21.15.118:0/956312204 wait complete. 2024-02-18T11:11:54.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-18T11:11:54.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.835+0000 7f3fe089d640 1 Processor -- start 2024-02-18T11:11:54.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.835+0000 7f3fe089d640 1 -- start start 2024-02-18T11:11:54.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fe089d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fdc06be60 0x7f3fdc09cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fe089d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3fdc0bc600 0x7f3fdc1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fe089d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc0b9fa0 con 0x7f3fdc149630 2024-02-18T11:11:54.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fe089d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc0b94e0 con 0x7f3fdc06be60 2024-02-18T11:11:54.840 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fe089d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc09d280 con 0x7f3fdc0bc600 2024-02-18T11:11:54.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fda59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fdc06be60 0x7f3fdc09cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fda59c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3fdc06be60 0x7f3fdc09cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35980/0 (socket says 172.21.15.118:35980) 2024-02-18T11:11:54.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.836+0000 7f3fda59c640 1 -- 172.21.15.118:0/1009613036 learned_addr learned my addr 172.21.15.118:0/1009613036 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:54.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fd9d9b640 1 --2- 172.21.15.118:0/1009613036 >> v2:172.21.15.164:3300/0 conn(0x7f3fdc0bc600 0x7f3fdc1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fda59c640 1 -- 172.21.15.118:0/1009613036 >> v2:172.21.15.164:3300/0 conn(0x7f3fdc0bc600 msgr2=0x7f3fdc1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:54.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fda59c640 1 --2- 172.21.15.118:0/1009613036 >> v2:172.21.15.164:3300/0 conn(0x7f3fdc0bc600 0x7f3fdc1490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fda59c640 1 -- 172.21.15.118:0/1009613036 >> v1:172.21.15.118:6789/0 conn(0x7f3fdc149630 legacy=0x7f3fdc0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fda59c640 1 -- 172.21.15.118:0/1009613036 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0b9c30 con 0x7f3fdc06be60 2024-02-18T11:11:54.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fda59c640 1 --2- 172.21.15.118:0/1009613036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc09cca0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0671a0 tx=0x7f3fd002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5905fbf24ba94d83 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:54.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fd959a640 1 -- 172.21.15.118:0/1009613036 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd002f850 con 0x7f3fdc06be60 2024-02-18T11:11:54.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fd959a640 1 -- 172.21.15.118:0/1009613036 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd002f9b0 con 0x7f3fdc06be60 2024-02-18T11:11:54.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.837+0000 7f3fd959a640 1 -- 172.21.15.118:0/1009613036 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd002fd40 con 0x7f3fdc06be60 2024-02-18T11:11:54.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 -- 172.21.15.118:0/1009613036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 msgr2=0x7f3fdc09cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 --2- 172.21.15.118:0/1009613036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc09cca0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0671a0 tx=0x7f3fd002ba30 comp rx=0 tx=0).stop 2024-02-18T11:11:54.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 -- 172.21.15.118:0/1009613036 shutdown_connections 2024-02-18T11:11:54.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 --2- 172.21.15.118:0/1009613036 >> v2:172.21.15.164:3300/0 conn(0x7f3fdc0bc600 0x7f3fdc1490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 --2- 172.21.15.118:0/1009613036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc09cca0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.843 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 -- 172.21.15.118:0/1009613036 >> 172.21.15.118:0/1009613036 conn(0x7f3fdc0ba4c0 msgr2=0x7f3fdc0ba8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:54.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 -- 172.21.15.118:0/1009613036 shutdown_connections 2024-02-18T11:11:54.844 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.838+0000 7f3fe089d640 1 -- 172.21.15.118:0/1009613036 wait complete. 2024-02-18T11:11:54.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.839+0000 7f3fe089d640 1 Processor -- start 2024-02-18T11:11:54.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.839+0000 7f3fe089d640 1 -- start start 2024-02-18T11:11:54.847 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fe089d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fe089d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fdc0bc600 0x7f3fdc1e1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fe089d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fdc149630 0x7f3fdc1e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fe089d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc070e30 con 0x7f3fdc06be60 2024-02-18T11:11:54.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fe089d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0a20a0 con 0x7f3fdc0bc600 2024-02-18T11:11:54.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fe089d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc149ee0 con 0x7f3fdc149630 2024-02-18T11:11:54.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.848 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc0708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35988/0 (socket says 172.21.15.118:35988) 2024-02-18T11:11:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 -- 172.21.15.118:0/149998361 learned_addr learned my addr 172.21.15.118:0/149998361 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fd9d9b640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fdc0bc600 0x7f3fdc1e1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fdad9d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fdc149630 0x7f3fdc1e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 -- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fdc149630 msgr2=0x7f3fdc1e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fdc149630 0x7f3fdc1e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 -- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fdc0bc600 msgr2=0x7f3fdc1e1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:54.849 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fdc0bc600 0x7f3fdc1e1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 -- 172.21.15.118:0/149998361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00094d0 con 0x7f3fdc06be60 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fd9d9b640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fdc0bc600 0x7f3fdc1e1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fdad9d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fdc149630 0x7f3fdc1e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.840+0000 7f3fda59c640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc0708f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3fd002ba70 tx=0x7f3fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.841+0000 7f3fcaffd640 1 -- 172.21.15.118:0/149998361 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd002f840 con 0x7f3fdc06be60 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.841+0000 7f3fcaffd640 1 -- 172.21.15.118:0/149998361 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0041400 con 0x7f3fdc06be60 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.841+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc0a2340 con 0x7f3fdc06be60 2024-02-18T11:11:54.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.841+0000 7f3fcaffd640 1 -- 172.21.15.118:0/149998361 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00417b0 con 0x7f3fdc06be60 2024-02-18T11:11:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.841+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc0715c0 con 0x7f3fdc06be60 2024-02-18T11:11:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.842+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc06d700 con 0x7f3fdc06be60 2024-02-18T11:11:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.842+0000 7f3fcaffd640 1 -- 172.21.15.118:0/149998361 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f3fd0041910 con 0x7f3fdc06be60 2024-02-18T11:11:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.842+0000 7f3fcaffd640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fbc06bc70 0x7f3fbc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.842+0000 7f3fcaffd640 1 -- 172.21.15.118:0/149998361 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3fd003c070 con 0x7f3fdc06be60 2024-02-18T11:11:54.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.842+0000 7f3fd9d9b640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fbc06bc70 0x7f3fbc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.843+0000 7f3fd9d9b640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fbc06bc70 0x7f3fbc06e130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0a2b90 tx=0x7f3fcc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:54.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:54.846+0000 7f3fcaffd640 1 -- 172.21.15.118:0/149998361 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3fd0077fe0 con 0x7f3fdc06be60 2024-02-18T11:11:55.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.023+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fdc074af0 con 0x7f3fbc06bc70 2024-02-18T11:11:55.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.023+0000 7f3fcaffd640 1 -- 172.21.15.118:0/149998361 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3fdc074af0 con 0x7f3fbc06bc70 2024-02-18T11:11:55.025 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 0 to deep-scrub 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fbc06bc70 msgr2=0x7f3fbc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fbc06bc70 0x7f3fbc06e130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0a2b90 tx=0x7f3fcc008040 comp rx=0 tx=0).stop 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 msgr2=0x7f3fdc0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc0708f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3fd002ba70 tx=0x7f3fd0004730 comp rx=0 tx=0).stop 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 shutdown_connections 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3fbc06bc70 0x7f3fbc06e130 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3fdc149630 0x7f3fdc1e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3fdc0bc600 0x7f3fdc1e1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 --2- 172.21.15.118:0/149998361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3fdc06be60 0x7f3fdc0708f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 >> 172.21.15.118:0/149998361 conn(0x7f3fdc0ba4c0 msgr2=0x7f3fdc06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 shutdown_connections 2024-02-18T11:11:55.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.025+0000 7f3fe089d640 1 -- 172.21.15.118:0/149998361 wait complete. 2024-02-18T11:11:55.037 INFO:tasks.ceph:Scrubbing osd.1 2024-02-18T11:11:55.038 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:55.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.142+0000 7f42a99dd640 1 Processor -- start 2024-02-18T11:11:55.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.142+0000 7f42a99dd640 1 -- start start 2024-02-18T11:11:55.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a99dd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42a40bb730 0x7f42a40bca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a99dd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 0x7f42a40ba560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a99dd640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a40baaa0 con 0x7f42a40bcf60 2024-02-18T11:11:55.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a99dd640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a40bd4c0 con 0x7f42a40bb730 2024-02-18T11:11:55.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a99dd640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40bd7a0 con 0x7f42a40ba0b0 2024-02-18T11:11:55.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a2ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42a40bb730 0x7f42a40bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a2ffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42a40bb730 0x7f42a40bca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35998/0 (socket says 172.21.15.118:35998) 2024-02-18T11:11:55.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a2ffd640 1 -- 172.21.15.118:0/3556591545 learned_addr learned my addr 172.21.15.118:0/3556591545 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a37fe640 1 --2- 172.21.15.118:0/3556591545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 0x7f42a40ba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a2ffd640 1 -- 172.21.15.118:0/3556591545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 msgr2=0x7f42a40ba560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:55.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a2ffd640 1 --2- 172.21.15.118:0/3556591545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 0x7f42a40ba560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a2ffd640 1 -- 172.21.15.118:0/3556591545 >> v1:172.21.15.118:6789/0 conn(0x7f42a40bcf60 legacy=0x7f42a4145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.143+0000 7f42a2ffd640 1 -- 172.21.15.118:0/3556591545 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a40bda80 con 0x7f42a40bb730 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.144+0000 7f42a2ffd640 1 --2- 172.21.15.118:0/3556591545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bb730 0x7f42a40bca20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f42940098a0 tx=0x7f429402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4362e2f114ed0c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.144+0000 7f42a27fc640 1 -- 172.21.15.118:0/3556591545 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429402f830 con 0x7f42a40bb730 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.144+0000 7f42a27fc640 1 -- 172.21.15.118:0/3556591545 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429402f990 con 0x7f42a40bb730 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.144+0000 7f42a27fc640 1 -- 172.21.15.118:0/3556591545 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429402fd20 con 0x7f42a40bb730 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 -- 172.21.15.118:0/3556591545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bb730 msgr2=0x7f42a40bca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 --2- 172.21.15.118:0/3556591545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bb730 0x7f42a40bca20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f42940098a0 tx=0x7f429402ba10 comp rx=0 tx=0).stop 2024-02-18T11:11:55.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 -- 172.21.15.118:0/3556591545 shutdown_connections 2024-02-18T11:11:55.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 --2- 172.21.15.118:0/3556591545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 0x7f42a40ba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 --2- 172.21.15.118:0/3556591545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bb730 0x7f42a40bca20 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 -- 172.21.15.118:0/3556591545 >> 172.21.15.118:0/3556591545 conn(0x7f42a40bea10 msgr2=0x7f42a40badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 -- 172.21.15.118:0/3556591545 shutdown_connections 2024-02-18T11:11:55.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.145+0000 7f42a99dd640 1 -- 172.21.15.118:0/3556591545 wait complete. 2024-02-18T11:11:55.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 Processor -- start 2024-02-18T11:11:55.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 -- start start 2024-02-18T11:11:55.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 0x7f42a414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42a40bb730 0x7f42a41d75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bcf60 0x7f42a4149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41d7af0 con 0x7f42a40bcf60 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a414c170 con 0x7f42a40bb730 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.146+0000 7f42a99dd640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41e1d70 con 0x7f42a40ba0b0 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bcf60 0x7f42a4149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bcf60 0x7f42a4149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36012/0 (socket says 172.21.15.118:36012) 2024-02-18T11:11:55.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 -- 172.21.15.118:0/544246944 learned_addr learned my addr 172.21.15.118:0/544246944 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a2ffd640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 0x7f42a414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f429bfff640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42a40bb730 0x7f42a41d75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 -- 172.21.15.118:0/544246944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 msgr2=0x7f42a414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f42a40ba0b0 0x7f42a414baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 -- 172.21.15.118:0/544246944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42a40bb730 msgr2=0x7f42a41d75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f42a40bb730 0x7f42a41d75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 -- 172.21.15.118:0/544246944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940094d0 con 0x7f42a40bcf60 2024-02-18T11:11:55.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a37fe640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bcf60 0x7f42a4149e10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f429c00cd70 tx=0x7f429c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c003b90 con 0x7f42a40bcf60 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c003cf0 con 0x7f42a40bcf60 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a41e2050 con 0x7f42a40bcf60 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c004240 con 0x7f42a40bcf60 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.147+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a41e2610 con 0x7f42a40bcf60 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.148+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42a40b9660 con 0x7f42a40bcf60 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.149+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f429c0043a0 con 0x7f42a40bcf60 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.149+0000 7f42a0ff9640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f428406bc70 0x7f428406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f429c012070 con 0x7f42a40bcf60 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f42a2ffd640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f428406bc70 0x7f428406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f42a0ff9640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f4284071b30 0x7f4284073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 --> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4284074600 con 0x7f4284071b30 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f429c08f260 con 0x7f42a40bcf60 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f429bfff640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f4284071b30 0x7f4284073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f42a2ffd640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f428406bc70 0x7f428406e130 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4294036000 tx=0x7f4294008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.150+0000 7f429bfff640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f4284071b30 0x7f4284073f50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.151+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== osd.1 v2:172.21.15.118:6816/2284297691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4284074600 con 0x7f4284071b30 2024-02-18T11:11:55.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.164+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 --> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f42a41e1ee0 con 0x7f4284071b30 2024-02-18T11:11:55.165 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.164+0000 7f42a0ff9640 1 -- 172.21.15.118:0/544246944 <== osd.1 v2:172.21.15.118:6816/2284297691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f42a41e1ee0 con 0x7f4284071b30 2024-02-18T11:11:55.166 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:55.166 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:55.166 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:55.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f4284071b30 msgr2=0x7f4284073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6816/2284297691,v1:172.21.15.118:6818/2284297691] conn(0x7f4284071b30 0x7f4284073f50 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f428406bc70 msgr2=0x7f428406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f428406bc70 0x7f428406e130 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4294036000 tx=0x7f4294008030 comp rx=0 tx=0).stop 2024-02-18T11:11:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bcf60 msgr2=0x7f42a4149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 --2- 172.21.15.118:0/544246944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f42a40bcf60 0x7f42a4149e10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f429c00cd70 tx=0x7f429c00a660 comp rx=0 tx=0).stop 2024-02-18T11:11:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a37fe640 1 -- 172.21.15.118:0/544246944 reap_dead start 2024-02-18T11:11:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 shutdown_connections 2024-02-18T11:11:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 >> 172.21.15.118:0/544246944 conn(0x7f42a40bea10 msgr2=0x7f42a4143340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 shutdown_connections 2024-02-18T11:11:55.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.165+0000 7f42a99dd640 1 -- 172.21.15.118:0/544246944 wait complete. 2024-02-18T11:11:55.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-18T11:11:55.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.277+0000 7f7defe9d640 1 Processor -- start 2024-02-18T11:11:55.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.277+0000 7f7defe9d640 1 -- start start 2024-02-18T11:11:55.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7defe9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de8071f80 0x7f7de8072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7defe9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7de80ba1a0 0x7f7de806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7defe9d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de8072bd0 con 0x7f7de806f0b0 2024-02-18T11:11:55.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7defe9d640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de806e0b0 con 0x7f7de80ba1a0 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7defe9d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8070fe0 con 0x7f7de8071f80 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7ded438640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7de80ba1a0 0x7f7de806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7ded438640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7de80ba1a0 0x7f7de806eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36022/0 (socket says 172.21.15.118:36022) 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7ded438640 1 -- 172.21.15.118:0/1754143941 learned_addr learned my addr 172.21.15.118:0/1754143941 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7dedc39640 1 --2- 172.21.15.118:0/1754143941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de8071f80 0x7f7de8072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7ded438640 1 -- 172.21.15.118:0/1754143941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de8071f80 msgr2=0x7f7de8072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7ded438640 1 --2- 172.21.15.118:0/1754143941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de8071f80 0x7f7de8072690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7ded438640 1 -- 172.21.15.118:0/1754143941 >> v1:172.21.15.164:6789/0 conn(0x7f7de806f0b0 legacy=0x7f7de8145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.278+0000 7f7ded438640 1 -- 172.21.15.118:0/1754143941 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8072e50 con 0x7f7de80ba1a0 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.279+0000 7f7ded438640 1 --2- 172.21.15.118:0/1754143941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de80ba1a0 0x7f7de806eb70 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009870 tx=0x7f7de402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cf64d5028e8bd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.279+0000 7f7decc37640 1 -- 172.21.15.118:0/1754143941 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4030840 con 0x7f7de80ba1a0 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.279+0000 7f7decc37640 1 -- 172.21.15.118:0/1754143941 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de40309a0 con 0x7f7de80ba1a0 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.279+0000 7f7decc37640 1 -- 172.21.15.118:0/1754143941 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4030d30 con 0x7f7de80ba1a0 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 -- 172.21.15.118:0/1754143941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de80ba1a0 msgr2=0x7f7de806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 --2- 172.21.15.118:0/1754143941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de80ba1a0 0x7f7de806eb70 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009870 tx=0x7f7de402b980 comp rx=0 tx=0).stop 2024-02-18T11:11:55.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 -- 172.21.15.118:0/1754143941 shutdown_connections 2024-02-18T11:11:55.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 --2- 172.21.15.118:0/1754143941 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de80ba1a0 0x7f7de806eb70 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 --2- 172.21.15.118:0/1754143941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de8071f80 0x7f7de8072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 -- 172.21.15.118:0/1754143941 >> 172.21.15.118:0/1754143941 conn(0x7f7de806bcf0 msgr2=0x7f7de806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 -- 172.21.15.118:0/1754143941 shutdown_connections 2024-02-18T11:11:55.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.280+0000 7f7defe9d640 1 -- 172.21.15.118:0/1754143941 wait complete. 2024-02-18T11:11:55.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 Processor -- start 2024-02-18T11:11:55.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 -- start start 2024-02-18T11:11:55.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de806f0b0 0x7f7de81e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de8071f80 0x7f7de80a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de80ba1a0 0x7f7de80bc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de81e52f0 con 0x7f7de8071f80 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80bd8d0 con 0x7f7de80ba1a0 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7defe9d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de813c1b0 con 0x7f7de806f0b0 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7ded438640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de8071f80 0x7f7de80a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7ded438640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de8071f80 0x7f7de80a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36032/0 (socket says 172.21.15.118:36032) 2024-02-18T11:11:55.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.281+0000 7f7ded438640 1 -- 172.21.15.118:0/3111605859 learned_addr learned my addr 172.21.15.118:0/3111605859 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7dee43a640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de80ba1a0 0x7f7de80bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7dedc39640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de806f0b0 0x7f7de81e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7ded438640 1 -- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de806f0b0 msgr2=0x7f7de81e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7ded438640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de806f0b0 0x7f7de81e4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7ded438640 1 -- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de80ba1a0 msgr2=0x7f7de80bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7ded438640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de80ba1a0 0x7f7de80bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7ded438640 1 -- 172.21.15.118:0/3111605859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40094d0 con 0x7f7de8071f80 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7ded438640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de8071f80 0x7f7de80a01d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009870 tx=0x7f7de4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7dde7fc640 1 -- 172.21.15.118:0/3111605859 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de40307f0 con 0x7f7de8071f80 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7dde7fc640 1 -- 172.21.15.118:0/3111605859 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4039d90 con 0x7f7de8071f80 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de81d5ab0 con 0x7f7de8071f80 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7dde7fc640 1 -- 172.21.15.118:0/3111605859 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4043630 con 0x7f7de8071f80 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.282+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de81d6070 con 0x7f7de8071f80 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.283+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de80bc120 con 0x7f7de8071f80 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.284+0000 7f7dde7fc640 1 -- 172.21.15.118:0/3111605859 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f7de404c3b0 con 0x7f7de8071f80 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.284+0000 7f7dde7fc640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dcc06bca0 0x7f7dcc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.284+0000 7f7dedc39640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dcc06bca0 0x7f7dcc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.284+0000 7f7dde7fc640 1 -- 172.21.15.118:0/3111605859 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7de40aca50 con 0x7f7de8071f80 2024-02-18T11:11:55.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.285+0000 7f7dedc39640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dcc06bca0 0x7f7dcc06e160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800a970 tx=0x7f7dd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.288+0000 7f7dde7fc640 1 -- 172.21.15.118:0/3111605859 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7de80bc120 con 0x7f7de8071f80 2024-02-18T11:11:55.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.465+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7de8068650 con 0x7f7dcc06bca0 2024-02-18T11:11:55.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.466+0000 7f7dde7fc640 1 -- 172.21.15.118:0/3111605859 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7de8068650 con 0x7f7dcc06bca0 2024-02-18T11:11:55.467 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 1 to deep-scrub 2024-02-18T11:11:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dcc06bca0 msgr2=0x7f7dcc06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dcc06bca0 0x7f7dcc06e160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800a970 tx=0x7f7dd8008040 comp rx=0 tx=0).stop 2024-02-18T11:11:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de8071f80 msgr2=0x7f7de80a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de8071f80 0x7f7de80a01d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009870 tx=0x7f7de4004730 comp rx=0 tx=0).stop 2024-02-18T11:11:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 shutdown_connections 2024-02-18T11:11:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f7dcc06bca0 0x7f7dcc06e160 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de80ba1a0 0x7f7de80bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7de8071f80 0x7f7de80a01d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 --2- 172.21.15.118:0/3111605859 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7de806f0b0 0x7f7de81e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.467+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 >> 172.21.15.118:0/3111605859 conn(0x7f7de806bcf0 msgr2=0x7f7de80a1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.468+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 shutdown_connections 2024-02-18T11:11:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.468+0000 7f7defe9d640 1 -- 172.21.15.118:0/3111605859 wait complete. 2024-02-18T11:11:55.480 INFO:tasks.ceph:Scrubbing osd.2 2024-02-18T11:11:55.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:55.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2ff1855640 1 Processor -- start 2024-02-18T11:11:55.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2ff1855640 1 -- start start 2024-02-18T11:11:55.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2ff1855640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2fec0a14c0 0x7f2fec0bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2ff1855640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2fec0bc550 0x7f2fec1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2ff1855640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec149e00 con 0x7f2fec149970 2024-02-18T11:11:55.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2ff1855640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec14a0e0 con 0x7f2fec0a14c0 2024-02-18T11:11:55.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2ff1855640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec14a3c0 con 0x7f2fec0bc550 2024-02-18T11:11:55.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2feaffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2fec0a14c0 0x7f2fec0bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2feaffd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2fec0a14c0 0x7f2fec0bd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36042/0 (socket says 172.21.15.118:36042) 2024-02-18T11:11:55.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.584+0000 7f2feaffd640 1 -- 172.21.15.118:0/717203865 learned_addr learned my addr 172.21.15.118:0/717203865 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2feaffd640 1 -- 172.21.15.118:0/717203865 >> v2:172.21.15.164:3300/0 conn(0x7f2fec0bc550 msgr2=0x7f2fec1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2feaffd640 1 --2- 172.21.15.118:0/717203865 >> v2:172.21.15.164:3300/0 conn(0x7f2fec0bc550 0x7f2fec1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2feaffd640 1 -- 172.21.15.118:0/717203865 >> v1:172.21.15.118:6789/0 conn(0x7f2fec149970 legacy=0x7f2fec0bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2feaffd640 1 -- 172.21.15.118:0/717203865 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec14a6a0 con 0x7f2fec0a14c0 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2feaffd640 1 --2- 172.21.15.118:0/717203865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec0a14c0 0x7f2fec0bd7f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0be970 tx=0x7f2fdc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78db63e333bc51a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2fea7fc640 1 -- 172.21.15.118:0/717203865 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc031870 con 0x7f2fec0a14c0 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2fea7fc640 1 -- 172.21.15.118:0/717203865 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0319d0 con 0x7f2fec0a14c0 2024-02-18T11:11:55.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.585+0000 7f2fea7fc640 1 -- 172.21.15.118:0/717203865 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc031d60 con 0x7f2fec0a14c0 2024-02-18T11:11:55.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 -- 172.21.15.118:0/717203865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec0a14c0 msgr2=0x7f2fec0bd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 --2- 172.21.15.118:0/717203865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec0a14c0 0x7f2fec0bd7f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0be970 tx=0x7f2fdc02b910 comp rx=0 tx=0).stop 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 -- 172.21.15.118:0/717203865 shutdown_connections 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 --2- 172.21.15.118:0/717203865 >> v2:172.21.15.164:3300/0 conn(0x7f2fec0bc550 0x7f2fec1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 --2- 172.21.15.118:0/717203865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec0a14c0 0x7f2fec0bd7f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 -- 172.21.15.118:0/717203865 >> 172.21.15.118:0/717203865 conn(0x7f2fec0bf510 msgr2=0x7f2fec0bf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 -- 172.21.15.118:0/717203865 shutdown_connections 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.586+0000 7f2ff1855640 1 -- 172.21.15.118:0/717203865 wait complete. 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.587+0000 7f2ff1855640 1 Processor -- start 2024-02-18T11:11:55.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.587+0000 7f2ff1855640 1 -- start start 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2ff1855640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fec0a14c0 0x7f2fec09e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2ff1855640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fec0bc550 0x7f2fec0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2ff1855640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec1e16c0 0x7f2fec1e1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2ff1855640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0b90f0 con 0x7f2fec1e16c0 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2ff1855640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec1e5b70 con 0x7f2fec0a14c0 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2ff1855640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec1e56e0 con 0x7f2fec0bc550 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec1e16c0 0x7f2fec1e1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec1e16c0 0x7f2fec1e1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36044/0 (socket says 172.21.15.118:36044) 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 -- 172.21.15.118:0/389101644 learned_addr learned my addr 172.21.15.118:0/389101644 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feaffd640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fec0a14c0 0x7f2fec09e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2fe3fff640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fec0bc550 0x7f2fec0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 -- 172.21.15.118:0/389101644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fec0bc550 msgr2=0x7f2fec0b8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fec0bc550 0x7f2fec0b8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 -- 172.21.15.118:0/389101644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fec0a14c0 msgr2=0x7f2fec09e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fec0a14c0 0x7f2fec09e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 -- 172.21.15.118:0/389101644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0094d0 con 0x7f2fec1e16c0 2024-02-18T11:11:55.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2fe3fff640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fec0bc550 0x7f2fec0b8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2feb7fe640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec1e16c0 0x7f2fec1e1b40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400b9a0 tx=0x7f2fe400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400cba0 con 0x7f2fec1e16c0 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.588+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe400cd20 con 0x7f2fec1e16c0 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.589+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec099f90 con 0x7f2fec1e16c0 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.589+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4014680 con 0x7f2fec1e16c0 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.589+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec1e5090 con 0x7f2fec1e16c0 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.590+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fec1437f0 con 0x7f2fec1e16c0 2024-02-18T11:11:55.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.590+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f2fe401d3b0 con 0x7f2fec1e16c0 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2fe8ff9640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2fcc06bc70 0x7f2fcc06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2fe408aa50 con 0x7f2fec1e16c0 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2feaffd640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2fcc06bc70 0x7f2fcc06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2fe8ff9640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7f2fcc071b30 0x7f2fcc073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 --> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fcc074600 con 0x7f2fcc071b30 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fe408aea0 con 0x7f2fec1e16c0 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2fe3fff640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7f2fcc071b30 0x7f2fcc073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2feaffd640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2fcc06bc70 0x7f2fcc06e130 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc036000 tx=0x7f2fdc03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.591+0000 7f2fe3fff640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7f2fcc071b30 0x7f2fcc073f50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.592+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== osd.2 v2:172.21.15.118:6817/1225011872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2fcc074600 con 0x7f2fcc071b30 2024-02-18T11:11:55.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.605+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 --> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2fec074af0 con 0x7f2fcc071b30 2024-02-18T11:11:55.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.605+0000 7f2fe8ff9640 1 -- 172.21.15.118:0/389101644 <== osd.2 v2:172.21.15.118:6817/1225011872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2fec074af0 con 0x7f2fcc071b30 2024-02-18T11:11:55.607 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:55.607 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:55.607 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:55.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7f2fcc071b30 msgr2=0x7f2fcc073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6817/1225011872,v1:172.21.15.118:6819/1225011872] conn(0x7f2fcc071b30 0x7f2fcc073f50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2fcc06bc70 msgr2=0x7f2fcc06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2fcc06bc70 0x7f2fcc06e130 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc036000 tx=0x7f2fdc03c040 comp rx=0 tx=0).stop 2024-02-18T11:11:55.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec1e16c0 msgr2=0x7f2fec1e1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 --2- 172.21.15.118:0/389101644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2fec1e16c0 0x7f2fec1e1b40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400b9a0 tx=0x7f2fe400be60 comp rx=0 tx=0).stop 2024-02-18T11:11:55.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2feb7fe640 1 -- 172.21.15.118:0/389101644 reap_dead start 2024-02-18T11:11:55.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 shutdown_connections 2024-02-18T11:11:55.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 >> 172.21.15.118:0/389101644 conn(0x7f2fec0bf510 msgr2=0x7f2fec0ba310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 shutdown_connections 2024-02-18T11:11:55.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.606+0000 7f2ff1855640 1 -- 172.21.15.118:0/389101644 wait complete. 2024-02-18T11:11:55.618 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-18T11:11:55.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.718+0000 7f10dced4640 1 Processor -- start 2024-02-18T11:11:55.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.718+0000 7f10dced4640 1 -- start start 2024-02-18T11:11:55.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10dced4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f10d814c900 0x7f10d806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10dced4640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10d814bcd0 0x7f10d80bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10dced4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d806dd50 con 0x7f10d806ce30 2024-02-18T11:11:55.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10dced4640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d80ba440 con 0x7f10d814bcd0 2024-02-18T11:11:55.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10dced4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d806da90 con 0x7f10d814c900 2024-02-18T11:11:55.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10cffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10d814bcd0 0x7f10d80bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10cffff640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10d814bcd0 0x7f10d80bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36056/0 (socket says 172.21.15.118:36056) 2024-02-18T11:11:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10cffff640 1 -- 172.21.15.118:0/1620480655 learned_addr learned my addr 172.21.15.118:0/1620480655 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10d659c640 1 --2- 172.21.15.118:0/1620480655 >> v2:172.21.15.164:3300/0 conn(0x7f10d814c900 0x7f10d806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10cffff640 1 -- 172.21.15.118:0/1620480655 >> v2:172.21.15.164:3300/0 conn(0x7f10d814c900 msgr2=0x7f10d806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10cffff640 1 --2- 172.21.15.118:0/1620480655 >> v2:172.21.15.164:3300/0 conn(0x7f10d814c900 0x7f10d806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10cffff640 1 -- 172.21.15.118:0/1620480655 >> v1:172.21.15.118:6789/0 conn(0x7f10d806ce30 legacy=0x7f10d806d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.719+0000 7f10cffff640 1 -- 172.21.15.118:0/1620480655 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d806ea80 con 0x7f10d814bcd0 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.720+0000 7f10cffff640 1 --2- 172.21.15.118:0/1620480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d80bbdf0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4e7ab7617d2852 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.720+0000 7f10d5d9b640 1 -- 172.21.15.118:0/1620480655 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0031870 con 0x7f10d814bcd0 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.720+0000 7f10d5d9b640 1 -- 172.21.15.118:0/1620480655 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00319d0 con 0x7f10d814bcd0 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.720+0000 7f10d5d9b640 1 -- 172.21.15.118:0/1620480655 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0031d60 con 0x7f10d814bcd0 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 -- 172.21.15.118:0/1620480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 msgr2=0x7f10d80bbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 --2- 172.21.15.118:0/1620480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d80bbdf0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009870 tx=0x7f10c002b910 comp rx=0 tx=0).stop 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 -- 172.21.15.118:0/1620480655 shutdown_connections 2024-02-18T11:11:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 --2- 172.21.15.118:0/1620480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d80bbdf0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 --2- 172.21.15.118:0/1620480655 >> v2:172.21.15.164:3300/0 conn(0x7f10d814c900 0x7f10d806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 -- 172.21.15.118:0/1620480655 >> 172.21.15.118:0/1620480655 conn(0x7f10d80bf330 msgr2=0x7f10d80bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 -- 172.21.15.118:0/1620480655 shutdown_connections 2024-02-18T11:11:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.721+0000 7f10dced4640 1 -- 172.21.15.118:0/1620480655 wait complete. 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 Processor -- start 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 -- start start 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10d806ce30 0x7f10d814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d81e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10d814c900 0x7f10d8144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d814fd70 con 0x7f10d814bcd0 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8146f10 con 0x7f10d814c900 2024-02-18T11:11:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10dced4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d8148010 con 0x7f10d806ce30 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.722+0000 7f10cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d81e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d81e5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36068/0 (socket says 172.21.15.118:36068) 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 -- 172.21.15.118:0/1881282143 learned_addr learned my addr 172.21.15.118:0/1881282143 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10d6d9d640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10d814c900 0x7f10d8144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10d659c640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10d806ce30 0x7f10d814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 -- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10d806ce30 msgr2=0x7f10d814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10d806ce30 0x7f10d814f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 -- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10d814c900 msgr2=0x7f10d8144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10d814c900 0x7f10d8144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 -- 172.21.15.118:0/1881282143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00094d0 con 0x7f10d814bcd0 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10d659c640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10d806ce30 0x7f10d814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10cffff640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d81e5180 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f10c0000c00 tx=0x7f10c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10ceffd640 1 -- 172.21.15.118:0/1881282143 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c003abe0 con 0x7f10d814bcd0 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10ceffd640 1 -- 172.21.15.118:0/1881282143 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c003ad40 con 0x7f10d814bcd0 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d8146c30 con 0x7f10d814bcd0 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10ceffd640 1 -- 172.21.15.118:0/1881282143 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0044630 con 0x7f10d814bcd0 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.723+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d81e4c60 con 0x7f10d814bcd0 2024-02-18T11:11:55.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.724+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d81e4e50 con 0x7f10d814bcd0 2024-02-18T11:11:55.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.725+0000 7f10ceffd640 1 -- 172.21.15.118:0/1881282143 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f10c004d450 con 0x7f10d814bcd0 2024-02-18T11:11:55.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.725+0000 7f10ceffd640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10b806bc70 0x7f10b806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:55.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.725+0000 7f10ceffd640 1 -- 172.21.15.118:0/1881282143 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10c002d040 con 0x7f10d814bcd0 2024-02-18T11:11:55.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.725+0000 7f10d659c640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10b806bc70 0x7f10b806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:55.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.725+0000 7f10d659c640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10b806bc70 0x7f10b806e130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f10c8006fd0 tx=0x7f10c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:55.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.733+0000 7f10ceffd640 1 -- 172.21.15.118:0/1881282143 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10c00774e0 con 0x7f10d814bcd0 2024-02-18T11:11:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.909+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d8074af0 con 0x7f10b806bc70 2024-02-18T11:11:55.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.909+0000 7f10ceffd640 1 -- 172.21.15.118:0/1881282143 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f10d8074af0 con 0x7f10b806bc70 2024-02-18T11:11:55.911 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 2 to deep-scrub 2024-02-18T11:11:55.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10b806bc70 msgr2=0x7f10b806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10b806bc70 0x7f10b806e130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f10c8006fd0 tx=0x7f10c8008040 comp rx=0 tx=0).stop 2024-02-18T11:11:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 msgr2=0x7f10d81e5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d81e5180 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f10c0000c00 tx=0x7f10c00046c0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 shutdown_connections 2024-02-18T11:11:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f10b806bc70 0x7f10b806e130 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10d814c900 0x7f10d8144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d814bcd0 0x7f10d81e5180 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 --2- 172.21.15.118:0/1881282143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10d806ce30 0x7f10d814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 >> 172.21.15.118:0/1881282143 conn(0x7f10d80bf330 msgr2=0x7f10d80ba7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 shutdown_connections 2024-02-18T11:11:55.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:55.911+0000 7f10dced4640 1 -- 172.21.15.118:0/1881282143 wait complete. 2024-02-18T11:11:55.923 INFO:tasks.ceph:Scrubbing osd.3 2024-02-18T11:11:55.924 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:56.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.027+0000 7fd39c90c640 1 Processor -- start 2024-02-18T11:11:56.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.027+0000 7fd39c90c640 1 -- start start 2024-02-18T11:11:56.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39c90c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd3980a14c0 0x7fd3980be690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39c90c640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd398145720 0x7fd398145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39c90c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3981460b0 con 0x7fd3980beff0 2024-02-18T11:11:56.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39c90c640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39806f1d0 con 0x7fd3980a14c0 2024-02-18T11:11:56.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39c90c640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980bebd0 con 0x7fd398145720 2024-02-18T11:11:56.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39659c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd3980a14c0 0x7fd3980be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39659c640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd3980a14c0 0x7fd3980be690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36082/0 (socket says 172.21.15.118:36082) 2024-02-18T11:11:56.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39659c640 1 -- 172.21.15.118:0/2857384672 learned_addr learned my addr 172.21.15.118:0/2857384672 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:56.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39659c640 1 -- 172.21.15.118:0/2857384672 >> v2:172.21.15.164:3300/0 conn(0x7fd398145720 msgr2=0x7fd398145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39659c640 1 --2- 172.21.15.118:0/2857384672 >> v2:172.21.15.164:3300/0 conn(0x7fd398145720 0x7fd398145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39659c640 1 -- 172.21.15.118:0/2857384672 >> v1:172.21.15.164:6789/0 conn(0x7fd3980beff0 legacy=0x7fd39806eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.028+0000 7fd39659c640 1 -- 172.21.15.118:0/2857384672 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39814bcc0 con 0x7fd3980a14c0 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.029+0000 7fd39659c640 1 --2- 172.21.15.118:0/2857384672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980be690 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd388009870 tx=0x7fd38802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2421e817cb959e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.029+0000 7fd395d9b640 1 -- 172.21.15.118:0/2857384672 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388030860 con 0x7fd3980a14c0 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.029+0000 7fd395d9b640 1 -- 172.21.15.118:0/2857384672 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3880309c0 con 0x7fd3980a14c0 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.029+0000 7fd395d9b640 1 -- 172.21.15.118:0/2857384672 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388030d50 con 0x7fd3980a14c0 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 -- 172.21.15.118:0/2857384672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 msgr2=0x7fd3980be690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 --2- 172.21.15.118:0/2857384672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980be690 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd388009870 tx=0x7fd38802b9a0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 -- 172.21.15.118:0/2857384672 shutdown_connections 2024-02-18T11:11:56.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 --2- 172.21.15.118:0/2857384672 >> v2:172.21.15.164:3300/0 conn(0x7fd398145720 0x7fd398145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 --2- 172.21.15.118:0/2857384672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980be690 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 -- 172.21.15.118:0/2857384672 >> 172.21.15.118:0/2857384672 conn(0x7fd3980bf510 msgr2=0x7fd3980bf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 -- 172.21.15.118:0/2857384672 shutdown_connections 2024-02-18T11:11:56.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.030+0000 7fd39c90c640 1 -- 172.21.15.118:0/2857384672 wait complete. 2024-02-18T11:11:56.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.031+0000 7fd39c90c640 1 Processor -- start 2024-02-18T11:11:56.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.031+0000 7fd39c90c640 1 -- start start 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3980beff0 0x7fd3981e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd398145720 0x7fd3981e5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a3ec0 con 0x7fd3980a14c0 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980bce40 con 0x7fd3980beff0 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980b66f0 con 0x7fd398145720 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980a3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36092/0 (socket says 172.21.15.118:36092) 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 -- 172.21.15.118:0/2286807379 learned_addr learned my addr 172.21.15.118:0/2286807379 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd396d9d640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd398145720 0x7fd3981e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd38ffff640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3980beff0 0x7fd3981e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 -- 172.21.15.118:0/2286807379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd398145720 msgr2=0x7fd3981e5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd398145720 0x7fd3981e5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 -- 172.21.15.118:0/2286807379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3980beff0 msgr2=0x7fd3981e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3980beff0 0x7fd3981e4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 -- 172.21.15.118:0/2286807379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880094d0 con 0x7fd3980a14c0 2024-02-18T11:11:56.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39659c640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980a3980 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd388009870 tx=0x7fd388004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388039d60 con 0x7fd3980a14c0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388043400 con 0x7fd3980a14c0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980b69d0 con 0x7fd3980a14c0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880437b0 con 0x7fd3980a14c0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.032+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980a4420 con 0x7fd3980a14c0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.033+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd39814b620 con 0x7fd3980a14c0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.034+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fd388043910 con 0x7fd3980a14c0 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.034+0000 7fd38effd640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd37806bc70 0x7fd37806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.034+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd38803e070 con 0x7fd3980a14c0 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.034+0000 7fd38ffff640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd37806bc70 0x7fd37806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.034+0000 7fd38effd640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7fd378071b30 0x7fd378073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.034+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 --> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd378074600 con 0x7fd378071b30 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.034+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3880ae370 con 0x7fd3980a14c0 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.035+0000 7fd396d9d640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7fd378071b30 0x7fd378073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.035+0000 7fd38ffff640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd37806bc70 0x7fd37806e130 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd3980be6b0 tx=0x7fd380009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.035+0000 7fd396d9d640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7fd378071b30 0x7fd378073f50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.035+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== osd.3 v2:172.21.15.118:6800/28144523 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd378074600 con 0x7fd378071b30 2024-02-18T11:11:56.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.048+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 --> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd39814c560 con 0x7fd378071b30 2024-02-18T11:11:56.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd38effd640 1 -- 172.21.15.118:0/2286807379 <== osd.3 v2:172.21.15.118:6800/28144523 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd390007930 con 0x7fd378071b30 2024-02-18T11:11:56.050 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:56.050 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:56.050 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:56.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7fd378071b30 msgr2=0x7fd378073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6800/28144523,v1:172.21.15.118:6801/28144523] conn(0x7fd378071b30 0x7fd378073f50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd37806bc70 msgr2=0x7fd37806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fd37806bc70 0x7fd37806e130 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd3980be6b0 tx=0x7fd380009040 comp rx=0 tx=0).stop 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 msgr2=0x7fd3980a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 --2- 172.21.15.118:0/2286807379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3980a14c0 0x7fd3980a3980 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd388009870 tx=0x7fd388004730 comp rx=0 tx=0).stop 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd396d9d640 1 -- 172.21.15.118:0/2286807379 reap_dead start 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 shutdown_connections 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 >> 172.21.15.118:0/2286807379 conn(0x7fd3980bf510 msgr2=0x7fd398072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 shutdown_connections 2024-02-18T11:11:56.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.049+0000 7fd39c90c640 1 -- 172.21.15.118:0/2286807379 wait complete. 2024-02-18T11:11:56.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-18T11:11:56.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.162+0000 7f1489b2e640 1 Processor -- start 2024-02-18T11:11:56.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.162+0000 7f1489b2e640 1 -- start start 2024-02-18T11:11:56.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.162+0000 7f1489b2e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1484071f80 0x7f1484072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.162+0000 7f1489b2e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14841460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.162+0000 7f1489b2e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1484072bd0 con 0x7f14840ba1a0 2024-02-18T11:11:56.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.162+0000 7f1489b2e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148406e0b0 con 0x7f1484071f80 2024-02-18T11:11:56.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.162+0000 7f1489b2e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1484070fe0 con 0x7f1484145c50 2024-02-18T11:11:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f1482ffd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f14840ba1a0 0x7f148406eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47150/0 (socket says 172.21.15.118:47150) 2024-02-18T11:11:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f1482ffd640 1 -- 172.21.15.118:0/2305777477 learned_addr learned my addr 172.21.15.118:0/2305777477 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14837fe640 1 --2- 172.21.15.118:0/2305777477 >> v2:172.21.15.164:3300/0 conn(0x7f1484071f80 0x7f1484072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f1483fff640 1 --2- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14841460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14827fc640 1 -- 172.21.15.118:0/2305777477 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597903789 0 0) 0x7f1484072bd0 con 0x7f14840ba1a0 2024-02-18T11:11:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14827fc640 1 -- 172.21.15.118:0/2305777477 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f146c003520 con 0x7f14840ba1a0 2024-02-18T11:11:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14837fe640 1 -- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 msgr2=0x7f14841460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14837fe640 1 --2- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14841460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14827fc640 1 -- 172.21.15.118:0/2305777477 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 551162746 0 0) 0x7f146c003520 con 0x7f14840ba1a0 2024-02-18T11:11:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14837fe640 1 -- 172.21.15.118:0/2305777477 >> v1:172.21.15.118:6789/0 conn(0x7f14840ba1a0 legacy=0x7f148406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.163+0000 7f14837fe640 1 -- 172.21.15.118:0/2305777477 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484072e50 con 0x7f1484071f80 2024-02-18T11:11:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.164+0000 7f14837fe640 1 --2- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f1484072690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f14740097a0 tx=0x7f147402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb5d26daf3d2ad65 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.164+0000 7f14827fc640 1 -- 172.21.15.118:0/2305777477 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147402f050 con 0x7f1484071f80 2024-02-18T11:11:56.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.164+0000 7f14827fc640 1 -- 172.21.15.118:0/2305777477 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474031500 con 0x7f1484071f80 2024-02-18T11:11:56.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.164+0000 7f14827fc640 1 -- 172.21.15.118:0/2305777477 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478001670 con 0x7f1484071f80 2024-02-18T11:11:56.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 -- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 msgr2=0x7f1484072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 --2- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f1484072690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f14740097a0 tx=0x7f147402b820 comp rx=0 tx=0).stop 2024-02-18T11:11:56.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 -- 172.21.15.118:0/2305777477 shutdown_connections 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 --2- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14841460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 --2- 172.21.15.118:0/2305777477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f1484072690 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 -- 172.21.15.118:0/2305777477 >> 172.21.15.118:0/2305777477 conn(0x7f148406bcf0 msgr2=0x7f148406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 -- 172.21.15.118:0/2305777477 shutdown_connections 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.165+0000 7f1489b2e640 1 -- 172.21.15.118:0/2305777477 wait complete. 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 Processor -- start 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 -- start start 2024-02-18T11:11:56.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f148409f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840ba1a0 0x7f148409e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14840a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148409dfa0 con 0x7f14840ba1a0 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148409f950 con 0x7f1484071f80 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.166+0000 7f1489b2e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148409ebe0 con 0x7f1484145c50 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840ba1a0 0x7f148409e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840ba1a0 0x7f148409e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36100/0 (socket says 172.21.15.118:36100) 2024-02-18T11:11:56.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 -- 172.21.15.118:0/1852382017 learned_addr learned my addr 172.21.15.118:0/1852382017 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f14837fe640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f148409f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1483fff640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14840a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 -- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 msgr2=0x7f14840a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14840a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 -- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 msgr2=0x7f148409f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f148409f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 -- 172.21.15.118:0/1852382017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009400 con 0x7f14840ba1a0 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f14837fe640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f148409f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1483fff640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14840a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1482ffd640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840ba1a0 0x7f148409e6a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f147800c750 tx=0x7f147800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f146bfff640 1 -- 172.21.15.118:0/1852382017 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478005ad0 con 0x7f14840ba1a0 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f146bfff640 1 -- 172.21.15.118:0/1852382017 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478005c50 con 0x7f14840ba1a0 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148409fbc0 con 0x7f14840ba1a0 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f146bfff640 1 -- 172.21.15.118:0/1852382017 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478007070 con 0x7f14840ba1a0 2024-02-18T11:11:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.167+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148414f460 con 0x7f14840ba1a0 2024-02-18T11:11:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.168+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148409e3c0 con 0x7f14840ba1a0 2024-02-18T11:11:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.169+0000 7f146bfff640 1 -- 172.21.15.118:0/1852382017 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f14780071d0 con 0x7f14840ba1a0 2024-02-18T11:11:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.169+0000 7f146bfff640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f147006bc70 0x7f147006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.169+0000 7f146bfff640 1 -- 172.21.15.118:0/1852382017 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f147808a160 con 0x7f14840ba1a0 2024-02-18T11:11:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.169+0000 7f14837fe640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f147006bc70 0x7f147006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.170+0000 7f14837fe640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f147006bc70 0x7f147006e130 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1474035000 tx=0x7f1474008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.174+0000 7f146bfff640 1 -- 172.21.15.118:0/1852382017 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f148409e3c0 con 0x7f14840ba1a0 2024-02-18T11:11:56.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.351+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1484071a80 con 0x7f147006bc70 2024-02-18T11:11:56.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.351+0000 7f146bfff640 1 -- 172.21.15.118:0/1852382017 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f14740319f0 con 0x7f147006bc70 2024-02-18T11:11:56.353 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 3 to deep-scrub 2024-02-18T11:11:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f147006bc70 msgr2=0x7f147006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f147006bc70 0x7f147006e130 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1474035000 tx=0x7f1474008030 comp rx=0 tx=0).stop 2024-02-18T11:11:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840ba1a0 msgr2=0x7f148409e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840ba1a0 0x7f148409e6a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f147800c750 tx=0x7f147800cc10 comp rx=0 tx=0).stop 2024-02-18T11:11:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 shutdown_connections 2024-02-18T11:11:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f147006bc70 0x7f147006e130 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1484145c50 0x7f14840a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14840ba1a0 0x7f148409e6a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 --2- 172.21.15.118:0/1852382017 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1484071f80 0x7f148409f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 >> 172.21.15.118:0/1852382017 conn(0x7f148406bcf0 msgr2=0x7f14840a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 shutdown_connections 2024-02-18T11:11:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.353+0000 7f1489b2e640 1 -- 172.21.15.118:0/1852382017 wait complete. 2024-02-18T11:11:56.365 INFO:tasks.ceph:Scrubbing osd.4 2024-02-18T11:11:56.366 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:56.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.470+0000 7fe1ce40e640 1 Processor -- start 2024-02-18T11:11:56.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.470+0000 7fe1ce40e640 1 -- start start 2024-02-18T11:11:56.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1ce40e640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe1c8149620 0x7fe1c806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1ce40e640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1c80bda30 0x7fe1c8156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1ce40e640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c80c1040 con 0x7fe1c806bf40 2024-02-18T11:11:56.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1ce40e640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80c1290 con 0x7fe1c80bda30 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1ce40e640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80bc270 con 0x7fe1c8149620 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1cc9ab640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1c80bda30 0x7fe1c8156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1cc9ab640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1c80bda30 0x7fe1c8156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36110/0 (socket says 172.21.15.118:36110) 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/994780466 learned_addr learned my addr 172.21.15.118:0/994780466 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1c7fff640 1 --2- 172.21.15.118:0/994780466 >> v2:172.21.15.164:3300/0 conn(0x7fe1c8149620 0x7fe1c806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/994780466 >> v2:172.21.15.164:3300/0 conn(0x7fe1c8149620 msgr2=0x7fe1c806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1cc9ab640 1 --2- 172.21.15.118:0/994780466 >> v2:172.21.15.164:3300/0 conn(0x7fe1c8149620 0x7fe1c806ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/994780466 >> v1:172.21.15.118:6789/0 conn(0x7fe1c806bf40 legacy=0x7fe1c814bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.471+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/994780466 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8149a00 con 0x7fe1c80bda30 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.472+0000 7fe1cc9ab640 1 --2- 172.21.15.118:0/994780466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c80bda30 0x7fe1c8156650 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe1c806ce30 tx=0x7fe1c002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8e636b320b2dc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.472+0000 7fe1c6ffd640 1 -- 172.21.15.118:0/994780466 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c002cb20 con 0x7fe1c80bda30 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.472+0000 7fe1c6ffd640 1 -- 172.21.15.118:0/994780466 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c002cc80 con 0x7fe1c80bda30 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.472+0000 7fe1c6ffd640 1 -- 172.21.15.118:0/994780466 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00343f0 con 0x7fe1c80bda30 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 -- 172.21.15.118:0/994780466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c80bda30 msgr2=0x7fe1c8156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 --2- 172.21.15.118:0/994780466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c80bda30 0x7fe1c8156650 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe1c806ce30 tx=0x7fe1c002bf80 comp rx=0 tx=0).stop 2024-02-18T11:11:56.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 -- 172.21.15.118:0/994780466 shutdown_connections 2024-02-18T11:11:56.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 --2- 172.21.15.118:0/994780466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c80bda30 0x7fe1c8156650 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 --2- 172.21.15.118:0/994780466 >> v2:172.21.15.164:3300/0 conn(0x7fe1c8149620 0x7fe1c806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 -- 172.21.15.118:0/994780466 >> 172.21.15.118:0/994780466 conn(0x7fe1c80be0b0 msgr2=0x7fe1c80be4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 -- 172.21.15.118:0/994780466 shutdown_connections 2024-02-18T11:11:56.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.473+0000 7fe1ce40e640 1 -- 172.21.15.118:0/994780466 wait complete. 2024-02-18T11:11:56.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.474+0000 7fe1ce40e640 1 Processor -- start 2024-02-18T11:11:56.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.474+0000 7fe1ce40e640 1 -- start start 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1c806bf40 0x7fe1c80a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1c80bda30 0x7fe1c80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c8149620 0x7fe1c81e4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80a4ec0 con 0x7fe1c8149620 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80a3910 con 0x7fe1c80bda30 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80a4b70 con 0x7fe1c806bf40 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c8149620 0x7fe1c81e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c8149620 0x7fe1c81e4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36120/0 (socket says 172.21.15.118:36120) 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/2033196270 learned_addr learned my addr 172.21.15.118:0/2033196270 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1c77fe640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1c80bda30 0x7fe1c80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1c7fff640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1c806bf40 0x7fe1c80a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1c806bf40 msgr2=0x7fe1c80a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1c806bf40 0x7fe1c80a33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1c80bda30 msgr2=0x7fe1c80a52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1c80bda30 0x7fe1c80a52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/2033196270 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0009b30 con 0x7fe1c8149620 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1cc9ab640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c8149620 0x7fe1c81e4570 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0036040 tx=0x7fe1c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0007e70 con 0x7fe1c8149620 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0009510 con 0x7fe1c8149620 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c80a6730 con 0x7fe1c8149620 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c003e690 con 0x7fe1c8149620 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.475+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c814a230 con 0x7fe1c8149620 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.476+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1c8146480 con 0x7fe1c8149620 2024-02-18T11:11:56.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.477+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fe1c003e7f0 con 0x7fe1c8149620 2024-02-18T11:11:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.477+0000 7fe1c4ff9640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe1b406bc70 0x7fe1b406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.477+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1c00ad560 con 0x7fe1c8149620 2024-02-18T11:11:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.477+0000 7fe1c7fff640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe1b406bc70 0x7fe1b406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.477+0000 7fe1c4ff9640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7fe1b4071b30 0x7fe1b4073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.477+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 --> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1b4074600 con 0x7fe1b4071b30 2024-02-18T11:11:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.477+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1c00ad9b0 con 0x7fe1c8149620 2024-02-18T11:11:56.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.478+0000 7fe1c77fe640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7fe1b4071b30 0x7fe1b4073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.478+0000 7fe1c7fff640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe1b406bc70 0x7fe1b406e130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006fd0 tx=0x7fe1bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.478+0000 7fe1c77fe640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7fe1b4071b30 0x7fe1b4073f50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.485 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.479+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== osd.4 v2:172.21.15.164:6802/748502063 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe1b4074600 con 0x7fe1b4071b30 2024-02-18T11:11:56.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.492+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 --> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe1c80a0bc0 con 0x7fe1b4071b30 2024-02-18T11:11:56.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.492+0000 7fe1c4ff9640 1 -- 172.21.15.118:0/2033196270 <== osd.4 v2:172.21.15.164:6802/748502063 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe1b80050e0 con 0x7fe1b4071b30 2024-02-18T11:11:56.494 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:56.494 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:56.494 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7fe1b4071b30 msgr2=0x7fe1b4073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.164:6802/748502063,v1:172.21.15.164:6804/748502063] conn(0x7fe1b4071b30 0x7fe1b4073f50 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe1b406bc70 msgr2=0x7fe1b406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fe1b406bc70 0x7fe1b406e130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006fd0 tx=0x7fe1bc008040 comp rx=0 tx=0).stop 2024-02-18T11:11:56.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c8149620 msgr2=0x7fe1c81e4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 --2- 172.21.15.118:0/2033196270 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1c8149620 0x7fe1c81e4570 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0036040 tx=0x7fe1c0004a40 comp rx=0 tx=0).stop 2024-02-18T11:11:56.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1cc9ab640 1 -- 172.21.15.118:0/2033196270 reap_dead start 2024-02-18T11:11:56.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 shutdown_connections 2024-02-18T11:11:56.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 >> 172.21.15.118:0/2033196270 conn(0x7fe1c80be0b0 msgr2=0x7fe1c814a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 shutdown_connections 2024-02-18T11:11:56.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.493+0000 7fe1ce40e640 1 -- 172.21.15.118:0/2033196270 wait complete. 2024-02-18T11:11:56.505 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-18T11:11:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.604+0000 7febe9ef2640 1 Processor -- start 2024-02-18T11:11:56.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.604+0000 7febe9ef2640 1 -- start start 2024-02-18T11:11:56.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febe9ef2640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7febe40bc0a0 0x7febe40b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febe9ef2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe414a0d0 0x7febe414a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febe9ef2640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe4149c40 con 0x7febe406fda0 2024-02-18T11:11:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febe9ef2640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe414aa60 con 0x7febe40bc0a0 2024-02-18T11:11:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febe9ef2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40b5b60 con 0x7febe414a0d0 2024-02-18T11:11:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febe37fe640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7febe40bc0a0 0x7febe40b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febe3fff640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe414a0d0 0x7febe414a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febdaffd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7febe406fda0 0x7febe4143b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.118:55204/0 (socket says 172.21.15.118:55204) 2024-02-18T11:11:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.605+0000 7febdaffd640 1 -- 172.21.15.118:0/3416609550 learned_addr learned my addr 172.21.15.118:0/3416609550 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.606+0000 7febe37fe640 1 -- 172.21.15.118:0/3416609550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe414a0d0 msgr2=0x7febe414a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.606+0000 7febe37fe640 1 --2- 172.21.15.118:0/3416609550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe414a0d0 0x7febe414a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.606+0000 7febe37fe640 1 -- 172.21.15.118:0/3416609550 >> v1:172.21.15.164:6789/0 conn(0x7febe406fda0 legacy=0x7febe4143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.606+0000 7febe37fe640 1 -- 172.21.15.118:0/3416609550 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40b5e40 con 0x7febe40bc0a0 2024-02-18T11:11:56.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.606+0000 7febe37fe640 1 --2- 172.21.15.118:0/3416609550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe40bc0a0 0x7febe40b5540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7febd40097a0 tx=0x7febd402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb1192c79133513e server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe2ffd640 1 -- 172.21.15.118:0/3416609550 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4030610 con 0x7febe40bc0a0 2024-02-18T11:11:56.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe2ffd640 1 -- 172.21.15.118:0/3416609550 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4030770 con 0x7febe40bc0a0 2024-02-18T11:11:56.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe2ffd640 1 -- 172.21.15.118:0/3416609550 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4030b00 con 0x7febe40bc0a0 2024-02-18T11:11:56.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 -- 172.21.15.118:0/3416609550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe40bc0a0 msgr2=0x7febe40b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 --2- 172.21.15.118:0/3416609550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe40bc0a0 0x7febe40b5540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7febd40097a0 tx=0x7febd402b960 comp rx=0 tx=0).stop 2024-02-18T11:11:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 -- 172.21.15.118:0/3416609550 shutdown_connections 2024-02-18T11:11:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 --2- 172.21.15.118:0/3416609550 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe414a0d0 0x7febe414a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 --2- 172.21.15.118:0/3416609550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe40bc0a0 0x7febe40b5540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 -- 172.21.15.118:0/3416609550 >> 172.21.15.118:0/3416609550 conn(0x7febe40bf330 msgr2=0x7febe40bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.613 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 -- 172.21.15.118:0/3416609550 shutdown_connections 2024-02-18T11:11:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.607+0000 7febe9ef2640 1 -- 172.21.15.118:0/3416609550 wait complete. 2024-02-18T11:11:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.608+0000 7febe9ef2640 1 Processor -- start 2024-02-18T11:11:56.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe9ef2640 1 -- start start 2024-02-18T11:11:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe9ef2640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febe406fda0 0x7febe406bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe9ef2640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe40bc0a0 0x7febe406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe9ef2640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe414a0d0 0x7febe406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe9ef2640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe413ae80 con 0x7febe406fda0 2024-02-18T11:11:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe9ef2640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe406c4a0 con 0x7febe414a0d0 2024-02-18T11:11:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe9ef2640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe406dda0 con 0x7febe40bc0a0 2024-02-18T11:11:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febe406fda0 0x7febe406bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe37fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febe406fda0 0x7febe406bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36136/0 (socket says 172.21.15.118:36136) 2024-02-18T11:11:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe37fe640 1 -- 172.21.15.118:0/1664543827 learned_addr learned my addr 172.21.15.118:0/1664543827 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:56.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febe3fff640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe414a0d0 0x7febe406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.609+0000 7febdaffd640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe40bc0a0 0x7febe406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe37fe640 1 -- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe40bc0a0 msgr2=0x7febe406c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe37fe640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe40bc0a0 0x7febe406c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe37fe640 1 -- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe414a0d0 msgr2=0x7febe406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe37fe640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe414a0d0 0x7febe406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe37fe640 1 -- 172.21.15.118:0/1664543827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009400 con 0x7febe406fda0 2024-02-18T11:11:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe37fe640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febe406fda0 0x7febe406bf60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7febd4009890 tx=0x7febd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe0ff9640 1 -- 172.21.15.118:0/1664543827 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd403e040 con 0x7febe406fda0 2024-02-18T11:11:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe0ff9640 1 -- 172.21.15.118:0/1664543827 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4039ce0 con 0x7febe406fda0 2024-02-18T11:11:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe0ff9640 1 -- 172.21.15.118:0/1664543827 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4043680 con 0x7febe406fda0 2024-02-18T11:11:56.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe406db20 con 0x7febe406fda0 2024-02-18T11:11:56.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.610+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe406d700 con 0x7febe406fda0 2024-02-18T11:11:56.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.611+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe413afc0 con 0x7febe406fda0 2024-02-18T11:11:56.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.612+0000 7febe0ff9640 1 -- 172.21.15.118:0/1664543827 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7febd40423e0 con 0x7febe406fda0 2024-02-18T11:11:56.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.612+0000 7febe0ff9640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febc406bc70 0x7febc406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.612+0000 7febdaffd640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febc406bc70 0x7febc406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.612+0000 7febe0ff9640 1 -- 172.21.15.118:0/1664543827 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7febd40ac760 con 0x7febe406fda0 2024-02-18T11:11:56.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.613+0000 7febdaffd640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febc406bc70 0x7febc406e130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7febe413b790 tx=0x7febcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.616+0000 7febe0ff9640 1 -- 172.21.15.118:0/1664543827 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febe413afc0 con 0x7febe406fda0 2024-02-18T11:11:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.789+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7febe40bc480 con 0x7febc406bc70 2024-02-18T11:11:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.789+0000 7febe0ff9640 1 -- 172.21.15.118:0/1664543827 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7febcc001330 con 0x7febc406bc70 2024-02-18T11:11:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 4 to deep-scrub 2024-02-18T11:11:56.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febc406bc70 msgr2=0x7febc406e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febc406bc70 0x7febc406e130 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7febe413b790 tx=0x7febcc009040 comp rx=0 tx=0).stop 2024-02-18T11:11:56.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febe406fda0 msgr2=0x7febe406bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febe406fda0 0x7febe406bf60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7febd4009890 tx=0x7febd4004730 comp rx=0 tx=0).stop 2024-02-18T11:11:56.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 shutdown_connections 2024-02-18T11:11:56.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7febc406bc70 0x7febc406e130 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7febe414a0d0 0x7febe406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7febe40bc0a0 0x7febe406c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 --2- 172.21.15.118:0/1664543827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febe406fda0 0x7febe406bf60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 >> 172.21.15.118:0/1664543827 conn(0x7febe40bf330 msgr2=0x7febe40bb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 shutdown_connections 2024-02-18T11:11:56.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.791+0000 7febe9ef2640 1 -- 172.21.15.118:0/1664543827 wait complete. 2024-02-18T11:11:56.803 INFO:tasks.ceph:Scrubbing osd.5 2024-02-18T11:11:56.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:56.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.906+0000 7f6ec188d640 1 Processor -- start 2024-02-18T11:11:56.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ec188d640 1 -- start start 2024-02-18T11:11:56.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ec188d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc072e90 0x7f6ebc14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ec188d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc14c710 con 0x7f6ebc0b8a20 2024-02-18T11:11:56.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ec188d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc14f570 con 0x7f6ebc14c2d0 2024-02-18T11:11:56.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ec188d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b9750 con 0x7f6ebc072e90 2024-02-18T11:11:56.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ebb7fe640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6ebc0b8a20 0x7f6ebc1564c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47166/0 (socket says 172.21.15.118:47166) 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ebb7fe640 1 -- 172.21.15.118:0/2199036734 learned_addr learned my addr 172.21.15.118:0/2199036734 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.907+0000 7f6ebaffd640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc072e90 0x7f6ebc14bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570376872 0 0) 0x7f6ebc14c710 con 0x7f6ebc0b8a20 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea4003520 con 0x7f6ebc0b8a20 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953645986 0 0) 0x7f6ebc14f570 con 0x7f6ebc14c2d0 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ebc14c710 con 0x7f6ebc14c2d0 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652790167 0 0) 0x7f6ea4003520 con 0x7f6ebc0b8a20 2024-02-18T11:11:56.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc072e90 msgr2=0x7f6ebc14bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc072e90 0x7f6ebc14bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 >> v1:172.21.15.164:6789/0 conn(0x7f6ebc14c2d0 legacy=0x7f6ebc0b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc14f850 con 0x7f6ebc0b8a20 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f6eb40019f0 con 0x7f6ebc0b8a20 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 >> v1:172.21.15.118:6789/0 conn(0x7f6ebc0b8a20 legacy=0x7f6ebc1564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ea4003b30 0x7f6ea4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ea40047c0 0x7f6ea4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea4005180 0x7f6ea400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea400bfc0 con 0x7f6ea4005180 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea400c130 con 0x7f6ea40047c0 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea400c2f0 con 0x7f6ea4003b30 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebaffd640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc072e90 0x7f6ebc14bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebb7fe640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea4005180 0x7f6ea400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6eba7fc640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ea40047c0 0x7f6ea4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebaffd640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ea4003b30 0x7f6ea4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebb7fe640 1 -- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ea4003b30 msgr2=0x7f6ea4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebb7fe640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ea4003b30 0x7f6ea4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebb7fe640 1 -- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ea40047c0 msgr2=0x7f6ea4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:56.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebb7fe640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ea40047c0 0x7f6ea4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.908+0000 7f6ebb7fe640 1 -- 172.21.15.118:0/2199036734 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4003520 con 0x7f6ea4005180 2024-02-18T11:11:56.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.909+0000 7f6ebb7fe640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea4005180 0x7f6ea400b980 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400a7c0 tx=0x7f6ea40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5154abafd68b61d server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.909+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4034630 con 0x7f6ea4005180 2024-02-18T11:11:56.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.909+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb402f070 con 0x7f6ea4005180 2024-02-18T11:11:56.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.909+0000 7f6eb9ffb640 1 -- 172.21.15.118:0/2199036734 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4034a30 con 0x7f6ea4005180 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.910+0000 7f6ec188d640 1 -- 172.21.15.118:0/2199036734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea4005180 msgr2=0x7f6ea400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.910+0000 7f6ec188d640 1 --2- 172.21.15.118:0/2199036734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea4005180 0x7f6ea400b980 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400a7c0 tx=0x7f6ea40057f0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.910+0000 7f6ebb7fe640 1 -- 172.21.15.118:0/2199036734 reap_dead start 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.910+0000 7f6ec188d640 1 -- 172.21.15.118:0/2199036734 shutdown_connections 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.910+0000 7f6ec188d640 1 -- 172.21.15.118:0/2199036734 >> 172.21.15.118:0/2199036734 conn(0x7f6ebc09f3b0 msgr2=0x7f6ebc09f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.910+0000 7f6ec188d640 1 -- 172.21.15.118:0/2199036734 shutdown_connections 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.910+0000 7f6ec188d640 1 -- 172.21.15.118:0/2199036734 wait complete. 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.911+0000 7f6ec188d640 1 Processor -- start 2024-02-18T11:11:56.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.911+0000 7f6ec188d640 1 -- start start 2024-02-18T11:11:56.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ebc14e660 0x7f6ebc0a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ebc1e4a50 0x7f6ebc0a2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc0b6db0 0x7f6ebc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0a2570 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.921 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0a1ba0 con 0x7f6ebc14e660 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc071f50 con 0x7f6ebc0b6db0 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ebc1e4a50 0x7f6ebc0a2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ebc1e4a50 0x7f6ebc0a2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36154/0 (socket says 172.21.15.118:36154) 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 -- 172.21.15.118:0/2913556266 learned_addr learned my addr 172.21.15.118:0/2913556266 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ebaffd640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ebc14e660 0x7f6ebc0a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ebb7fe640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc0b6db0 0x7f6ebc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 -- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc0b6db0 msgr2=0x7f6ebc0b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.922 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6ebc0b6db0 0x7f6ebc0b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 -- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ebc14e660 msgr2=0x7f6ebc0a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ebc14e660 0x7f6ebc0a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 -- 172.21.15.118:0/2913556266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0721f0 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6eba7fc640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ebc1e4a50 0x7f6ebc0a2e30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00f7a0 tx=0x7f6eac00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0014a0 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0050d0 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc0a3370 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac005480 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.912+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc149740 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.913+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ebc14fe10 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.914+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f6eac00d6d0 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.914+0000 7f6ea3fff640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6ea806bc70 0x7f6ea806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.914+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6eac08a2d0 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.914+0000 7f6ebaffd640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6ea806bc70 0x7f6ea806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.914+0000 7f6ea3fff640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f6ea8071b30 0x7f6ea8073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.914+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 --> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ea8074600 con 0x7f6ea8071b30 2024-02-18T11:11:56.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.914+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eac08c990 con 0x7f6ebc1e4a50 2024-02-18T11:11:56.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.915+0000 7f6ebb7fe640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f6ea8071b30 0x7f6ea8073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:56.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.915+0000 7f6ebaffd640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6ea806bc70 0x7f6ea806e130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0688e0 tx=0x7f6eb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.915+0000 7f6ebb7fe640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f6ea8071b30 0x7f6ea8073f50 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:56.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.916+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== osd.5 v2:172.21.15.164:6800/2574652314 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6ea8074600 con 0x7f6ea8071b30 2024-02-18T11:11:56.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.941+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 --> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6ebc14f190 con 0x7f6ea8071b30 2024-02-18T11:11:56.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.941+0000 7f6ea3fff640 1 -- 172.21.15.118:0/2913556266 <== osd.5 v2:172.21.15.164:6800/2574652314 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6eb4001440 con 0x7f6ea8071b30 2024-02-18T11:11:56.945 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:56.945 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:56.945 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:56.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.941+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f6ea8071b30 msgr2=0x7f6ea8073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.941+0000 7f6ec188d640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.164:6800/2574652314,v1:172.21.15.164:6801/2574652314] conn(0x7f6ea8071b30 0x7f6ea8073f50 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6ea806bc70 msgr2=0x7f6ea806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f6ea806bc70 0x7f6ea806e130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0688e0 tx=0x7f6eb0008040 comp rx=0 tx=0).stop 2024-02-18T11:11:56.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ebc1e4a50 msgr2=0x7f6ebc0a2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:56.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 --2- 172.21.15.118:0/2913556266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ebc1e4a50 0x7f6ebc0a2e30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00f7a0 tx=0x7f6eac00fba0 comp rx=0 tx=0).stop 2024-02-18T11:11:56.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ebb7fe640 1 -- 172.21.15.118:0/2913556266 reap_dead start 2024-02-18T11:11:56.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 shutdown_connections 2024-02-18T11:11:56.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 >> 172.21.15.118:0/2913556266 conn(0x7f6ebc09f3b0 msgr2=0x7f6ebc0b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:56.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 shutdown_connections 2024-02-18T11:11:56.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:56.942+0000 7f6ec188d640 1 -- 172.21.15.118:0/2913556266 wait complete. 2024-02-18T11:11:56.955 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-18T11:11:57.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.054+0000 7efe63c4d640 1 Processor -- start 2024-02-18T11:11:57.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.054+0000 7efe63c4d640 1 -- start start 2024-02-18T11:11:57.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe63c4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe63c4d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c070fe0 con 0x7efe5c06f0b0 2024-02-18T11:11:57.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe63c4d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c072e50 con 0x7efe5c071f80 2024-02-18T11:11:57.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe63c4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c06e0b0 con 0x7efe5c0ba1a0 2024-02-18T11:11:57.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe621ea640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7efe5c06f0b0 0x7efe5c145c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47180/0 (socket says 172.21.15.118:47180) 2024-02-18T11:11:57.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe621ea640 1 -- 172.21.15.118:0/284565824 learned_addr learned my addr 172.21.15.118:0/284565824 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:57.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe611e8640 1 --2- 172.21.15.118:0/284565824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe609e7640 1 -- 172.21.15.118:0/284565824 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276123745 0 0) 0x7efe5c070fe0 con 0x7efe5c06f0b0 2024-02-18T11:11:57.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe609e7640 1 -- 172.21.15.118:0/284565824 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe48003520 con 0x7efe5c06f0b0 2024-02-18T11:11:57.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe609e7640 1 -- 172.21.15.118:0/284565824 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534982240 0 0) 0x7efe5c072e50 con 0x7efe5c071f80 2024-02-18T11:11:57.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe609e7640 1 -- 172.21.15.118:0/284565824 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe5c070fe0 con 0x7efe5c071f80 2024-02-18T11:11:57.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe611e8640 1 -- 172.21.15.118:0/284565824 >> v1:172.21.15.164:6789/0 conn(0x7efe5c071f80 legacy=0x7efe5c072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.055+0000 7efe611e8640 1 -- 172.21.15.118:0/284565824 >> v1:172.21.15.118:6789/0 conn(0x7efe5c06f0b0 legacy=0x7efe5c145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.056+0000 7efe611e8640 1 -- 172.21.15.118:0/284565824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c071280 con 0x7efe5c0ba1a0 2024-02-18T11:11:57.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.056+0000 7efe611e8640 1 --2- 172.21.15.118:0/284565824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c06eb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe580097d0 tx=0x7efe5802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b738fdc32056ec7f server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.056+0000 7efe609e7640 1 -- 172.21.15.118:0/284565824 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58030880 con 0x7efe5c0ba1a0 2024-02-18T11:11:57.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe609e7640 1 -- 172.21.15.118:0/284565824 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580309e0 con 0x7efe5c0ba1a0 2024-02-18T11:11:57.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe609e7640 1 -- 172.21.15.118:0/284565824 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58030d70 con 0x7efe5c0ba1a0 2024-02-18T11:11:57.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe63c4d640 1 -- 172.21.15.118:0/284565824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 msgr2=0x7efe5c06eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe63c4d640 1 --2- 172.21.15.118:0/284565824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c06eb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe580097d0 tx=0x7efe5802b9c0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe63c4d640 1 -- 172.21.15.118:0/284565824 shutdown_connections 2024-02-18T11:11:57.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe63c4d640 1 --2- 172.21.15.118:0/284565824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c06eb70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe63c4d640 1 -- 172.21.15.118:0/284565824 >> 172.21.15.118:0/284565824 conn(0x7efe5c06bcf0 msgr2=0x7efe5c06c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe63c4d640 1 -- 172.21.15.118:0/284565824 shutdown_connections 2024-02-18T11:11:57.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.057+0000 7efe63c4d640 1 -- 172.21.15.118:0/284565824 wait complete. 2024-02-18T11:11:57.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.058+0000 7efe63c4d640 1 Processor -- start 2024-02-18T11:11:57.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.058+0000 7efe63c4d640 1 -- start start 2024-02-18T11:11:57.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe63c4d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe5c06f0b0 0x7efe5c0a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe63c4d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe5c071f80 0x7efe5c09f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe63c4d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c1e5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe63c4d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c14d750 con 0x7efe5c06f0b0 2024-02-18T11:11:57.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe63c4d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c14e420 con 0x7efe5c071f80 2024-02-18T11:11:57.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe63c4d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c09fea0 con 0x7efe5c0ba1a0 2024-02-18T11:11:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe5c06f0b0 0x7efe5c0a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe5c06f0b0 0x7efe5c0a0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36160/0 (socket says 172.21.15.118:36160) 2024-02-18T11:11:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 -- 172.21.15.118:0/3330190100 learned_addr learned my addr 172.21.15.118:0/3330190100 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe611e8640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe5c071f80 0x7efe5c09f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe621ea640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c1e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 -- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 msgr2=0x7efe5c1e5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c1e5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 -- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe5c071f80 msgr2=0x7efe5c09f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe5c071f80 0x7efe5c09f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 -- 172.21.15.118:0/3330190100 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009400 con 0x7efe5c06f0b0 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe611e8640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe5c071f80 0x7efe5c09f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.059+0000 7efe619e9640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe5c06f0b0 0x7efe5c0a0870 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c490 tx=0x7efe4c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.060+0000 7efe527fc640 1 -- 172.21.15.118:0/3330190100 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0052d0 con 0x7efe5c06f0b0 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.060+0000 7efe527fc640 1 -- 172.21.15.118:0/3330190100 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c005430 con 0x7efe5c06f0b0 2024-02-18T11:11:57.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.060+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c1e5c40 con 0x7efe5c06f0b0 2024-02-18T11:11:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.060+0000 7efe527fc640 1 -- 172.21.15.118:0/3330190100 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c012870 con 0x7efe5c06f0b0 2024-02-18T11:11:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.060+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c09f000 con 0x7efe5c06f0b0 2024-02-18T11:11:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.061+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c1e6160 con 0x7efe5c06f0b0 2024-02-18T11:11:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.061+0000 7efe527fc640 1 -- 172.21.15.118:0/3330190100 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7efe4c0129d0 con 0x7efe5c06f0b0 2024-02-18T11:11:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.062+0000 7efe527fc640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe4006bc70 0x7efe4006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.062+0000 7efe527fc640 1 -- 172.21.15.118:0/3330190100 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efe4c08a070 con 0x7efe5c06f0b0 2024-02-18T11:11:57.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.062+0000 7efe611e8640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe4006bc70 0x7efe4006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.062+0000 7efe611e8640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe4006bc70 0x7efe4006e130 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efe58036000 tx=0x7efe58008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.070+0000 7efe527fc640 1 -- 172.21.15.118:0/3330190100 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe5c1e6160 con 0x7efe5c06f0b0 2024-02-18T11:11:57.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.241+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7efe5c072360 con 0x7efe4006bc70 2024-02-18T11:11:57.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.241+0000 7efe527fc640 1 -- 172.21.15.118:0/3330190100 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efe58030680 con 0x7efe4006bc70 2024-02-18T11:11:57.242 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 5 to deep-scrub 2024-02-18T11:11:57.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe4006bc70 msgr2=0x7efe4006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe4006bc70 0x7efe4006e130 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efe58036000 tx=0x7efe58008030 comp rx=0 tx=0).stop 2024-02-18T11:11:57.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe5c06f0b0 msgr2=0x7efe5c0a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe5c06f0b0 0x7efe5c0a0870 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c490 tx=0x7efe4c00c950 comp rx=0 tx=0).stop 2024-02-18T11:11:57.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 shutdown_connections 2024-02-18T11:11:57.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7efe4006bc70 0x7efe4006e130 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efe5c0ba1a0 0x7efe5c1e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe5c071f80 0x7efe5c09f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 --2- 172.21.15.118:0/3330190100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe5c06f0b0 0x7efe5c0a0870 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 >> 172.21.15.118:0/3330190100 conn(0x7efe5c06bcf0 msgr2=0x7efe5c0a29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 shutdown_connections 2024-02-18T11:11:57.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.243+0000 7efe63c4d640 1 -- 172.21.15.118:0/3330190100 wait complete. 2024-02-18T11:11:57.255 INFO:tasks.ceph:Scrubbing osd.6 2024-02-18T11:11:57.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:57.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 Processor -- start 2024-02-18T11:11:57.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 -- start start 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2ee80a14c0 0x7f2ee80be690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ee80beff0 0x7f2ee806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee8145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee81460b0 con 0x7f2ee80beff0 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee80bebd0 con 0x7f2ee80a14c0 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.359+0000 7f2eec815640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee814bcc0 con 0x7f2ee8145720 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ee80beff0 0x7f2ee806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ee80beff0 0x7f2ee806eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36174/0 (socket says 172.21.15.118:36174) 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/3754570265 learned_addr learned my addr 172.21.15.118:0/3754570265 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee659c640 1 --2- 172.21.15.118:0/3754570265 >> v2:172.21.15.164:3300/0 conn(0x7f2ee80a14c0 0x7f2ee80be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee6d9d640 1 --2- 172.21.15.118:0/3754570265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee8145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/3754570265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 msgr2=0x7f2ee8145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 --2- 172.21.15.118:0/3754570265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee8145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/3754570265 >> v2:172.21.15.164:3300/0 conn(0x7f2ee80a14c0 msgr2=0x7f2ee80be690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 --2- 172.21.15.118:0/3754570265 >> v2:172.21.15.164:3300/0 conn(0x7f2ee80a14c0 0x7f2ee80be690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/3754570265 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee814bfa0 con 0x7f2ee80beff0 2024-02-18T11:11:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee6d9d640 1 --2- 172.21.15.118:0/3754570265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee8145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.360+0000 7f2ee659c640 1 --2- 172.21.15.118:0/3754570265 >> v2:172.21.15.164:3300/0 conn(0x7f2ee80a14c0 0x7f2ee80be690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:57.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.361+0000 7f2ee5d9b640 1 --2- 172.21.15.118:0/3754570265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee806eac0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80bd040 tx=0x7f2ed802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6cfcc446dc0b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.361+0000 7f2ee559a640 1 -- 172.21.15.118:0/3754570265 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8030860 con 0x7f2ee80beff0 2024-02-18T11:11:57.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.361+0000 7f2ee559a640 1 -- 172.21.15.118:0/3754570265 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80309c0 con 0x7f2ee80beff0 2024-02-18T11:11:57.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.361+0000 7f2ee559a640 1 -- 172.21.15.118:0/3754570265 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8030d50 con 0x7f2ee80beff0 2024-02-18T11:11:57.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 -- 172.21.15.118:0/3754570265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 msgr2=0x7f2ee806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 --2- 172.21.15.118:0/3754570265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee806eac0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80bd040 tx=0x7f2ed802b9a0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 -- 172.21.15.118:0/3754570265 shutdown_connections 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 --2- 172.21.15.118:0/3754570265 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee8145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 --2- 172.21.15.118:0/3754570265 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee806eac0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 --2- 172.21.15.118:0/3754570265 >> v2:172.21.15.164:3300/0 conn(0x7f2ee80a14c0 0x7f2ee80be690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 -- 172.21.15.118:0/3754570265 >> 172.21.15.118:0/3754570265 conn(0x7f2ee80bf510 msgr2=0x7f2ee80bf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 -- 172.21.15.118:0/3754570265 shutdown_connections 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.362+0000 7f2eec815640 1 -- 172.21.15.118:0/3754570265 wait complete. 2024-02-18T11:11:57.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.363+0000 7f2eec815640 1 Processor -- start 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.363+0000 7f2eec815640 1 -- start start 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2eec815640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ee80a14c0 0x7f2ee81e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2eec815640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee8146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2eec815640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee81446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2eec815640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee81e5ca0 con 0x7f2ee80beff0 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2eec815640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee814d050 con 0x7f2ee80a14c0 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2eec815640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee81e5510 con 0x7f2ee8145720 2024-02-18T11:11:57.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee8146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee8146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36176/0 (socket says 172.21.15.118:36176) 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/500713872 learned_addr learned my addr 172.21.15.118:0/500713872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee659c640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ee80a14c0 0x7f2ee81e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee6d9d640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee81446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 msgr2=0x7f2ee81446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee81446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ee80a14c0 msgr2=0x7f2ee81e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ee80a14c0 0x7f2ee81e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 -- 172.21.15.118:0/500713872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80094d0 con 0x7f2ee80beff0 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee6d9d640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ee8145720 0x7f2ee81446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ee5d9b640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee8146250 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2ed802b9e0 tx=0x7f2ed8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8039c90 con 0x7f2ee80beff0 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8039df0 con 0x7f2ee80beff0 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee814e6f0 con 0x7f2ee80beff0 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.364+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8044680 con 0x7f2ee80beff0 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.365+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee81e5780 con 0x7f2ee80beff0 2024-02-18T11:11:57.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.365+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ee8145f40 con 0x7f2ee80beff0 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.366+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f2ed804d3b0 con 0x7f2ee80beff0 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.366+0000 7f2ed6ffd640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2ec806bc70 0x7f2ec806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.366+0000 7f2ee659c640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2ec806bc70 0x7f2ec806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.366+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ed803e070 con 0x7f2ee80beff0 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.367+0000 7f2ed6ffd640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f2ec8071b30 0x7f2ec8073f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.367+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 --> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ec8074600 con 0x7f2ec8071b30 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.367+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed80ada70 con 0x7f2ee80beff0 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.367+0000 7f2ee659c640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2ec806bc70 0x7f2ec806e130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8149940 tx=0x7f2edc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.367+0000 7f2ee6d9d640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f2ec8071b30 0x7f2ec8073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.367+0000 7f2ee6d9d640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f2ec8071b30 0x7f2ec8073f50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.368+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== osd.6 v2:172.21.15.164:6816/3123231040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2ec8074600 con 0x7f2ec8071b30 2024-02-18T11:11:57.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.381+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 --> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ee80a05f0 con 0x7f2ec8071b30 2024-02-18T11:11:57.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2ed6ffd640 1 -- 172.21.15.118:0/500713872 <== osd.6 v2:172.21.15.164:6816/3123231040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2ee80a05f0 con 0x7f2ec8071b30 2024-02-18T11:11:57.383 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:57.383 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:57.383 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:57.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f2ec8071b30 msgr2=0x7f2ec8073f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.164:6816/3123231040,v1:172.21.15.164:6817/3123231040] conn(0x7f2ec8071b30 0x7f2ec8073f50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2ec806bc70 msgr2=0x7f2ec806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f2ec806bc70 0x7f2ec806e130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8149940 tx=0x7f2edc008040 comp rx=0 tx=0).stop 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 msgr2=0x7f2ee8146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 --2- 172.21.15.118:0/500713872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ee80beff0 0x7f2ee8146250 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2ed802b9e0 tx=0x7f2ed8004730 comp rx=0 tx=0).stop 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2ee6d9d640 1 -- 172.21.15.118:0/500713872 reap_dead start 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 shutdown_connections 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 >> 172.21.15.118:0/500713872 conn(0x7f2ee80bf510 msgr2=0x7f2ee806eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 shutdown_connections 2024-02-18T11:11:57.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.382+0000 7f2eec815640 1 -- 172.21.15.118:0/500713872 wait complete. 2024-02-18T11:11:57.395 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-18T11:11:57.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.495+0000 7f3069f9a640 1 Processor -- start 2024-02-18T11:11:57.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.495+0000 7f3069f9a640 1 -- start start 2024-02-18T11:11:57.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.496+0000 7f3069f9a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 0x7f3064155310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.496+0000 7f3069f9a640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30640b4f90 con 0x7f30640a0ce0 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.496+0000 7f3069f9a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30641441f0 con 0x7f3064143e10 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.496+0000 7f3069f9a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3064072fe0 con 0x7f30640ba180 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.496+0000 7f3062ffd640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f30640a0ce0 0x7f306414cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47190/0 (socket says 172.21.15.118:47190) 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.496+0000 7f3062ffd640 1 -- 172.21.15.118:0/2290438799 learned_addr learned my addr 172.21.15.118:0/2290438799 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989556624 0 0) 0x7f30640b4f90 con 0x7f30640a0ce0 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f3063fff640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 0x7f3064155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f304c003520 con 0x7f30640a0ce0 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2445770700 0 0) 0x7f304c003520 con 0x7f30640a0ce0 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 msgr2=0x7f3064155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 0x7f3064155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 >> v1:172.21.15.164:6789/0 conn(0x7f3064143e10 legacy=0x7f3064070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640716f0 con 0x7f30640a0ce0 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f3058001670 con 0x7f30640a0ce0 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 >> v1:172.21.15.118:6789/0 conn(0x7f30640a0ce0 legacy=0x7f306414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f304c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 0x7f304c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f304c004d00 0x7f304c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3064072fe0 con 0x7f304c0039a0 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c00baf0 con 0x7f304c004d00 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c00bcb0 con 0x7f30640ba180 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30637fe640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f304c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f3062ffd640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 0x7f304c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f3063fff640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f304c004d00 0x7f304c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30637fe640 1 -- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 msgr2=0x7f304c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30637fe640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30640ba180 0x7f304c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30637fe640 1 -- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f304c004d00 msgr2=0x7f304c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30637fe640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f304c004d00 0x7f304c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.497+0000 7f30637fe640 1 -- 172.21.15.118:0/2290438799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c003520 con 0x7f304c0039a0 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.498+0000 7f30637fe640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f304c003dc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3054001720 tx=0x7f304c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c634dd765bfef6 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540052d0 con 0x7f304c0039a0 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305402e050 con 0x7f304c0039a0 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f30627fc640 1 -- 172.21.15.118:0/2290438799 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540035f0 con 0x7f304c0039a0 2024-02-18T11:11:57.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f3069f9a640 1 -- 172.21.15.118:0/2290438799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 msgr2=0x7f304c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f3069f9a640 1 --2- 172.21.15.118:0/2290438799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f304c003dc0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3054001720 tx=0x7f304c0057f0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f3063fff640 1 -- 172.21.15.118:0/2290438799 reap_dead start 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f3069f9a640 1 -- 172.21.15.118:0/2290438799 shutdown_connections 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f3069f9a640 1 -- 172.21.15.118:0/2290438799 >> 172.21.15.118:0/2290438799 conn(0x7f306406bcf0 msgr2=0x7f306406c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f3069f9a640 1 -- 172.21.15.118:0/2290438799 shutdown_connections 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.499+0000 7f3069f9a640 1 -- 172.21.15.118:0/2290438799 wait complete. 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.500+0000 7f3069f9a640 1 Processor -- start 2024-02-18T11:11:57.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.500+0000 7f3069f9a640 1 -- start start 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f3069f9a640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f30641428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f3069f9a640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30640b7f10 0x7f30640b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f3069f9a640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306413b4c0 0x7f306413b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f3069f9a640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640b5ea0 con 0x7f304c0039a0 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f3069f9a640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3064142e30 con 0x7f30640b7f10 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f3069f9a640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306414c7e0 con 0x7f306413b4c0 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f30637fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f30641428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f30637fe640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f30641428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36196/0 (socket says 172.21.15.118:36196) 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.501+0000 7f30637fe640 1 -- 172.21.15.118:0/2172544545 learned_addr learned my addr 172.21.15.118:0/2172544545 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f3062ffd640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30640b7f10 0x7f30640b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f3063fff640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306413b4c0 0x7f306413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f30637fe640 1 -- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306413b4c0 msgr2=0x7f306413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f30637fe640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306413b4c0 0x7f306413b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f30637fe640 1 -- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30640b7f10 msgr2=0x7f30640b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f30637fe640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30640b7f10 0x7f30640b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f30637fe640 1 -- 172.21.15.118:0/2172544545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640b5b00 con 0x7f304c0039a0 2024-02-18T11:11:57.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f3062ffd640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30640b7f10 0x7f30640b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f30637fe640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f30641428f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3054008fd0 tx=0x7f3054001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f304bfff640 1 -- 172.21.15.118:0/2172544545 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540076c0 con 0x7f304c0039a0 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f304bfff640 1 -- 172.21.15.118:0/2172544545 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054007a30 con 0x7f304c0039a0 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306414c1b0 con 0x7f304c0039a0 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f304bfff640 1 -- 172.21.15.118:0/2172544545 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054006c00 con 0x7f304c0039a0 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.502+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306413be90 con 0x7f304c0039a0 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.503+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3064074af0 con 0x7f304c0039a0 2024-02-18T11:11:57.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.504+0000 7f304bfff640 1 -- 172.21.15.118:0/2172544545 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f30540035f0 con 0x7f304c0039a0 2024-02-18T11:11:57.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.504+0000 7f304bfff640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f305006bca0 0x7f305006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.504+0000 7f3062ffd640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f305006bca0 0x7f305006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.504+0000 7f304bfff640 1 -- 172.21.15.118:0/2172544545 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f30540ac1f0 con 0x7f304c0039a0 2024-02-18T11:11:57.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.505+0000 7f3062ffd640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f305006bca0 0x7f305006e160 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3058001b40 tx=0x7f3058009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.508+0000 7f304bfff640 1 -- 172.21.15.118:0/2172544545 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3054076d60 con 0x7f304c0039a0 2024-02-18T11:11:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.684+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f3064072b10 con 0x7f305006bca0 2024-02-18T11:11:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.684+0000 7f304bfff640 1 -- 172.21.15.118:0/2172544545 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3064072b10 con 0x7f305006bca0 2024-02-18T11:11:57.686 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 6 to deep-scrub 2024-02-18T11:11:57.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f305006bca0 msgr2=0x7f305006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f305006bca0 0x7f305006e160 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3058001b40 tx=0x7f3058009040 comp rx=0 tx=0).stop 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 msgr2=0x7f30641428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f30641428f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3054008fd0 tx=0x7f3054001120 comp rx=0 tx=0).stop 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 shutdown_connections 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f305006bca0 0x7f305006e160 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f306413b4c0 0x7f306413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30640b7f10 0x7f30640b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 --2- 172.21.15.118:0/2172544545 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f304c0039a0 0x7f30641428f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 >> 172.21.15.118:0/2172544545 conn(0x7f306406bcf0 msgr2=0x7f30640b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 shutdown_connections 2024-02-18T11:11:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.686+0000 7f3069f9a640 1 -- 172.21.15.118:0/2172544545 wait complete. 2024-02-18T11:11:57.699 INFO:tasks.ceph:Scrubbing osd.7 2024-02-18T11:11:57.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-18T11:11:57.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.802+0000 7f84db640640 1 Processor -- start 2024-02-18T11:11:57.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84db640640 1 -- start start 2024-02-18T11:11:57.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84db640640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d4149970 0x7f84d40bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84db640640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f84d40bc380 0x7f84d41432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84db640640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40bc830 con 0x7f84d40a14c0 2024-02-18T11:11:57.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84db640640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d40bdf00 con 0x7f84d40bc380 2024-02-18T11:11:57.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84db640640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4149e00 con 0x7f84d4149970 2024-02-18T11:11:57.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84d9bdd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f84d40bc380 0x7f84d41432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84d9bdd640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f84d40bc380 0x7f84d41432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36200/0 (socket says 172.21.15.118:36200) 2024-02-18T11:11:57.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84d9bdd640 1 -- 172.21.15.118:0/547674034 learned_addr learned my addr 172.21.15.118:0/547674034 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:57.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.803+0000 7f84d8bdb640 1 --2- 172.21.15.118:0/547674034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d4149970 0x7f84d40bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84d9bdd640 1 -- 172.21.15.118:0/547674034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d4149970 msgr2=0x7f84d40bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84d9bdd640 1 --2- 172.21.15.118:0/547674034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d4149970 0x7f84d40bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84d9bdd640 1 -- 172.21.15.118:0/547674034 >> v1:172.21.15.118:6789/0 conn(0x7f84d40a14c0 legacy=0x7f84d40bd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84d9bdd640 1 -- 172.21.15.118:0/547674034 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d414a0e0 con 0x7f84d40bc380 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84d8bdb640 1 --2- 172.21.15.118:0/547674034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d4149970 0x7f84d40bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84d9bdd640 1 --2- 172.21.15.118:0/547674034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d40bc380 0x7f84d41432b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1f38dad120eaf7 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84cbfff640 1 -- 172.21.15.118:0/547674034 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0030840 con 0x7f84d40bc380 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84cbfff640 1 -- 172.21.15.118:0/547674034 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d00309a0 con 0x7f84d40bc380 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.804+0000 7f84cbfff640 1 -- 172.21.15.118:0/547674034 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0030d30 con 0x7f84d40bc380 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 -- 172.21.15.118:0/547674034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d40bc380 msgr2=0x7f84d41432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 --2- 172.21.15.118:0/547674034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d40bc380 0x7f84d41432b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d002b980 comp rx=0 tx=0).stop 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 -- 172.21.15.118:0/547674034 shutdown_connections 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 --2- 172.21.15.118:0/547674034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d40bc380 0x7f84d41432b0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 --2- 172.21.15.118:0/547674034 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d4149970 0x7f84d40bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 -- 172.21.15.118:0/547674034 >> 172.21.15.118:0/547674034 conn(0x7f84d40bf510 msgr2=0x7f84d40bf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 -- 172.21.15.118:0/547674034 shutdown_connections 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.805+0000 7f84db640640 1 -- 172.21.15.118:0/547674034 wait complete. 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.806+0000 7f84db640640 1 Processor -- start 2024-02-18T11:11:57.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.806+0000 7f84db640640 1 -- start start 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84db640640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d40a14c0 0x7f84d4147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84db640640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d40bc380 0x7f84d409deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84db640640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d41e2460 0x7f84d4141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84db640640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4148880 con 0x7f84d41e2460 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84db640640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4146800 con 0x7f84d40bc380 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84db640640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4146dc0 con 0x7f84d40a14c0 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d41e2460 0x7f84d4141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d41e2460 0x7f84d4141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36204/0 (socket says 172.21.15.118:36204) 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 -- 172.21.15.118:0/3450501658 learned_addr learned my addr 172.21.15.118:0/3450501658 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d8bdb640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d40bc380 0x7f84d409deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d93dc640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d40a14c0 0x7f84d4147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 -- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d40a14c0 msgr2=0x7f84d4147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d40a14c0 0x7f84d4147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 -- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d40bc380 msgr2=0x7f84d409deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d40bc380 0x7f84d409deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 -- 172.21.15.118:0/3450501658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d00094d0 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84d9bdd640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d41e2460 0x7f84d4141a10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f84d002b9c0 tx=0x7f84d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.807+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00307d0 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.808+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0044480 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.808+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d40bb600 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.808+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0044830 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.808+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d4146a50 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.808+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84d40a18a0 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f84d004d3b0 con 0x7f84d41e2460 2024-02-18T11:11:57.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84c9ffb640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f84b806bca0 0x7f84b806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84d003e070 con 0x7f84d41e2460 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84d93dc640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f84b806bca0 0x7f84b806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84c9ffb640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f84b8071b60 0x7f84b8073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 --> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84b8074630 con 0x7f84b8071b60 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84d00adb20 con 0x7f84d41e2460 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84d93dc640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f84b806bca0 0x7f84b806e160 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f84cc001d40 tx=0x7f84cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.810+0000 7f84d8bdb640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f84b8071b60 0x7f84b8073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.811+0000 7f84d8bdb640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f84b8071b60 0x7f84b8073f80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.812+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== osd.7 v2:172.21.15.164:6824/3262371118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f84b8074630 con 0x7f84b8071b60 2024-02-18T11:11:57.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.824+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 --> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84d414a6a0 con 0x7f84b8071b60 2024-02-18T11:11:57.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84c9ffb640 1 -- 172.21.15.118:0/3450501658 <== osd.7 v2:172.21.15.164:6824/3262371118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f84c400c040 con 0x7f84b8071b60 2024-02-18T11:11:57.827 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-02-18T11:11:57.827 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-18T11:11:57.827 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-02-18T11:11:57.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f84b8071b60 msgr2=0x7f84b8073f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.164:6824/3262371118,v1:172.21.15.164:6825/3262371118] conn(0x7f84b8071b60 0x7f84b8073f80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f84b806bca0 msgr2=0x7f84b806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f84b806bca0 0x7f84b806e160 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f84cc001d40 tx=0x7f84cc009040 comp rx=0 tx=0).stop 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d41e2460 msgr2=0x7f84d4141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 --2- 172.21.15.118:0/3450501658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f84d41e2460 0x7f84d4141a10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f84d002b9c0 tx=0x7f84d0004730 comp rx=0 tx=0).stop 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84d9bdd640 1 -- 172.21.15.118:0/3450501658 reap_dead start 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 shutdown_connections 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.825+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 >> 172.21.15.118:0/3450501658 conn(0x7f84d40bf510 msgr2=0x7f84d40ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.826+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 shutdown_connections 2024-02-18T11:11:57.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.826+0000 7f84db640640 1 -- 172.21.15.118:0/3450501658 wait complete. 2024-02-18T11:11:57.837 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-18T11:11:57.939 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.938+0000 7f8b6609d640 1 Processor -- start 2024-02-18T11:11:57.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.938+0000 7f8b6609d640 1 -- start start 2024-02-18T11:11:57.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.939+0000 7f8b6609d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 0x7f8b600b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.944 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.939+0000 7f8b6609d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60149c40 con 0x7f8b6014a0d0 2024-02-18T11:11:57.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.939+0000 7f8b6609d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600b5b60 con 0x7f8b600bc0a0 2024-02-18T11:11:57.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.939+0000 7f8b6609d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600b5e40 con 0x7f8b6006fda0 2024-02-18T11:11:57.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.939+0000 7f8b5ffff640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8b6014a0d0 0x7f8b6014a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47210/0 (socket says 172.21.15.118:47210) 2024-02-18T11:11:57.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.939+0000 7f8b5ffff640 1 -- 172.21.15.118:0/2634809258 learned_addr learned my addr 172.21.15.118:0/2634809258 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:57.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.939+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 0x7f8b600b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259532533 0 0) 0x7f8b60149c40 con 0x7f8b6014a0d0 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b4c003520 con 0x7f8b6014a0d0 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873035620 0 0) 0x7f8b600b5b60 con 0x7f8b600bc0a0 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b60149c40 con 0x7f8b600bc0a0 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764510908 0 0) 0x7f8b4c003520 con 0x7f8b6014a0d0 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 msgr2=0x7f8b600b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 0x7f8b600b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 >> v1:172.21.15.164:6789/0 conn(0x7f8b600bc0a0 legacy=0x7f8b60143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600b6120 con 0x7f8b6014a0d0 2024-02-18T11:11:57.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f8b580019f0 con 0x7f8b6014a0d0 2024-02-18T11:11:57.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 0x7f8b600b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-18T11:11:57.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 >> v1:172.21.15.118:6789/0 conn(0x7f8b6014a0d0 legacy=0x7f8b6014a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 0x7f8b4c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b4c004070 0x7f8b4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004d00 0x7f8b4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600b5e40 con 0x7f8b4c004070 2024-02-18T11:11:57.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c00ba30 con 0x7f8b4c004d00 2024-02-18T11:11:57.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c00bbf0 con 0x7f8b6006fda0 2024-02-18T11:11:57.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b4c004070 0x7f8b4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5f7fe640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 0x7f8b4c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b5ffff640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004d00 0x7f8b4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b56ffd640 1 -- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 msgr2=0x7f8b4c003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b6006fda0 0x7f8b4c003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b56ffd640 1 -- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004d00 msgr2=0x7f8b4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004d00 0x7f8b4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.940+0000 7f8b56ffd640 1 -- 172.21.15.118:0/2634809258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48009400 con 0x7f8b4c004070 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.941+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b4c004070 0x7f8b4c0047c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009c70 tx=0x7f8b4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab99874f2abb6f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.941+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4802c910 con 0x7f8b4c004070 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.941+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4802ca70 con 0x7f8b4c004070 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.941+0000 7f8b5effd640 1 -- 172.21.15.118:0/2634809258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4802cde0 con 0x7f8b4c004070 2024-02-18T11:11:57.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.942+0000 7f8b6609d640 1 -- 172.21.15.118:0/2634809258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b4c004070 msgr2=0x7f8b4c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.942+0000 7f8b6609d640 1 --2- 172.21.15.118:0/2634809258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b4c004070 0x7f8b4c0047c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009c70 tx=0x7f8b4c0057f0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.942+0000 7f8b5ffff640 1 -- 172.21.15.118:0/2634809258 reap_dead start 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.942+0000 7f8b6609d640 1 -- 172.21.15.118:0/2634809258 shutdown_connections 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.942+0000 7f8b6609d640 1 -- 172.21.15.118:0/2634809258 >> 172.21.15.118:0/2634809258 conn(0x7f8b600bf330 msgr2=0x7f8b600bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.942+0000 7f8b6609d640 1 -- 172.21.15.118:0/2634809258 shutdown_connections 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.942+0000 7f8b6609d640 1 -- 172.21.15.118:0/2634809258 wait complete. 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.943+0000 7f8b6609d640 1 Processor -- start 2024-02-18T11:11:57.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.944+0000 7f8b6609d640 1 -- start start 2024-02-18T11:11:57.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.944+0000 7f8b6609d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004070 0x7f8b6006bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.944+0000 7f8b6609d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b60148070 0x7f8b6013a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.944+0000 7f8b6609d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b601484b0 0x7f8b6013a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.944+0000 7f8b6609d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6006c4a0 con 0x7f8b60148070 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.944+0000 7f8b6609d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013ba70 con 0x7f8b4c004070 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.944+0000 7f8b6609d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013be10 con 0x7f8b601484b0 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b60148070 0x7f8b6013a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b60148070 0x7f8b6013a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36220/0 (socket says 172.21.15.118:36220) 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 -- 172.21.15.118:0/2783276255 learned_addr learned my addr 172.21.15.118:0/2783276255 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:57.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b5f7fe640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004070 0x7f8b6006bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b5ffff640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b601484b0 0x7f8b6013a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 -- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b601484b0 msgr2=0x7f8b6013a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b601484b0 0x7f8b6013a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 -- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004070 msgr2=0x7f8b6006bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004070 0x7f8b6006bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 -- 172.21.15.118:0/2783276255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600a1c10 con 0x7f8b60148070 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b5ffff640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b601484b0 0x7f8b6013a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:11:57.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b56ffd640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b60148070 0x7f8b6013a270 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8b48037040 tx=0x7f8b48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b5cff9640 1 -- 172.21.15.118:0/2783276255 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48034c00 con 0x7f8b60148070 2024-02-18T11:11:57.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b5cff9640 1 -- 172.21.15.118:0/2783276255 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48034d60 con 0x7f8b60148070 2024-02-18T11:11:57.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b5cff9640 1 -- 172.21.15.118:0/2783276255 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4803e620 con 0x7f8b60148070 2024-02-18T11:11:57.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6006db50 con 0x7f8b60148070 2024-02-18T11:11:57.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.945+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6006d5b0 con 0x7f8b60148070 2024-02-18T11:11:57.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.946+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60149710 con 0x7f8b60148070 2024-02-18T11:11:57.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.947+0000 7f8b5cff9640 1 -- 172.21.15.118:0/2783276255 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f8b4803e780 con 0x7f8b60148070 2024-02-18T11:11:57.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.947+0000 7f8b5cff9640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b4006bca0 0x7f8b4006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:57.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.947+0000 7f8b5f7fe640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b4006bca0 0x7f8b4006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:57.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.947+0000 7f8b5cff9640 1 -- 172.21.15.118:0/2783276255 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b480ac6a0 con 0x7f8b60148070 2024-02-18T11:11:57.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.948+0000 7f8b5f7fe640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b4006bca0 0x7f8b4006e160 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b500055b0 tx=0x7f8b50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:57.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:57.951+0000 7f8b5cff9640 1 -- 172.21.15.118:0/2783276255 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8b60149710 con 0x7f8b60148070 2024-02-18T11:11:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.129+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b6006dd90 con 0x7f8b4006bca0 2024-02-18T11:11:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.129+0000 7f8b5cff9640 1 -- 172.21.15.118:0/2783276255 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8b6006dd90 con 0x7f8b4006bca0 2024-02-18T11:11:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 7 to deep-scrub 2024-02-18T11:11:58.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b4006bca0 msgr2=0x7f8b4006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b4006bca0 0x7f8b4006e160 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b500055b0 tx=0x7f8b50009040 comp rx=0 tx=0).stop 2024-02-18T11:11:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b60148070 msgr2=0x7f8b6013a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b60148070 0x7f8b6013a270 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8b48037040 tx=0x7f8b48004730 comp rx=0 tx=0).stop 2024-02-18T11:11:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 shutdown_connections 2024-02-18T11:11:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f8b4006bca0 0x7f8b4006e160 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b601484b0 0x7f8b6013a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b60148070 0x7f8b6013a270 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 --2- 172.21.15.118:0/2783276255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b4c004070 0x7f8b6006bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 >> 172.21.15.118:0/2783276255 conn(0x7f8b600bf330 msgr2=0x7f8b6006e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 shutdown_connections 2024-02-18T11:11:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.131+0000 7f8b6609d640 1 -- 172.21.15.118:0/2783276255 wait complete. 2024-02-18T11:11:58.144 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T11:11:58.245 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.244+0000 7fa1fc90d640 1 Processor -- start 2024-02-18T11:11:58.246 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.244+0000 7fa1fc90d640 1 -- start start 2024-02-18T11:11:58.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1fc90d640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa1f814a7e0 0x7fa1f80b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:58.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1fc90d640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f8149c40 con 0x7fa1f806fda0 2024-02-18T11:11:58.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1fc90d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f80b5b60 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1fc90d640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80b5e40 con 0x7fa1f814a7e0 2024-02-18T11:11:58.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1f5d9b640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa1f806fda0 0x7fa1f814a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47226/0 (socket says 172.21.15.118:47226) 2024-02-18T11:11:58.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1f5d9b640 1 -- 172.21.15.118:0/2377286183 learned_addr learned my addr 172.21.15.118:0/2377286183 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:11:58.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1f6d9d640 1 --2- 172.21.15.118:0/2377286183 >> v2:172.21.15.164:3300/0 conn(0x7fa1f814a7e0 0x7fa1f80b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:58.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1f559a640 1 -- 172.21.15.118:0/2377286183 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816370101 0 0) 0x7fa1f8149c40 con 0x7fa1f806fda0 2024-02-18T11:11:58.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.245+0000 7fa1f559a640 1 -- 172.21.15.118:0/2377286183 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e0003520 con 0x7fa1f806fda0 2024-02-18T11:11:58.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.246+0000 7fa1f6d9d640 1 -- 172.21.15.118:0/2377286183 >> v1:172.21.15.164:6789/0 conn(0x7fa1f80bc0a0 legacy=0x7fa1f8143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.246+0000 7fa1f6d9d640 1 -- 172.21.15.118:0/2377286183 >> v1:172.21.15.118:6789/0 conn(0x7fa1f806fda0 legacy=0x7fa1f814a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.246+0000 7fa1f6d9d640 1 -- 172.21.15.118:0/2377286183 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80b6120 con 0x7fa1f814a7e0 2024-02-18T11:11:58.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.246+0000 7fa1f6d9d640 1 --2- 172.21.15.118:0/2377286183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f80b5540 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009d90 tx=0x7fa1f002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c332b3fb5ec4d05 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1f559a640 1 -- 172.21.15.118:0/2377286183 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002cd80 con 0x7fa1f814a7e0 2024-02-18T11:11:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1f559a640 1 -- 172.21.15.118:0/2377286183 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0034440 con 0x7fa1f814a7e0 2024-02-18T11:11:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1f559a640 1 -- 172.21.15.118:0/2377286183 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00347b0 con 0x7fa1f814a7e0 2024-02-18T11:11:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2377286183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 msgr2=0x7fa1f80b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2377286183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f80b5540 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009d90 tx=0x7fa1f002bfd0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2377286183 shutdown_connections 2024-02-18T11:11:58.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2377286183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f80b5540 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2377286183 >> 172.21.15.118:0/2377286183 conn(0x7fa1f80bf330 msgr2=0x7fa1f80bf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2377286183 shutdown_connections 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.247+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2377286183 wait complete. 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.248+0000 7fa1fc90d640 1 Processor -- start 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.248+0000 7fa1fc90d640 1 -- start start 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1fc90d640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1f806fda0 0x7fa1f80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1fc90d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f80bc0a0 0x7fa1f81495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1fc90d640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f81e1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:58.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1fc90d640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80a3ce0 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1fc90d640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8149b20 con 0x7fa1f814a7e0 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1fc90d640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8148bf0 con 0x7fa1f806fda0 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f80bc0a0 0x7fa1f81495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f80bc0a0 0x7fa1f81495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36226/0 (socket says 172.21.15.118:36226) 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 -- 172.21.15.118:0/2075067209 learned_addr learned my addr 172.21.15.118:0/2075067209 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f6d9d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f81e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f659c640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1f806fda0 0x7fa1f80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 -- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1f806fda0 msgr2=0x7fa1f80a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1f806fda0 0x7fa1f80a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 -- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 msgr2=0x7fa1f81e1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f81e1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f5d9b640 1 -- 172.21.15.118:0/2075067209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0009a70 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.249+0000 7fa1f6d9d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f81e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.250+0000 7fa1f5d9b640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f80bc0a0 0x7fa1f81495e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c500 tx=0x7fa1e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.250+0000 7fa1e6ffd640 1 -- 172.21.15.118:0/2075067209 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8005ce0 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.250+0000 7fa1e6ffd640 1 -- 172.21.15.118:0/2075067209 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8005e40 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.250+0000 7fa1e6ffd640 1 -- 172.21.15.118:0/2075067209 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8007330 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.250+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f806d690 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.250+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f80a4130 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.251+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f8074af0 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.251+0000 7fa1e6ffd640 1 -- 172.21.15.118:0/2075067209 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fa1e8007490 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.252+0000 7fa1e6ffd640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa1d806bca0 0x7fa1d806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:11:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.252+0000 7fa1f659c640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa1d806bca0 0x7fa1d806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:11:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.252+0000 7fa1e6ffd640 1 -- 172.21.15.118:0/2075067209 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa1e80899f0 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.252+0000 7fa1f659c640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa1d806bca0 0x7fa1d806e160 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec000f60 tx=0x7fa1ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:11:58.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.256+0000 7fa1e6ffd640 1 -- 172.21.15.118:0/2075067209 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa1e8054620 con 0x7fa1f80bc0a0 2024-02-18T11:11:58.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.431+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1f80bc480 con 0x7fa1d806bca0 2024-02-18T11:11:58.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.432+0000 7fa1e6ffd640 1 -- 172.21.15.118:0/2075067209 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13627 (secure 0 0 0) 0x7fa1ec001c70 con 0x7fa1d806bca0 2024-02-18T11:11:58.433 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:11:58.434 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T11:11:58.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa1d806bca0 msgr2=0x7fa1d806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa1d806bca0 0x7fa1d806e160 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec000f60 tx=0x7fa1ec009040 comp rx=0 tx=0).stop 2024-02-18T11:11:58.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f80bc0a0 msgr2=0x7fa1f81495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:11:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f80bc0a0 0x7fa1f81495e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c500 tx=0x7fa1e800c9c0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 shutdown_connections 2024-02-18T11:11:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fa1d806bca0 0x7fa1d806e160 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1f814a7e0 0x7fa1f81e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1f80bc0a0 0x7fa1f81495e0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 --2- 172.21.15.118:0/2075067209 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa1f806fda0 0x7fa1f80a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:11:58.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 >> 172.21.15.118:0/2075067209 conn(0x7fa1f80bf330 msgr2=0x7fa1f806e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:11:58.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 shutdown_connections 2024-02-18T11:11:58.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:11:58.434+0000 7fa1fc90d640 1 -- 172.21.15.118:0/2075067209 wait complete. 2024-02-18T11:11:58.446 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":2164,"stamp":"2024-02-18T11:11:56.454576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":9774144,"kb_used_data":320792,"kb_used_omap":12,"kb_used_meta":9436787,"kb_avail":745200576,"statfs":{"total":773094113280,"available":763085389824,"internally_reserved":0,"allocated":328491008,"data_stored":326570926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":9663270448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":149,"apply_latency_ms":149,"commit_latency_ns":149000000,"apply_latency_ns":149000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-803634267,"num_objects":-1485,"num_object_clones":0,"num_object_copies":-2970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1485,"num_whiteouts":0,"num_read":-50765,"num_read_kb":-54618151,"num_write":-1441905,"num_write_kb":-59935094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001282"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-18T11:11:50.619838+0000","last_change":"2024-02-18T10:00:45.090401+0000","last_active":"2024-02-18T11:11:50.619838+0000","last_peered":"2024-02-18T11:11:50.619838+0000","last_clean":"2024-02-18T11:11:50.619838+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T11:11:50.619838+0000","last_undegraded":"2024-02-18T11:11:50.619838+0000","last_fullsized":"2024-02-18T11:11:50.619838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-18T10:00:43.481918+0000","last_clean_scrub_stamp":"2024-02-18T10:00:43.481918+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T21:05:29.915983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1295952,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":1294974,"kb_avail":93075888,"statfs":{"total":96636764160,"available":95309709312,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1326053834},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":831852,"kb_used_data":74336,"kb_used_omap":1,"kb_used_meta":757502,"kb_avail":93539988,"statfs":{"total":96636764160,"available":95784947712,"internally_reserved":0,"allocated":76120064,"data_stored":75889056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":775682502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575704,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1371852,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1371454,"kb_avail":92999988,"statfs":{"total":96636764160,"available":95231987712,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1404369349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575704,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1367820,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1367422,"kb_avail":93004020,"statfs":{"total":96636764160,"available":95236116480,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1400240581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1434512,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1434110,"kb_avail":92937328,"statfs":{"total":96636764160,"available":95167823872,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1468529095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575706,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":951340,"kb_used_data":121696,"kb_used_omap":1,"kb_used_meta":829630,"kb_avail":93420500,"statfs":{"total":96636764160,"available":95662592000,"internally_reserved":0,"allocated":124616704,"data_stored":124385696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":849541573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575705,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1694368,"kb_used_data":121680,"kb_used_omap":1,"kb_used_meta":1556222,"kb_avail":92677472,"statfs":{"total":96636764160,"available":94901731328,"internally_reserved":0,"allocated":124600320,"data_stored":124358493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1593571781},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575706,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":826448,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":825470,"kb_avail":93545392,"statfs":{"total":96636764160,"available":95790481408,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":845281733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T11:11:58.449 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-18T10:00:43.481918+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=10, tm_min=0, tm_sec=43, tm_wday=6, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=18, tm_hour=11, tm_min=11, tm_sec=53, tm_wday=6, tm_yday=49, tm_isdst=0) 2024-02-18T11:11:58.449 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-18T11:12:18.450 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-18T11:12:18.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.551+0000 7fed2c839640 1 Processor -- start 2024-02-18T11:12:18.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.551+0000 7fed2c839640 1 -- start start 2024-02-18T11:12:18.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed2c839640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed2814bf20 0x7fed2814c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed2c839640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed281546d0 0x7fed28156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed2c839640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280b4aa0 con 0x7fed280a6e60 2024-02-18T11:12:18.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed2c839640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2806bcd0 con 0x7fed281546d0 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed2c839640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280b4cf0 con 0x7fed2814bf20 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed26d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed281546d0 0x7fed28156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed26d9d640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed281546d0 0x7fed28156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39062/0 (socket says 172.21.15.118:39062) 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed26d9d640 1 -- 172.21.15.118:0/102548906 learned_addr learned my addr 172.21.15.118:0/102548906 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed1ffff640 1 --2- 172.21.15.118:0/102548906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed2814bf20 0x7fed2814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed26d9d640 1 -- 172.21.15.118:0/102548906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed2814bf20 msgr2=0x7fed2814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed26d9d640 1 --2- 172.21.15.118:0/102548906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed2814bf20 0x7fed2814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed26d9d640 1 -- 172.21.15.118:0/102548906 >> v1:172.21.15.164:6789/0 conn(0x7fed280a6e60 legacy=0x7fed2806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.552+0000 7fed26d9d640 1 -- 172.21.15.118:0/102548906 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2814c8a0 con 0x7fed281546d0 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.553+0000 7fed26d9d640 1 --2- 172.21.15.118:0/102548906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed281546d0 0x7fed28156ac0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fed20009e50 tx=0x7fed2002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5708da72b05ae81 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.553+0000 7fed25d9b640 1 -- 172.21.15.118:0/102548906 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2002c950 con 0x7fed281546d0 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.553+0000 7fed25d9b640 1 -- 172.21.15.118:0/102548906 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2002cab0 con 0x7fed281546d0 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.553+0000 7fed25d9b640 1 -- 172.21.15.118:0/102548906 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2002ce40 con 0x7fed281546d0 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 -- 172.21.15.118:0/102548906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed281546d0 msgr2=0x7fed28156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 --2- 172.21.15.118:0/102548906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed281546d0 0x7fed28156ac0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fed20009e50 tx=0x7fed2002bdb0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 -- 172.21.15.118:0/102548906 shutdown_connections 2024-02-18T11:12:18.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 --2- 172.21.15.118:0/102548906 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed281546d0 0x7fed28156ac0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 --2- 172.21.15.118:0/102548906 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed2814bf20 0x7fed2814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 -- 172.21.15.118:0/102548906 >> 172.21.15.118:0/102548906 conn(0x7fed280c15b0 msgr2=0x7fed280c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:12:18.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 -- 172.21.15.118:0/102548906 shutdown_connections 2024-02-18T11:12:18.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.554+0000 7fed2c839640 1 -- 172.21.15.118:0/102548906 wait complete. 2024-02-18T11:12:18.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.555+0000 7fed2c839640 1 Processor -- start 2024-02-18T11:12:18.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.555+0000 7fed2c839640 1 -- start start 2024-02-18T11:12:18.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed280a6e60 0x7fed2814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed2814bf20 0x7fed280b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed281546d0 0x7fed280b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed281e30d0 con 0x7fed280a6e60 2024-02-18T11:12:18.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed281e2680 con 0x7fed2814bf20 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280b40a0 con 0x7fed281546d0 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed280a6e60 0x7fed2814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed280a6e60 0x7fed2814d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39064/0 (socket says 172.21.15.118:39064) 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 -- 172.21.15.118:0/2917206806 learned_addr learned my addr 172.21.15.118:0/2917206806 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed26d9d640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed281546d0 0x7fed280b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed1ffff640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed2814bf20 0x7fed280b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 -- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed281546d0 msgr2=0x7fed280b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed281546d0 0x7fed280b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 -- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed2814bf20 msgr2=0x7fed280b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed2814bf20 0x7fed280b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 -- 172.21.15.118:0/2917206806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009b30 con 0x7fed280a6e60 2024-02-18T11:12:18.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2659c640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed280a6e60 0x7fed2814d430 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3f0 tx=0x7fed1800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:18.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed1effd640 1 -- 172.21.15.118:0/2917206806 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18011830 con 0x7fed280a6e60 2024-02-18T11:12:18.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed1effd640 1 -- 172.21.15.118:0/2917206806 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed18011990 con 0x7fed280a6e60 2024-02-18T11:12:18.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed280b42f0 con 0x7fed280a6e60 2024-02-18T11:12:18.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed1effd640 1 -- 172.21.15.118:0/2917206806 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18011d40 con 0x7fed280a6e60 2024-02-18T11:12:18.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.556+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed280a2410 con 0x7fed280a6e60 2024-02-18T11:12:18.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.557+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2806c510 con 0x7fed280a6e60 2024-02-18T11:12:18.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.558+0000 7fed1effd640 1 -- 172.21.15.118:0/2917206806 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7fed1801a400 con 0x7fed280a6e60 2024-02-18T11:12:18.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.558+0000 7fed1effd640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed0806bc70 0x7fed0806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.558+0000 7fed1ffff640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed0806bc70 0x7fed0806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.558+0000 7fed1effd640 1 -- 172.21.15.118:0/2917206806 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fed1808a1a0 con 0x7fed280a6e60 2024-02-18T11:12:18.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.559+0000 7fed1ffff640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed0806bc70 0x7fed0806e130 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fed280c0ea0 tx=0x7fed10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:18.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.563+0000 7fed1effd640 1 -- 172.21.15.118:0/2917206806 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed18054cb0 con 0x7fed280a6e60 2024-02-18T11:12:18.740 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.739+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 --> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed2814cc50 con 0x7fed0806bc70 2024-02-18T11:12:18.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.740+0000 7fed1effd640 1 -- 172.21.15.118:0/2917206806 <== mgr.4110 v2:172.21.15.118:6832/906581077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13399 (secure 0 0 0) 0x7fed2814cc50 con 0x7fed0806bc70 2024-02-18T11:12:18.741 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:12:18.743 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-02-18T11:12:18.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed0806bc70 msgr2=0x7fed0806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed0806bc70 0x7fed0806e130 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fed280c0ea0 tx=0x7fed10008040 comp rx=0 tx=0).stop 2024-02-18T11:12:18.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed280a6e60 msgr2=0x7fed2814d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed280a6e60 0x7fed2814d430 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3f0 tx=0x7fed1800b8b0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 shutdown_connections 2024-02-18T11:12:18.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7fed0806bc70 0x7fed0806e130 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed281546d0 0x7fed280b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed2814bf20 0x7fed280b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 --2- 172.21.15.118:0/2917206806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed280a6e60 0x7fed2814d430 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.741+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 >> 172.21.15.118:0/2917206806 conn(0x7fed280c15b0 msgr2=0x7fed280a43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:12:18.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.742+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 shutdown_connections 2024-02-18T11:12:18.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.742+0000 7fed2c839640 1 -- 172.21.15.118:0/2917206806 wait complete. 2024-02-18T11:12:18.754 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":2175,"stamp":"2024-02-18T11:12:18.457679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":9477224,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":9472883,"kb_avail":745497496,"statfs":{"total":773094113280,"available":763389435904,"internally_reserved":0,"allocated":4333568,"data_stored":2391848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":9700232752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001653"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":240,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-02-18T11:11:59.068840+0000","last_change":"2024-02-18T11:11:59.068883+0000","last_active":"2024-02-18T11:11:59.068840+0000","last_peered":"2024-02-18T11:11:59.068840+0000","last_clean":"2024-02-18T11:11:59.068840+0000","last_became_active":"2024-02-18T10:00:45.089477+0000","last_became_peered":"2024-02-18T10:00:45.089477+0000","last_unstale":"2024-02-18T11:11:59.068840+0000","last_undegraded":"2024-02-18T11:11:59.068840+0000","last_fullsized":"2024-02-18T11:11:59.068840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-02-18T11:11:59.068745+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-02-18T11:11:59.068745+0000","last_clean_scrub_stamp":"2024-02-18T11:11:59.068745+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T14:44:40.925882+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575708,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1295948,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":1294974,"kb_avail":93075892,"statfs":{"total":96636764160,"available":95309713408,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":1326053834},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":775948,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":775550,"kb_avail":93595892,"statfs":{"total":96636764160,"available":95842193408,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":794163654},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1371852,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1371454,"kb_avail":92999988,"statfs":{"total":96636764160,"available":95231987712,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1404369349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1367820,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1367422,"kb_avail":93004020,"statfs":{"total":96636764160,"available":95236116480,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1400240581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1434512,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1434110,"kb_avail":92937328,"statfs":{"total":96636764160,"available":95167823872,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1468529095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575711,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":848080,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":847678,"kb_avail":93523760,"statfs":{"total":96636764160,"available":95768330240,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":868022725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575710,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1556620,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":1556222,"kb_avail":92815220,"statfs":{"total":96636764160,"available":95042785280,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1593571781},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575711,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":826444,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":825470,"kb_avail":93545396,"statfs":{"total":96636764160,"available":95790485504,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":845281733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-18T11:12:18.755 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-18T11:12:18.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.854+0000 7f30570f4640 1 Processor -- start 2024-02-18T11:12:18.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.854+0000 7f30570f4640 1 -- start start 2024-02-18T11:12:18.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f30570f4640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3050145ea0 0x7f30500be630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f30570f4640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305006bb30 con 0x7f30500ba8c0 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f30570f4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305014cae0 con 0x7f30500a0920 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f30570f4640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305006bdb0 con 0x7f3050145ea0 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f3055691640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f30500ba8c0 0x7f30500bad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:54598/0 (socket says 172.21.15.118:54598) 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f3055691640 1 -- 172.21.15.118:0/2291695048 learned_addr learned my addr 172.21.15.118:0/2291695048 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532332838 0 0) 0x7f305006bb30 con 0x7f30500ba8c0 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3040003520 con 0x7f30500ba8c0 2024-02-18T11:12:18.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.855+0000 7f3054e90640 1 --2- 172.21.15.118:0/2291695048 >> v2:172.21.15.164:3300/0 conn(0x7f3050145ea0 0x7f30500be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2345855021 0 0) 0x7f3040003520 con 0x7f30500ba8c0 2024-02-18T11:12:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 >> v2:172.21.15.164:3300/0 conn(0x7f3050145ea0 msgr2=0x7f30500be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 --2- 172.21.15.118:0/2291695048 >> v2:172.21.15.164:3300/0 conn(0x7f3050145ea0 0x7f30500be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 >> v1:172.21.15.164:6789/0 conn(0x7f30500a0920 legacy=0x7f305014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305006c090 con 0x7f30500ba8c0 2024-02-18T11:12:18.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2252177766 0 0) 0x7f30480019f0 con 0x7f30500ba8c0 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 >> v1:172.21.15.118:6789/0 conn(0x7f30500ba8c0 legacy=0x7f30500bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040003970 0x7f3040003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30400047c0 0x7f3040004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3040005180 0x7f304000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305006bdb0 con 0x7f3040005180 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304000c0d0 con 0x7f3040003970 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304000c290 con 0x7f30400047c0 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f3055691640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3040005180 0x7f304000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f3054e90640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040003970 0x7f3040003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f304ffff640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30400047c0 0x7f3040004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f3055691640 1 -- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30400047c0 msgr2=0x7f3040004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f3055691640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30400047c0 0x7f3040004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f3055691640 1 -- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040003970 msgr2=0x7f3040003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f3055691640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040003970 0x7f3040003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.856+0000 7f3055691640 1 -- 172.21.15.118:0/2291695048 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040003520 con 0x7f3040005180 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f3055691640 1 -- 172.21.15.118:0/2291695048 reap_dead start 2024-02-18T11:12:18.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f3055691640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3040005180 0x7f304000b980 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f304800a820 tx=0x7f30400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a012dbcc6bef9e5a server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:18.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480072d0 con 0x7f3040005180 2024-02-18T11:12:18.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304802f070 con 0x7f3040005180 2024-02-18T11:12:18.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f304f7fe640 1 -- 172.21.15.118:0/2291695048 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480076b0 con 0x7f3040005180 2024-02-18T11:12:18.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f30570f4640 1 -- 172.21.15.118:0/2291695048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3040005180 msgr2=0x7f304000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f30570f4640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3040005180 0x7f304000b980 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f304800a820 tx=0x7f30400057f0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f30570f4640 1 -- 172.21.15.118:0/2291695048 shutdown_connections 2024-02-18T11:12:18.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f30570f4640 1 --2- 172.21.15.118:0/2291695048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3040005180 0x7f304000b980 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f30570f4640 1 -- 172.21.15.118:0/2291695048 >> 172.21.15.118:0/2291695048 conn(0x7f30500c1ad0 msgr2=0x7f30500bdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:12:18.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f30570f4640 1 -- 172.21.15.118:0/2291695048 shutdown_connections 2024-02-18T11:12:18.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.857+0000 7f30570f4640 1 -- 172.21.15.118:0/2291695048 wait complete. 2024-02-18T11:12:18.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.858+0000 7f30570f4640 1 Processor -- start 2024-02-18T11:12:18.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f30570f4640 1 -- start start 2024-02-18T11:12:18.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f30570f4640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040005180 0x7f30500c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f30570f4640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30500684d0 0x7f30501d6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f30570f4640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30501e5580 0x7f30500b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f30570f4640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305014ec30 con 0x7f30500684d0 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f30570f4640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501d69c0 con 0x7f3040005180 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f30570f4640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500c12e0 con 0x7f30501e5580 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f304ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30500684d0 0x7f30501d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f304ffff640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30500684d0 0x7f30501d6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39092/0 (socket says 172.21.15.118:39092) 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.859+0000 7f304ffff640 1 -- 172.21.15.118:0/1551771647 learned_addr learned my addr 172.21.15.118:0/1551771647 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:12:18.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f3054e90640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040005180 0x7f30500c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f3055691640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30501e5580 0x7f30500b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304ffff640 1 -- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30501e5580 msgr2=0x7f30500b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304ffff640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30501e5580 0x7f30500b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304ffff640 1 -- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040005180 msgr2=0x7f30500c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304ffff640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040005180 0x7f30500c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304ffff640 1 -- 172.21.15.118:0/1551771647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500c1000 con 0x7f30500684d0 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304ffff640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30500684d0 0x7f30501d6480 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f303c00f5f0 tx=0x7f303c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0052e0 con 0x7f30500684d0 2024-02-18T11:12:18.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c005440 con 0x7f30500684d0 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c003830 con 0x7f30500684d0 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30501e4d80 con 0x7f30500684d0 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.860+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500a49b0 con 0x7f30500684d0 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.861+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3050075150 con 0x7f30500684d0 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.861+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f303c003990 con 0x7f30500684d0 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.862+0000 7f304d7fa640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f303406bca0 0x7f303406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.862+0000 7f3054e90640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f303406bca0 0x7f303406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:18.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.862+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f303c089e80 con 0x7f30500684d0 2024-02-18T11:12:18.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.862+0000 7f3054e90640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f303406bca0 0x7f303406e160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3044006fd0 tx=0x7f3044008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:18.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:18.866+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f303c054970 con 0x7f30500684d0 2024-02-18T11:12:19.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.045+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f305014b0f0 con 0x7f30500684d0 2024-02-18T11:12:19.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.048+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f303c058030 con 0x7f30500684d0 2024-02-18T11:12:19.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.050+0000 7f304d7fa640 1 -- 172.21.15.118:0/1551771647 <== mon.0 v2:172.21.15.118:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f303c054970 con 0x7f30500684d0 2024-02-18T11:12:19.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f303406bca0 msgr2=0x7f303406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f303406bca0 0x7f303406e160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3044006fd0 tx=0x7f3044008040 comp rx=0 tx=0).stop 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30500684d0 msgr2=0x7f30501d6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30500684d0 0x7f30501d6480 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f303c00f5f0 tx=0x7f303c00fab0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 shutdown_connections 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f303406bca0 0x7f303406e160 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30501e5580 0x7f30500b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30500684d0 0x7f30501d6480 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 --2- 172.21.15.118:0/1551771647 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3040005180 0x7f30500c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 >> 172.21.15.118:0/1551771647 conn(0x7f30500c1ad0 msgr2=0x7f30501453a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:12:19.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.051+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 shutdown_connections 2024-02-18T11:12:19.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.052+0000 7f30570f4640 1 -- 172.21.15.118:0/1551771647 wait complete. 2024-02-18T11:12:19.067 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-18T11:12:19.067 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-18T11:12:19.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.168+0000 7f3bccfb5640 1 Processor -- start 2024-02-18T11:12:19.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.168+0000 7f3bccfb5640 1 -- start start 2024-02-18T11:12:19.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bccfb5640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f3bc8071f80 0x7f3bc8072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:19.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bccfb5640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3bc80ba1a0 0x7f3bc806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:19.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bccfb5640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc8072bd0 con 0x7f3bc806f0b0 2024-02-18T11:12:19.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bccfb5640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc806e0b0 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bccfb5640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc8070fe0 con 0x7f3bc8071f80 2024-02-18T11:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3bc80ba1a0 0x7f3bc806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc5d9b640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3bc80ba1a0 0x7f3bc806eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39102/0 (socket says 172.21.15.118:39102) 2024-02-18T11:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc5d9b640 1 -- 172.21.15.118:0/1957848757 learned_addr learned my addr 172.21.15.118:0/1957848757 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc659c640 1 --2- 172.21.15.118:0/1957848757 >> v2:172.21.15.164:3300/0 conn(0x7f3bc8071f80 0x7f3bc8072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc5d9b640 1 -- 172.21.15.118:0/1957848757 >> v2:172.21.15.164:3300/0 conn(0x7f3bc8071f80 msgr2=0x7f3bc8072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc5d9b640 1 --2- 172.21.15.118:0/1957848757 >> v2:172.21.15.164:3300/0 conn(0x7f3bc8071f80 0x7f3bc8072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc5d9b640 1 -- 172.21.15.118:0/1957848757 >> v1:172.21.15.164:6789/0 conn(0x7f3bc806f0b0 legacy=0x7f3bc8145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-18T11:12:19.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.169+0000 7f3bc5d9b640 1 -- 172.21.15.118:0/1957848757 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8072e50 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bc5d9b640 1 --2- 172.21.15.118:0/1957848757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc806eb70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3bc806cf20 tx=0x7f3bbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c2deb12c4a4158 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:19.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bc559a640 1 -- 172.21.15.118:0/1957848757 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc031870 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bc559a640 1 -- 172.21.15.118:0/1957848757 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3bbc0319d0 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bc559a640 1 -- 172.21.15.118:0/1957848757 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc031d80 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bccfb5640 1 -- 172.21.15.118:0/1957848757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 msgr2=0x7f3bc806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:19.176 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/1957848757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc806eb70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3bc806cf20 tx=0x7f3bbc02b910 comp rx=0 tx=0).stop 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bccfb5640 1 -- 172.21.15.118:0/1957848757 shutdown_connections 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/1957848757 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc806eb70 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/1957848757 >> v2:172.21.15.164:3300/0 conn(0x7f3bc8071f80 0x7f3bc8072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.170+0000 7f3bccfb5640 1 -- 172.21.15.118:0/1957848757 >> 172.21.15.118:0/1957848757 conn(0x7f3bc806bcf0 msgr2=0x7f3bc806c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.171+0000 7f3bccfb5640 1 -- 172.21.15.118:0/1957848757 shutdown_connections 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.171+0000 7f3bccfb5640 1 -- 172.21.15.118:0/1957848757 wait complete. 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 Processor -- start 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 -- start start 2024-02-18T11:12:19.177 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc806f0b0 0x7f3bc809fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc8071f80 0x7f3bc809ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc81e1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc81d79d0 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc809f460 con 0x7f3bc8071f80 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bccfb5640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc809ea40 con 0x7f3bc806f0b0 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bc6d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc81e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bc6d9d640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc81e1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39108/0 (socket says 172.21.15.118:39108) 2024-02-18T11:12:19.178 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.172+0000 7f3bc6d9d640 1 -- 172.21.15.118:0/2761829534 learned_addr learned my addr 172.21.15.118:0/2761829534 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc5d9b640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc8071f80 0x7f3bc809ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc659c640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc806f0b0 0x7f3bc809fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc6d9d640 1 -- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc806f0b0 msgr2=0x7f3bc809fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc6d9d640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc806f0b0 0x7f3bc809fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc6d9d640 1 -- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc8071f80 msgr2=0x7f3bc809ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc6d9d640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc8071f80 0x7f3bc809ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc6d9d640 1 -- 172.21.15.118:0/2761829534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0094d0 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc659c640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc806f0b0 0x7f3bc809fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-18T11:12:19.179 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bc6d9d640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc81e1740 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c780 tx=0x7f3bc000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:19.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bb6ffd640 1 -- 172.21.15.118:0/2761829534 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0004b60 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bb6ffd640 1 -- 172.21.15.118:0/2761829534 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3bc000ce90 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bb6ffd640 1 -- 172.21.15.118:0/2761829534 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000a850 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc809e760 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.173+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc81e1c80 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.174+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc81d7b10 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.174+0000 7f3bb6ffd640 1 -- 172.21.15.118:0/2761829534 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90106+0+0 (secure 0 0 0) 0x7f3bc000a9b0 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.175+0000 7f3bb6ffd640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3ba806bc70 0x7f3ba806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-18T11:12:19.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.175+0000 7f3bc659c640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3ba806bc70 0x7f3ba806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-18T11:12:19.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.175+0000 7f3bb6ffd640 1 -- 172.21.15.118:0/2761829534 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3bc008a5c0 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.175+0000 7f3bc659c640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3ba806bc70 0x7f3ba806e130 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8006fd0 tx=0x7f3bb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-18T11:12:19.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.179+0000 7f3bb6ffd640 1 -- 172.21.15.118:0/2761829534 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3bc81d7b10 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.394+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bc81d7b10 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.395+0000 7f3bb6ffd640 1 -- 172.21.15.118:0/2761829534 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2917 (secure 0 0 0) 0x7f3bc81d7b10 con 0x7f3bc80ba1a0 2024-02-18T11:12:19.396 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-02-18T11:12:19.396 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4732,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6833/1586932009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1586932009},{"type":"v1","addr":"172.21.15.164:6833","nonce":1586932009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6836/1218312757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1218312757},{"type":"v1","addr":"172.21.15.118:6836","nonce":1218312757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":6756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/4163703330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6835","nonce":4163703330},{"type":"v1","addr":"172.21.15.118:6837","nonce":4163703330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":15}],"filesystems":[]} 2024-02-18T11:12:19.396 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 15 2024-02-18T11:12:19.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3ba806bc70 msgr2=0x7f3ba806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:19.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3ba806bc70 0x7f3ba806e130 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8006fd0 tx=0x7f3bb8008040 comp rx=0 tx=0).stop 2024-02-18T11:12:19.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 msgr2=0x7f3bc81e1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-18T11:12:19.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc81e1740 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c780 tx=0x7f3bc000cc40 comp rx=0 tx=0).stop 2024-02-18T11:12:19.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 shutdown_connections 2024-02-18T11:12:19.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:6832/906581077,v1:172.21.15.118:6833/906581077] conn(0x7f3ba806bc70 0x7f3ba806e130 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3bc80ba1a0 0x7f3bc81e1740 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bc8071f80 0x7f3bc809ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 --2- 172.21.15.118:0/2761829534 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3bc806f0b0 0x7f3bc809fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-18T11:12:19.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 >> 172.21.15.118:0/2761829534 conn(0x7f3bc806bcf0 msgr2=0x7f3bc8145a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-18T11:12:19.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 shutdown_connections 2024-02-18T11:12:19.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-02-18T11:12:19.397+0000 7f3bccfb5640 1 -- 172.21.15.118:0/2761829534 wait complete. 2024-02-18T11:12:19.408 DEBUG:tasks.cephfs.filesystem:already dead... 2024-02-18T11:12:19.408 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-18T11:12:19.409 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-18T11:12:19.409 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.417 INFO:tasks.ceph.mds.a:Stopped 2024-02-18T11:12:19.418 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-18T11:12:19.418 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.468 INFO:tasks.ceph.mds.c:Stopped 2024-02-18T11:12:19.468 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-18T11:12:19.468 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.481 INFO:tasks.ceph.mds.b:Stopped 2024-02-18T11:12:19.481 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-18T11:12:19.481 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-18T11:12:19.481 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.570 INFO:tasks.ceph.osd.0:Stopped 2024-02-18T11:12:19.571 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-18T11:12:19.571 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.644 INFO:tasks.ceph.osd.1:Stopped 2024-02-18T11:12:19.644 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-18T11:12:19.644 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.715 INFO:tasks.ceph.osd.2:Stopped 2024-02-18T11:12:19.715 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-18T11:12:19.715 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.790 INFO:tasks.ceph.osd.3:Stopped 2024-02-18T11:12:19.790 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-18T11:12:19.790 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.881 INFO:tasks.ceph.osd.4:Stopped 2024-02-18T11:12:19.882 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-18T11:12:19.882 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:19.961 INFO:tasks.ceph.osd.5:Stopped 2024-02-18T11:12:19.962 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-18T11:12:19.962 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:20.024 INFO:tasks.ceph.osd.6:Stopped 2024-02-18T11:12:20.024 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-18T11:12:20.024 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:20.095 INFO:tasks.ceph.osd.7:Stopped 2024-02-18T11:12:20.095 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-18T11:12:20.095 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-18T11:12:20.096 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:20.121 INFO:tasks.ceph.mgr.y:Stopped 2024-02-18T11:12:20.122 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-18T11:12:20.122 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:20.145 INFO:tasks.ceph.mgr.x:Stopped 2024-02-18T11:12:20.146 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-18T11:12:20.146 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-18T11:12:20.146 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:20.175 INFO:tasks.ceph.mon.a:Stopped 2024-02-18T11:12:20.175 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-18T11:12:20.175 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:20.197 INFO:tasks.ceph.mon.b:Stopped 2024-02-18T11:12:20.197 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-18T11:12:20.197 INFO:teuthology.orchestra.run:waiting for 300 2024-02-18T11:12:20.248 INFO:tasks.ceph.mon.c:Stopped 2024-02-18T11:12:20.249 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-18T11:12:20.249 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-18T11:12:20.337 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T11:12:20.338 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-18T11:12:21.193 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T11:12:21.194 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-18T11:12:21.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T11:12:21.371 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-18T11:12:21.459 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T11:12:21.459 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-18T11:12:21.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T11:12:21.563 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-18T11:12:21.803 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T11:12:21.803 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-18T11:12:21.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T11:12:21.923 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-18T11:12:21.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T11:12:21.992 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-18T11:12:22.093 INFO:tasks.ceph:Archiving mon data... 2024-02-18T11:12:22.094 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/data/mon.a.tgz 2024-02-18T11:12:22.095 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-02-18T11:12:22.109 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.RtkchRfZFI 2024-02-18T11:12:22.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RtkchRfZFI 2024-02-18T11:12:22.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.RtkchRfZFI 2024-02-18T11:12:22.343 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.RtkchRfZFI is 295KB 2024-02-18T11:12:22.439 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.RtkchRfZFI 2024-02-18T11:12:22.453 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/data/mon.b.tgz 2024-02-18T11:12:22.453 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-02-18T11:12:22.468 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.VXOlLKuGhi 2024-02-18T11:12:22.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VXOlLKuGhi 2024-02-18T11:12:22.604 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.VXOlLKuGhi 2024-02-18T11:12:22.700 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.VXOlLKuGhi is 305KB 2024-02-18T11:12:22.797 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.VXOlLKuGhi 2024-02-18T11:12:22.812 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/data/mon.c.tgz 2024-02-18T11:12:22.812 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-02-18T11:12:22.866 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.D6o6D3anVn 2024-02-18T11:12:22.867 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.D6o6D3anVn 2024-02-18T11:12:22.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.D6o6D3anVn 2024-02-18T11:12:23.075 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.D6o6D3anVn is 305KB 2024-02-18T11:12:23.170 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.D6o6D3anVn 2024-02-18T11:12:23.184 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-18T11:12:23.185 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-18T11:12:23.187 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-18T11:12:23.226 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-18T11:12:23.354 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-18T11:12:23.370 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-18T11:12:23.434 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-18T11:12:23.435 INFO:tasks.ceph:Archiving crash dumps... 2024-02-18T11:12:23.437 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi118/crash 2024-02-18T11:12:23.437 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-18T11:12:23.464 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi164/crash 2024-02-18T11:12:23.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-18T11:12:23.493 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi204/crash 2024-02-18T11:12:23.494 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-18T11:12:23.604 INFO:tasks.ceph:Shutting down logrotate 2024-02-18T11:13:23.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-18T11:13:23.084 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-18T11:13:23.130 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-18T11:13:23.231 INFO:tasks.ceph:Compressing logs... 2024-02-18T11:13:23.232 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-18T11:13:23.237 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-18T11:13:23.240 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-18T11:13:23.282 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-18T11:13:23.282 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-02-18T11:13:23.282 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.38102.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38222.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38342.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38142.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38302.log 2024-02-18T11:13:23.283 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38182.log 2024-02-18T11:13:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-18T11:13:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38302.log: /var/log/ceph/ceph-client.admin.38182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38262.log 2024-02-18T11:13:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38062.log 2024-02-18T11:13:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.38262.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-18T11:13:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-18T11:13:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.38062.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-18T11:13:23.286 INFO:teuthology.orchestra.run.smithi164.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-02-18T11:13:23.291 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-mon.c.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38062.log.gz 2024-02-18T11:13:23.298 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51701.log 2024-02-18T11:13:23.298 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53230.log 2024-02-18T11:13:23.298 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-02-18T11:13:23.298 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51701.log: /var/log/ceph/ceph-client.admin.53230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51617.log 2024-02-18T11:13:23.298 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51701.log.gz 2024-02-18T11:13:23.298 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47702.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53230.log.gz 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48080.log 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51617.log.gz 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48410.log 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48080.log: /var/log/ceph/ceph-client.admin.52854.log 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz 2024-02-18T11:13:23.299 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47492.log 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44790.log 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45467.log 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52854.log.gz 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47996.log/var/log/ceph/ceph-client.admin.45467.log: 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46921.log 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47744.log 2024-02-18T11:13:23.300 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43922.log 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45467.log.gz 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44795.log 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52602.log 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47131.log 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46753.log 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2024-02-18T11:13:23.301 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2024-02-18T11:13:23.302 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46627.log 2024-02-18T11:13:23.302 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46309.log 2024-02-18T11:13:23.302 INFO:teuthology.orchestra.run.smithi164.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-18T11:13:23.308 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32141.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48565.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49169.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44260.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46795.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45127.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48471.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46267.log 2024-02-18T11:13:23.309 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46543.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47660.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45131.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51659.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47408.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49127.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45130.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44796.log 2024-02-18T11:13:23.310 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44386.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52308.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47366.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51911.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48038.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2024-02-18T11:13:23.311 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48650.log 2024-02-18T11:13:23.312 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47450.log 2024-02-18T11:13:23.312 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46879.log 2024-02-18T11:13:23.312 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48915.log 2024-02-18T11:13:23.312 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2024-02-18T11:13:23.312 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48873.log 2024-02-18T11:13:23.312 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45931.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47215.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48202.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53022.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52770.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52896.log 2024-02-18T11:13:23.313 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44008.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46501.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47954.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53106.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47912.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48122.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45465.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2024-02-18T11:13:23.314 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49361.log 2024-02-18T11:13:23.315 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2024-02-18T11:13:23.358 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38222.log.gz 2024-02-18T11:13:23.358 INFO:teuthology.orchestra.run.smithi164.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38262.log.gz 2024-02-18T11:13:23.358 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38302.log.gz 2024-02-18T11:13:23.358 INFO:teuthology.orchestra.run.smithi164.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38342.log.gz 2024-02-18T11:13:23.363 INFO:teuthology.orchestra.run.smithi164.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-18T11:13:23.366 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46963.log 2024-02-18T11:13:23.366 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49767.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45461.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43533.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51827.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51953.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-02-18T11:13:23.367 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52938.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49725.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47828.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46057.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45790.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46141.log 2024-02-18T11:13:23.368 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46669.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52518.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48521.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52560.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52980.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51743.log 2024-02-18T11:13:23.369 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48734.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38042.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51785.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47047.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53272.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44785.log 2024-02-18T11:13:23.370 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46417.log 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47131.log: /var/log/ceph/ceph-client.admin.46417.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52602.log.gz 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46753.log: 87.9%/var/log/ceph/ceph-client.admin.45129.log: -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46015.log: /var/log/ceph/ceph-client.admin.44302.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48080.log.gz 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47996.log.gz 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46627.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47744.log.gz 2024-02-18T11:13:23.371 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46309.log: /var/log/ceph/ceph.tmp-client.admin.32141.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48565.log: /var/log/ceph/ceph-client.admin.48692.log 2024-02-18T11:13:23.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49169.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32141.log.gz 2024-02-18T11:13:23.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45748.log: /var/log/ceph/ceph-client.admin.52476.log: /var/log/ceph/ceph-client.admin.44260.log: /var/log/ceph/ceph-client.admin.46795.log: /var/log/ceph/ceph-client.admin.45127.log: /var/log/ceph/ceph-client.admin.48471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45132.log 2024-02-18T11:13:23.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46267.log: /var/log/ceph/ceph-client.admin.46543.log: /var/log/ceph/ceph-client.admin.47660.log: /var/log/ceph/ceph-client.admin.45131.log: /var/log/ceph/ceph-client.admin.51659.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-02-18T11:13:23.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45466.log: /var/log/ceph/ceph-client.admin.47408.log: /var/log/ceph/ceph-client.admin.48692.log: gzip/var/log/ceph/ceph-client.admin.49127.log: -5 --verbose --/var/log/ceph/ceph-client.admin.45130.log: /var/log/ceph/ceph-client.admin.44796.log: /var/log/ceph/ceph-client.admin.52140.log 2024-02-18T11:13:23.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44386.log: /var/log/ceph/ceph-client.admin.46375.log: /var/log/ceph/ceph-client.admin.45132.log: /var/log/ceph/ceph-client.admin.44092.log: /var/log/ceph/ceph-client.admin.49295.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51659.log.gz 2024-02-18T11:13:23.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52308.log: /var/log/ceph/ceph-client.admin.47366.log: /var/log/ceph/ceph-client.admin.51911.log: /var/log/ceph/ceph-client.admin.48038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45706.log 2024-02-18T11:13:23.372 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38412.log: /var/log/ceph/ceph-client.admin.48650.log: /var/log/ceph/ceph-client.admin.47450.log: /var/log/ceph/ceph-client.admin.46879.log: 88.0% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51911.log.gz 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52308.log.gz 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48915.log: -- replaced with /var/log/ceph/ceph-client.admin.48410.log.gz 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52140.log: /var/log/ceph/ceph-client.admin.45847.log: /var/log/ceph/ceph-client.admin.48873.log: /var/log/ceph/ceph-client.admin.48957.log: /var/log/ceph/ceph-client.admin.45931.log: /var/log/ceph/ceph-client.admin.47215.log: /var/log/ceph/ceph-client.admin.48202.log: /var/log/ceph/ceph-client.admin.53022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47257.log 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52140.log.gz 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52770.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53022.log.gz 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52770.log.gz 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43966.log: /var/log/ceph/ceph-client.admin.44008.log: /var/log/ceph/ceph-client.admin.46501.log: /var/log/ceph/ceph-client.admin.47954.log: /var/log/ceph/ceph-client.admin.52896.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-18T11:13:23.373 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53106.log: /var/log/ceph/ceph-client.admin.47912.log: /var/log/ceph/ceph-client.admin.48122.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43922.log.gz 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47257.log: /var/log/ceph/ceph-client.admin.45465.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52896.log.gz 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47005.log 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49085.log: /var/log/ceph/ceph-client.admin.49361.log: /var/log/ceph/ceph-client.admin.43743.log: /var/log/ceph/ceph-osd.3.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53106.log.gz 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46963.log: /var/log/ceph/ceph-client.admin.49767.log: /var/log/ceph/ceph-client.admin.45461.log: /var/log/ceph/ceph-client.admin.45456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49001.log 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43533.log: /var/log/ceph/ceph-client.admin.51827.log: /var/log/ceph/ceph-client.admin.51953.log: /var/log/ceph/ceph-client.admin.49501.log: /var/log/ceph/ceph-client.admin.44470.log: /var/log/ceph/ceph-client.admin.47005.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51827.log.gz 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51953.log.gzgzip 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2024-02-18T11:13:23.374 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49253.log: /var/log/ceph/ceph-client.admin.52938.log: /var/log/ceph/ceph-client.admin.49725.log: /var/log/ceph/ceph-client.admin.47828.log: /var/log/ceph/ceph-client.admin.46057.log: /var/log/ceph/ceph-client.admin.44554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51491.log/var/log/ceph/ceph-client.admin.49001.log: 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45790.log: /var/log/ceph/ceph-client.admin.46141.log: /var/log/ceph/ceph-client.admin.46669.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52938.log.gz/var/log/ceph/ceph-client.admin.52518.log: 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48521.log: /var/log/ceph/ceph-client.admin.44134.log: gzip/var/log/ceph/ceph-client.admin.52560.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45462.log 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3%/var/log/ceph/ceph-client.admin.51491.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48565.log.gz 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52518.log.gz 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47534.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52560.log.gz 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr:gzip 87.9%/var/log/ceph/ceph-client.admin.43613.log: -- replaced with /var/log/ceph/ceph-client.admin.44790.log.gz 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.1.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51491.log.gz 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -5 --verbose/var/log/ceph/ceph-client.admin.52980.log: -- replaced with /var/log/ceph/ceph-client.admin.44795.log.gz 2024-02-18T11:13:23.375 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51743.log: --/var/log/ceph/ceph-client.admin.45118.log: /var/log/ceph/ceph-client.admin.51533.log 2024-02-18T11:13:23.376 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48734.log: /var/log/ceph/ceph-client.admin.44050.log: /var/log/ceph/ceph-client.admin.38042.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52980.log.gz 2024-02-18T11:13:23.376 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51743.log.gz 2024-02-18T11:13:23.376 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51785.log: /var/log/ceph/ceph-client.admin.45462.log: /var/log/ceph/ceph-client.admin.47047.log: /var/log/ceph/ceph-client.admin.53272.log: /var/log/ceph/ceph-client.admin.44785.log: /var/log/ceph/ceph-client.admin.51533.log: /var/log/ceph/ceph-client.admin.43437.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51785.log.gz 2024-02-18T11:13:23.376 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52728.log 2024-02-18T11:13:23.376 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53272.log.gz 2024-02-18T11:13:23.376 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51533.log.gz 2024-02-18T11:13:23.376 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53190.log 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43867.log 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5%/var/log/ceph/ceph-client.admin.53190.log: -- replaced with /var/log/ceph/ceph-client.admin.52728.log.gz 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53064.log 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43867.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.53190.log.gz 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53148.log 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46585.log 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.53148.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53064.log.gz 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2024-02-18T11:13:23.377 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46183.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53148.log.gz 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44791.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46183.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47870.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44793.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49211.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46837.log 2024-02-18T11:13:23.378 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47618.log 2024-02-18T11:13:23.379 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43659.log 2024-02-18T11:13:23.379 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gz 2024-02-18T11:13:23.379 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46711.log 2024-02-18T11:13:23.379 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52812.log 2024-02-18T11:13:23.379 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49043.log 2024-02-18T11:13:23.379 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51407.log 2024-02-18T11:13:23.379 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2024-02-18T11:13:23.380 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52812.log.gz 2024-02-18T11:13:23.380 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51407.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-18T11:13:23.380 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52037.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.51407.log.gz 2024-02-18T11:13:23.380 INFO:teuthology.orchestra.run.smithi118.stderr: /var/log/ceph/ceph-client.admin.45973.log 2024-02-18T11:13:23.380 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.0.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz 2024-02-18T11:13:23.380 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52392.log 2024-02-18T11:13:23.380 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47173.log 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52266.log 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52392.log.gz 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47786.log 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51995.log 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52266.log: /var/log/ceph/ceph-client.admin.47786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45664.log 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52266.log.gz 2024-02-18T11:13:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51995.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45664.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51995.log.gz 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48471.log.gz 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52350.log 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46267.log.gz 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45122.log 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2024-02-18T11:13:23.382 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47089.log 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49127.log.gz 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52350.log: /var/log/ceph/ceph-client.admin.45122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45468.log 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46309.log.gz 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47089.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52350.log.gz 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43701.log 2024-02-18T11:13:23.383 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47786.log.gz 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47870.log.gz 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47912.log.gz 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47954.log.gz 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52182.log 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48038.log.gz 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48122.log.gz 2024-02-18T11:13:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52434.log 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44218.log: /var/log/ceph/ceph-client.admin.52182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48325.log 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45465.log.gz 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45468.log.gz 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52182.log.gz 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52686.log 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48608.log 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52434.log.gz 2024-02-18T11:13:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.52686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44512.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44787.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52686.log.gz 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45119.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44512.log: /var/log/ceph/ceph-client.admin.44787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38293.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45119.log: /var/log/ceph/ceph-client.admin.45889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44794.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.38293.log: /var/log/ceph/ceph-client.admin.44344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52644.log 2024-02-18T11:13:23.386 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49459.log 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44794.log: /var/log/ceph/ceph-client.admin.52644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.49459.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52644.log.gz 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51869.log 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48283.log 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44614.log: /var/log/ceph/ceph-client.admin.51869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43803.log 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48283.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51869.log.gz 2024-02-18T11:13:23.387 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46099.log 2024-02-18T11:13:23.388 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47576.log 2024-02-18T11:13:23.388 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43803.log: /var/log/ceph/ceph-client.admin.46099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-02-18T11:13:23.388 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.47576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2024-02-18T11:13:23.388 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-02-18T11:13:23.388 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.51575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2024-02-18T11:13:23.388 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.46459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52079.log 2024-02-18T11:13:23.388 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45328.log: /var/log/ceph/ceph-client.admin.52079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48367.log 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48822.log 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52079.log.gz 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47299.log 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.48822.log: /var/log/ceph/ceph-client.admin.47299.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47131.log.gz 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47408.log.gz 2024-02-18T11:13:23.389 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47492.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44008.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44260.log.gz 2024-02-18T11:13:23.390 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47660.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44793.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49459.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49361.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47366.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47299.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47257.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47215.log.gz 2024-02-18T11:13:23.391 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47450.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48692.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48734.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48873.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48822.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48915.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38042.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2024-02-18T11:13:23.392 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45706.log.gz 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45664.log.gz 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45931.log.gz 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45973.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45790.log.gz 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46141.log.gz 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46057.log.gz 2024-02-18T11:13:23.393 INFO:teuthology.orchestra.run.smithi118.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46099.log.gz 2024-02-18T11:13:23.394 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49001.log.gz 2024-02-18T11:13:23.394 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-02-18T11:13:23.394 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2024-02-18T11:13:23.394 INFO:teuthology.orchestra.run.smithi118.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49043.log.gz 2024-02-18T11:13:23.394 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz 2024-02-18T11:13:23.394 INFO:teuthology.orchestra.run.smithi118.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48521.log.gz 2024-02-18T11:13:23.394 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44794.log.gz 2024-02-18T11:13:23.396 INFO:teuthology.orchestra.run.smithi164.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38142.log.gz 2024-02-18T11:13:23.396 INFO:teuthology.orchestra.run.smithi164.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38182.log.gz 2024-02-18T11:13:23.398 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48650.log.gz 2024-02-18T11:13:23.398 INFO:teuthology.orchestra.run.smithi118.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-18T11:13:23.398 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47047.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47089.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47576.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48202.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48283.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48325.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48367.log.gz 2024-02-18T11:13:23.399 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44785.log.gz 2024-02-18T11:13:23.400 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-18T11:13:23.403 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-02-18T11:13:23.405 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198206.log 2024-02-18T11:13:23.406 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200352.log 2024-02-18T11:13:23.406 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169896.log 2024-02-18T11:13:23.406 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254978.log 2024-02-18T11:13:23.406 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232169.log 2024-02-18T11:13:23.406 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262972.log 2024-02-18T11:13:23.406 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230587.log 2024-02-18T11:13:23.407 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160811.log 2024-02-18T11:13:23.407 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230788.log 2024-02-18T11:13:23.407 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186373.log 2024-02-18T11:13:23.407 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.169896.log: /var/log/ceph/ceph-client.admin.254978.log: /var/log/ceph/ceph-client.admin.230788.log: /var/log/ceph/ceph-client.admin.232169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169896.log.gz 2024-02-18T11:13:23.407 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254978.log.gz 2024-02-18T11:13:23.407 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230788.log.gz 2024-02-18T11:13:23.408 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232169.log.gz 2024-02-18T11:13:23.408 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177750.log 2024-02-18T11:13:23.408 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0%/var/log/ceph/ceph-client.admin.230587.log: -- replaced with /var/log/ceph/ceph-client.admin.262972.log.gz 2024-02-18T11:13:23.408 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.200352.log: /var/log/ceph/ceph-client.admin.198206.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230587.log.gz -- replaced with /var/log/ceph/ceph-client.admin.200352.log.gz 2024-02-18T11:13:23.408 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-02-18T11:13:23.408 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198206.log.gz 2024-02-18T11:13:23.409 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122288.log 2024-02-18T11:13:23.409 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160811.log.gz 2024-02-18T11:13:23.409 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186373.log.gz 2024-02-18T11:13:23.409 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.177750.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.199899.log 2024-02-18T11:13:23.409 INFO:teuthology.orchestra.run.smithi204.stderr: -- replaced with /var/log/ceph/ceph-client.admin.177750.log.gz 2024-02-18T11:13:23.409 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122288.log.gz 2024-02-18T11:13:23.410 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160860.log 2024-02-18T11:13:23.410 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.199899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202642.log 2024-02-18T11:13:23.410 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199899.log.gz 2024-02-18T11:13:23.410 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160860.log.gz 2024-02-18T11:13:23.410 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169494.log 2024-02-18T11:13:23.410 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188024.log 2024-02-18T11:13:23.420 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2024-02-18T11:13:23.420 INFO:teuthology.orchestra.run.smithi118.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46921.log.gz 2024-02-18T11:13:23.420 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46417.log.gz 2024-02-18T11:13:23.420 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43533.log.gz 2024-02-18T11:13:23.420 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44386.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46543.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46627.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46753.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46795.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46837.log.gz 2024-02-18T11:13:23.421 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46879.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47005.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46963.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49169.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49211.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46501.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46711.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz 2024-02-18T11:13:23.422 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46669.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47173.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44791.log.gz 2024-02-18T11:13:23.423 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44796.log.gz 2024-02-18T11:13:23.424 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gz 2024-02-18T11:13:23.424 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45132.log.gz 2024-02-18T11:13:23.424 INFO:teuthology.orchestra.run.smithi118.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45131.log.gz 2024-02-18T11:13:23.424 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45122.log.gz 2024-02-18T11:13:23.424 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45127.log.gz 2024-02-18T11:13:23.424 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-02-18T11:13:23.424 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49767.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49725.log.gz 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46183.log.gz 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47828.log.gz 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48608.log.gz 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44787.log.gz 2024-02-18T11:13:23.425 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2024-02-18T11:13:23.427 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45461.log.gz 2024-02-18T11:13:23.427 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45462.log.gz 2024-02-18T11:13:23.433 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202642.log.gz 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.169494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169494.log.gz 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246352.log 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271911.log 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188024.log.gz 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.246352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147948.log 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246352.log.gz 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.271911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271911.log.gz 2024-02-18T11:13:23.434 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271415.log 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.147948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233862.log 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147948.log.gz 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.271415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271415.log.gz 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134749.log 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.233862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233862.log.gzgzip 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.198292.log 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.134749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134749.log.gz 2024-02-18T11:13:23.435 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255212.log 2024-02-18T11:13:23.436 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.198292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198292.log.gz 2024-02-18T11:13:23.436 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252776.log 2024-02-18T11:13:23.436 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.255212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255212.log.gz 2024-02-18T11:13:23.436 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181636.log 2024-02-18T11:13:23.436 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.252776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252776.log.gz 2024-02-18T11:13:23.436 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150300.log 2024-02-18T11:13:23.439 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181636.log.gz 2024-02-18T11:13:23.439 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277256.log 2024-02-18T11:13:23.439 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.150300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135344.log 2024-02-18T11:13:23.439 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150300.log.gz 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.277256.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.277256.log.gz --verbose 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr: -- /var/log/ceph/ceph-client.admin.184715.log 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.135344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135344.log.gz 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232618.log 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184715.log.gz 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202383.log 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232618.log.gz 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166045.log 2024-02-18T11:13:23.440 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202383.log.gz 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184728.log 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166045.log.gz 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169110.log 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184728.log.gz 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190609.log 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.169110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169110.log.gz 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259621.log 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.190609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190609.log.gz 2024-02-18T11:13:23.441 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264470.log 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.259621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259621.log.gz 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180186.log 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264470.log.gz 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232323.log 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180186.log.gz 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177366.log 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232323.log.gz 2024-02-18T11:13:23.442 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110741.log 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.177366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177366.log.gz 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189680.log 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.110741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110741.log.gz 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122381.log 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.189680.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.189680.log.gz -- 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr: /var/log/ceph/ceph-client.admin.253757.log 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122381.log.gz 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188467.log 2024-02-18T11:13:23.443 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.253757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253757.log.gz 2024-02-18T11:13:23.444 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160178.log 2024-02-18T11:13:23.444 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188467.log.gz 2024-02-18T11:13:23.444 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181850.log 2024-02-18T11:13:23.444 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160178.log.gz 2024-02-18T11:13:23.444 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190948.log 2024-02-18T11:13:23.444 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181850.log.gz 2024-02-18T11:13:23.444 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201169.log 2024-02-18T11:13:23.452 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.190948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190948.log.gz 2024-02-18T11:13:23.452 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122604.log 2024-02-18T11:13:23.452 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.201169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201169.log.gz 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159964.log 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122604.log.gz 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161521.log 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.159964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159964.log.gz 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171834.log 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.161521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161521.log.gz 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219800.log 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.171834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171834.log.gz 2024-02-18T11:13:23.453 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263186.log 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.219800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219800.log.gz 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122645.log 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263186.log.gz 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187822.log 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263400.log 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122645.log.gz 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.187822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187822.log.gz 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189119.log 2024-02-18T11:13:23.454 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263400.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263400.log.gz 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.122302.log 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.189119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189119.log.gz 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222590.log 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186840.log 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122302.log.gz 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222590.log.gz 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134736.log 2024-02-18T11:13:23.455 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186840.log.gz 2024-02-18T11:13:23.456 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265540.log 2024-02-18T11:13:23.456 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.134736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134736.log.gz 2024-02-18T11:13:23.456 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110754.log 2024-02-18T11:13:23.456 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232369.log 2024-02-18T11:13:23.456 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265540.log.gz 2024-02-18T11:13:23.456 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.110754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231421.log 2024-02-18T11:13:23.456 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110754.log.gz 2024-02-18T11:13:23.457 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232369.log.gz 2024-02-18T11:13:23.457 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201372.log 2024-02-18T11:13:23.457 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.231421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231421.log.gz 2024-02-18T11:13:23.457 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232439.log 2024-02-18T11:13:23.457 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.201372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232462.log 2024-02-18T11:13:23.457 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201372.log.gz 2024-02-18T11:13:23.463 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232439.log.gz 2024-02-18T11:13:23.463 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181239.log 2024-02-18T11:13:23.463 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232462.log.gz 2024-02-18T11:13:23.463 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186878.log 2024-02-18T11:13:23.463 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221174.log 2024-02-18T11:13:23.463 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181239.log.gz 2024-02-18T11:13:23.463 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255012.log 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186878.log.gz 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.221174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221174.log.gz 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110052.log 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.255012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255012.log.gz 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183616.log 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.110052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110052.log.gz 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255199.log 2024-02-18T11:13:23.464 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.183616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232485.log 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183616.log.gz 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.255199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255199.log.gzgzip 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.180173.log 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192246.log 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232485.log.gz 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259947.log 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180173.log.gz 2024-02-18T11:13:23.465 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.192246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192246.log.gz 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190596.log 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.259947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258883.log 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259947.log.gz 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.190596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165180.log 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190596.log.gz 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.258883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258883.log.gz 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242542.log 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.165180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165180.log.gz 2024-02-18T11:13:23.466 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154222.log 2024-02-18T11:13:23.467 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44512.log.gz 2024-02-18T11:13:23.468 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242542.log.gz 2024-02-18T11:13:23.469 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222832.log 2024-02-18T11:13:23.469 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.154222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200951.log 2024-02-18T11:13:23.469 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154222.log.gz 2024-02-18T11:13:23.469 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195797.log 2024-02-18T11:13:23.469 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222832.log.gz 2024-02-18T11:13:23.469 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.200951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200951.log.gz 2024-02-18T11:13:23.471 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145794.log 2024-02-18T11:13:23.471 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.195797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195797.log.gz 2024-02-18T11:13:23.472 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231216.log 2024-02-18T11:13:23.472 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.145794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145794.log.gz 2024-02-18T11:13:23.472 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122355.log 2024-02-18T11:13:23.472 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.231216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231216.log.gz 2024-02-18T11:13:23.472 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31858.log 2024-02-18T11:13:23.472 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122355.log.gz 2024-02-18T11:13:23.472 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231434.log 2024-02-18T11:13:23.473 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.0.31858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136816.log 2024-02-18T11:13:23.473 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31858.log.gz 2024-02-18T11:13:23.474 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.231434.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.265112.log -- replaced with /var/log/ceph/ceph-client.admin.231434.log.gz 2024-02-18T11:13:23.474 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-02-18T11:13:23.474 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.136816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136816.log.gz 2024-02-18T11:13:23.474 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265955.log 2024-02-18T11:13:23.474 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265112.log.gz 2024-02-18T11:13:23.475 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191369.log 2024-02-18T11:13:23.475 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265955.log.gz 2024-02-18T11:13:23.476 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123816.log 2024-02-18T11:13:23.476 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.191369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178243.log 2024-02-18T11:13:23.476 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191369.log.gz 2024-02-18T11:13:23.477 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.123816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123816.log.gz 2024-02-18T11:13:23.477 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256881.log 2024-02-18T11:13:23.477 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182697.log 2024-02-18T11:13:23.477 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178243.log.gz 2024-02-18T11:13:23.478 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.256881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256881.log.gz 2024-02-18T11:13:23.478 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232595.log 2024-02-18T11:13:23.479 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202408.log 2024-02-18T11:13:23.479 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182697.log.gz 2024-02-18T11:13:23.480 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232595.log.gz 2024-02-18T11:13:23.480 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257102.log 2024-02-18T11:13:23.481 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278051.log 2024-02-18T11:13:23.481 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202408.log.gz 2024-02-18T11:13:23.481 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.257102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257102.log.gz 2024-02-18T11:13:23.482 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134942.log 2024-02-18T11:13:23.483 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.278051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278051.log.gz 2024-02-18T11:13:23.483 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141127.log 2024-02-18T11:13:23.483 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.134942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134942.log.gz 2024-02-18T11:13:23.484 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178024.log 2024-02-18T11:13:23.484 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.141127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148969.log 2024-02-18T11:13:23.484 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141127.log.gz 2024-02-18T11:13:23.485 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178024.log.gz 2024-02-18T11:13:23.485 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257280.log 2024-02-18T11:13:23.486 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.148969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170482.log 2024-02-18T11:13:23.486 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148969.log.gz 2024-02-18T11:13:23.487 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.257280.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.257280.log.gz --verbose 2024-02-18T11:13:23.487 INFO:teuthology.orchestra.run.smithi204.stderr: -- /var/log/ceph/ceph-client.admin.160383.log 2024-02-18T11:13:23.488 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.170482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170482.log.gz 2024-02-18T11:13:23.488 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117196.log 2024-02-18T11:13:23.489 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160383.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.232277.log 2024-02-18T11:13:23.489 INFO:teuthology.orchestra.run.smithi204.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160383.log.gz 2024-02-18T11:13:23.490 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.117196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117196.log.gz 2024-02-18T11:13:23.490 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164966.log 2024-02-18T11:13:23.491 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180843.log 2024-02-18T11:13:23.491 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232277.log.gz 2024-02-18T11:13:23.492 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.164966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258488.log 2024-02-18T11:13:23.492 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164966.log.gz 2024-02-18T11:13:23.493 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180843.log.gz 2024-02-18T11:13:23.493 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179124.log 2024-02-18T11:13:23.494 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.258488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258488.log.gz 2024-02-18T11:13:23.494 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235299.log 2024-02-18T11:13:23.495 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167116.log 2024-02-18T11:13:23.495 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179124.log.gz 2024-02-18T11:13:23.495 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.235299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235299.log.gz 2024-02-18T11:13:23.496 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163753.log 2024-02-18T11:13:23.497 INFO:teuthology.orchestra.run.smithi118.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-18T11:13:23.498 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.167116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167116.log.gz 2024-02-18T11:13:23.498 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166461.log 2024-02-18T11:13:23.498 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163753.log.gz 2024-02-18T11:13:23.498 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264684.log 2024-02-18T11:13:23.499 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225447.log 2024-02-18T11:13:23.499 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166461.log.gz 2024-02-18T11:13:23.500 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260852.log 2024-02-18T11:13:23.500 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264684.log.gz 2024-02-18T11:13:23.501 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.225447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225447.log.gz 2024-02-18T11:13:23.501 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263614.log 2024-02-18T11:13:23.502 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.260852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155043.log 2024-02-18T11:13:23.502 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260852.log.gz 2024-02-18T11:13:23.503 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177152.log 2024-02-18T11:13:23.503 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263614.log.gz 2024-02-18T11:13:23.503 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.155043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155043.log.gz 2024-02-18T11:13:23.504 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116422.log 2024-02-18T11:13:23.505 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.177152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202586.log 2024-02-18T11:13:23.505 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177152.log.gz 2024-02-18T11:13:23.506 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.116422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168681.log 2024-02-18T11:13:23.506 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116422.log.gz 2024-02-18T11:13:23.507 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202586.log.gz 2024-02-18T11:13:23.507 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222577.log 2024-02-18T11:13:23.507 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.168681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168681.log.gz 2024-02-18T11:13:23.508 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263815.log 2024-02-18T11:13:23.509 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181863.log 2024-02-18T11:13:23.509 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222577.log.gz 2024-02-18T11:13:23.509 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263815.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.263815.log.gz 2024-02-18T11:13:23.510 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.138083.log 2024-02-18T11:13:23.510 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181863.log.gzgzip 2024-02-18T11:13:23.511 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.232346.log 2024-02-18T11:13:23.511 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.138083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138083.log.gz 2024-02-18T11:13:23.512 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117182.log 2024-02-18T11:13:23.513 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163967.log 2024-02-18T11:13:23.513 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232346.log.gz 2024-02-18T11:13:23.513 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.117182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163526.log 2024-02-18T11:13:23.514 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117182.log.gz 2024-02-18T11:13:23.514 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163967.log.gz 2024-02-18T11:13:23.515 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182974.log 2024-02-18T11:13:23.515 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184216.log 2024-02-18T11:13:23.516 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163526.log.gz 2024-02-18T11:13:23.517 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165808.log 2024-02-18T11:13:23.517 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182974.log.gz 2024-02-18T11:13:23.517 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184216.log.gz 2024-02-18T11:13:23.518 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222367.log 2024-02-18T11:13:23.518 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.165808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165808.log.gz 2024-02-18T11:13:23.519 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243184.log 2024-02-18T11:13:23.520 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197998.log 2024-02-18T11:13:23.520 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222367.log.gz 2024-02-18T11:13:23.520 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.243184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243184.log.gz 2024-02-18T11:13:23.521 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219056.log 2024-02-18T11:13:23.522 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.197998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242957.log 2024-02-18T11:13:23.522 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197998.log.gz 2024-02-18T11:13:23.522 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.219056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219056.log.gz 2024-02-18T11:13:23.523 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164199.log 2024-02-18T11:13:23.523 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-02-18T11:13:23.524 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242957.log.gz 2024-02-18T11:13:23.524 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257759.log 2024-02-18T11:13:23.525 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.164199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164199.log.gz 2024-02-18T11:13:23.525 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163740.log 2024-02-18T11:13:23.526 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.257759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243171.log 2024-02-18T11:13:23.526 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257759.log.gz 2024-02-18T11:13:23.527 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163740.log.gz 2024-02-18T11:13:23.527 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166675.log 2024-02-18T11:13:23.528 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.243171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243171.log.gz 2024-02-18T11:13:23.528 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192460.log 2024-02-18T11:13:23.529 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166675.log.gz 2024-02-18T11:13:23.529 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242756.log 2024-02-18T11:13:23.530 INFO:teuthology.orchestra.run.smithi164.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-18T11:13:23.530 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.192460.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.192460.log.gz 2024-02-18T11:13:23.530 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.233849.log 2024-02-18T11:13:23.531 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242756.log.gz 2024-02-18T11:13:23.531 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175436.log 2024-02-18T11:13:23.532 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2024-02-18T11:13:23.532 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.233849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233849.log.gz 2024-02-18T11:13:23.533 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262317.log 2024-02-18T11:13:23.533 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.175436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175436.log.gz 2024-02-18T11:13:23.533 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219026.log 2024-02-18T11:13:23.534 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262317.log.gz 2024-02-18T11:13:23.534 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225628.log 2024-02-18T11:13:23.535 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.219026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219026.log.gz 2024-02-18T11:13:23.535 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122557.log 2024-02-18T11:13:23.536 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.225628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225628.log.gz 2024-02-18T11:13:23.536 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227169.log 2024-02-18T11:13:23.537 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122557.log.gz 2024-02-18T11:13:23.537 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263387.log 2024-02-18T11:13:23.538 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.227169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227169.log.gz 2024-02-18T11:13:23.539 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228159.log 2024-02-18T11:13:23.539 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263387.log.gz 2024-02-18T11:13:23.540 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155005.log 2024-02-18T11:13:23.540 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.228159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165381.log 2024-02-18T11:13:23.541 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228159.log.gz 2024-02-18T11:13:23.541 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.155005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155005.log.gz 2024-02-18T11:13:23.542 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254945.log 2024-02-18T11:13:23.542 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.165381.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.165381.log.gz -- 2024-02-18T11:13:23.542 INFO:teuthology.orchestra.run.smithi204.stderr: /var/log/ceph/ceph-client.admin.219813.log 2024-02-18T11:13:23.543 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.254945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254945.log.gz 2024-02-18T11:13:23.543 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176755.log 2024-02-18T11:13:23.545 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.219813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232572.log 2024-02-18T11:13:23.545 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219813.log.gz 2024-02-18T11:13:23.545 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.176755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176755.log.gz 2024-02-18T11:13:23.546 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202370.log 2024-02-18T11:13:23.547 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166889.log 2024-02-18T11:13:23.547 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232572.log.gz 2024-02-18T11:13:23.547 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202370.log.gz 2024-02-18T11:13:23.548 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180830.log 2024-02-18T11:13:23.548 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242743.log 2024-02-18T11:13:23.549 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166889.log.gz 2024-02-18T11:13:23.549 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180830.log.gz 2024-02-18T11:13:23.550 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270685.log 2024-02-18T11:13:23.551 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242743.log.gz 2024-02-18T11:13:23.551 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258870.log 2024-02-18T11:13:23.552 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.270685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270685.log.gz 2024-02-18T11:13:23.552 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245105.log 2024-02-18T11:13:23.553 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.258870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258870.log.gz 2024-02-18T11:13:23.553 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175650.log 2024-02-18T11:13:23.554 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.245105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245105.log.gz 2024-02-18T11:13:23.554 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176741.log 2024-02-18T11:13:23.555 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.175650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175650.log.gz 2024-02-18T11:13:23.555 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160635.log 2024-02-18T11:13:23.556 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.176741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176741.log.gz 2024-02-18T11:13:23.556 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183389.log 2024-02-18T11:13:23.557 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160635.log.gz 2024-02-18T11:13:23.557 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234544.log 2024-02-18T11:13:23.558 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.183389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183389.log.gz 2024-02-18T11:13:23.559 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177797.log 2024-02-18T11:13:23.559 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.234544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234544.log.gz 2024-02-18T11:13:23.559 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235285.log 2024-02-18T11:13:23.560 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.177797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177797.log.gz 2024-02-18T11:13:23.561 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277240.log 2024-02-18T11:13:23.561 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.235285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235285.log.gz 2024-02-18T11:13:23.562 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242314.log 2024-02-18T11:13:23.562 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.277240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277240.log.gz 2024-02-18T11:13:23.563 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191356.log 2024-02-18T11:13:23.563 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242314.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.262531.log -- replaced with /var/log/ceph/ceph-client.admin.242314.log.gz 2024-02-18T11:13:23.564 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-02-18T11:13:23.565 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.191356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265099.log 2024-02-18T11:13:23.565 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191356.log.gz 2024-02-18T11:13:23.566 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262531.log.gz 2024-02-18T11:13:23.566 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170867.log 2024-02-18T11:13:23.567 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265099.log.gz 2024-02-18T11:13:23.567 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147481.log 2024-02-18T11:13:23.568 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.170867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170867.log.gz 2024-02-18T11:13:23.568 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161076.log 2024-02-18T11:13:23.569 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.147481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260131.log 2024-02-18T11:13:23.569 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147481.log.gz 2024-02-18T11:13:23.570 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.161076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161076.log.gzgzip 2024-02-18T11:13:23.570 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.263173.log 2024-02-18T11:13:23.571 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.260131.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.189106.log 2024-02-18T11:13:23.571 INFO:teuthology.orchestra.run.smithi204.stderr: -- replaced with /var/log/ceph/ceph-client.admin.260131.log.gz 2024-02-18T11:13:23.572 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253744.log 2024-02-18T11:13:23.572 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263173.log.gz 2024-02-18T11:13:23.573 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.189106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147746.log 2024-02-18T11:13:23.573 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189106.log.gz 2024-02-18T11:13:23.574 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38293.log.gz 2024-02-18T11:13:23.574 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.253744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227592.log 2024-02-18T11:13:23.574 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253744.log.gz 2024-02-18T11:13:23.576 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43803.log.gz 2024-02-18T11:13:23.576 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43701.log.gz 2024-02-18T11:13:23.576 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43867.log.gz 2024-02-18T11:13:23.576 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2024-02-18T11:13:23.577 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.147746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265754.log 2024-02-18T11:13:23.577 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147746.log.gz 2024-02-18T11:13:23.577 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.227592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266673.log 2024-02-18T11:13:23.577 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227592.log.gz 2024-02-18T11:13:23.578 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265754.log.gz 2024-02-18T11:13:23.578 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242970.log 2024-02-18T11:13:23.578 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.266673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266673.log.gz 2024-02-18T11:13:23.579 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200365.log 2024-02-18T11:13:23.579 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242970.log.gz 2024-02-18T11:13:23.580 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168909.log 2024-02-18T11:13:23.580 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.200365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200365.log.gz 2024-02-18T11:13:23.581 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163954.log 2024-02-18T11:13:23.582 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.168909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168909.log.gz 2024-02-18T11:13:23.582 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164752.log 2024-02-18T11:13:23.583 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163954.log.gz 2024-02-18T11:13:23.583 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178918.log 2024-02-18T11:13:23.584 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.164752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164752.log.gz 2024-02-18T11:13:23.585 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170880.log 2024-02-18T11:13:23.586 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178918.log.gz 2024-02-18T11:13:23.586 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203033.log 2024-02-18T11:13:23.587 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.170880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170880.log.gz 2024-02-18T11:13:23.587 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135683.log 2024-02-18T11:13:23.588 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.203033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203033.log.gz 2024-02-18T11:13:23.589 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262758.log 2024-02-18T11:13:23.589 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.135683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135683.log.gz 2024-02-18T11:13:23.590 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182914.log 2024-02-18T11:13:23.591 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262758.log.gz 2024-02-18T11:13:23.591 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200104.log 2024-02-18T11:13:23.592 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182914.log.gz 2024-02-18T11:13:23.593 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167103.log 2024-02-18T11:13:23.593 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.200104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200104.log.gz 2024-02-18T11:13:23.594 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261233.log 2024-02-18T11:13:23.595 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.167103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167103.log.gz 2024-02-18T11:13:23.595 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222814.log 2024-02-18T11:13:23.596 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.261233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261233.log.gz 2024-02-18T11:13:23.597 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234453.log 2024-02-18T11:13:23.599 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222814.log.gz 2024-02-18T11:13:23.599 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219040.log 2024-02-18T11:13:23.600 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43659.log.gz 2024-02-18T11:13:23.600 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.234453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234453.log.gz 2024-02-18T11:13:23.600 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182278.log 2024-02-18T11:13:23.601 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.219040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219040.log.gz 2024-02-18T11:13:23.601 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169123.log 2024-02-18T11:13:23.602 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182278.log.gz 2024-02-18T11:13:23.602 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258475.log 2024-02-18T11:13:23.603 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.169123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169123.log.gz 2024-02-18T11:13:23.603 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264042.log 2024-02-18T11:13:23.604 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.258475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258475.log.gz 2024-02-18T11:13:23.604 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178230.log 2024-02-18T11:13:23.605 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264042.log.gz 2024-02-18T11:13:23.605 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198012.log 2024-02-18T11:13:23.606 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178230.log.gz 2024-02-18T11:13:23.607 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232821.log 2024-02-18T11:13:23.607 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.198012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198012.log.gz 2024-02-18T11:13:23.608 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265313.log 2024-02-18T11:13:23.609 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256166.log 2024-02-18T11:13:23.609 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232821.log.gz 2024-02-18T11:13:23.610 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265313.log.gz 2024-02-18T11:13:23.610 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187809.log 2024-02-18T11:13:23.611 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.256166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256166.log.gz 2024-02-18T11:13:23.611 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171848.log 2024-02-18T11:13:23.612 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.187809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187809.log.gz 2024-02-18T11:13:23.612 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179967.log 2024-02-18T11:13:23.613 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.171848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159950.log 2024-02-18T11:13:23.613 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171848.log.gz 2024-02-18T11:13:23.614 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179967.log.gz 2024-02-18T11:13:23.614 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203046.log 2024-02-18T11:13:23.615 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.159950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159950.log.gz 2024-02-18T11:13:23.615 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183402.log 2024-02-18T11:13:23.616 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.203046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203046.log.gz 2024-02-18T11:13:23.617 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235091.log 2024-02-18T11:13:23.617 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.183402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183402.log.gz 2024-02-18T11:13:23.618 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188900.log 2024-02-18T11:13:23.619 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.235091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235091.log.gz 2024-02-18T11:13:23.619 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227579.log 2024-02-18T11:13:23.620 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188900.log.gz 2024-02-18T11:13:23.620 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161508.log 2024-02-18T11:13:23.621 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.227579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148955.log 2024-02-18T11:13:23.621 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227579.log.gz 2024-02-18T11:13:23.622 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.161508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161508.log.gz 2024-02-18T11:13:23.622 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264029.log 2024-02-18T11:13:23.623 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.148955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201185.log 2024-02-18T11:13:23.623 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148955.log.gz 2024-02-18T11:13:23.624 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264029.log.gz 2024-02-18T11:13:23.624 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182291.log 2024-02-18T11:13:23.625 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.201185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231203.log 2024-02-18T11:13:23.625 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201185.log.gz 2024-02-18T11:13:23.626 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182291.log.gz 2024-02-18T11:13:23.626 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232392.log 2024-02-18T11:13:23.628 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.231203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231203.log.gz 2024-02-18T11:13:23.628 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246365.log 2024-02-18T11:13:23.629 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232392.log.gz 2024-02-18T11:13:23.629 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264671.log 2024-02-18T11:13:23.630 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.246365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246365.log.gz 2024-02-18T11:13:23.630 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147723.log 2024-02-18T11:13:23.631 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264671.log.gz 2024-02-18T11:13:23.631 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180392.log 2024-02-18T11:13:23.632 INFO:teuthology.orchestra.run.smithi164.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-18T11:13:23.632 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.147723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147723.log.gz 2024-02-18T11:13:23.633 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250621.log 2024-02-18T11:13:23.633 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188239.log 2024-02-18T11:13:23.633 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180392.log.gz 2024-02-18T11:13:23.634 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.250621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250621.log.gz 2024-02-18T11:13:23.634 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195178.log 2024-02-18T11:13:23.635 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188239.log.gz 2024-02-18T11:13:23.635 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265968.log 2024-02-18T11:13:23.636 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.195178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195178.log.gz 2024-02-18T11:13:23.636 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196003.log 2024-02-18T11:13:23.637 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265968.log.gz 2024-02-18T11:13:23.638 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147710.log 2024-02-18T11:13:23.638 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.196003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196003.log.gz 2024-02-18T11:13:23.639 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261928.log 2024-02-18T11:13:23.640 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.147710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147710.log.gz 2024-02-18T11:13:23.640 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134171.log 2024-02-18T11:13:23.645 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.261928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261928.log.gz 2024-02-18T11:13:23.645 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198193.log 2024-02-18T11:13:23.645 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.134171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134171.log.gz 2024-02-18T11:13:23.645 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181649.log 2024-02-18T11:13:23.645 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.198193.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.198193.log.gz --verbose 2024-02-18T11:13:23.645 INFO:teuthology.orchestra.run.smithi204.stderr: -- /var/log/ceph/ceph-client.admin.178011.log 2024-02-18T11:13:23.647 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266197.log 2024-02-18T11:13:23.647 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181649.log.gz 2024-02-18T11:13:23.647 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184744.log 2024-02-18T11:13:23.647 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178011.log.gz 2024-02-18T11:13:23.648 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.266197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266197.log.gz 2024-02-18T11:13:23.648 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278065.log 2024-02-18T11:13:23.648 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184744.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.184744.log.gz --verbose 2024-02-18T11:13:23.648 INFO:teuthology.orchestra.run.smithi204.stderr: -- /var/log/ceph/ceph-client.admin.200165.log 2024-02-18T11:13:23.649 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.278065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278065.log.gz 2024-02-18T11:13:23.649 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182961.log 2024-02-18T11:13:23.649 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.200165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163325.log 2024-02-18T11:13:23.649 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200165.log.gz 2024-02-18T11:13:23.650 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182961.log.gz 2024-02-18T11:13:23.650 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152698.log 2024-02-18T11:13:23.651 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163325.log.gz 2024-02-18T11:13:23.651 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263601.log 2024-02-18T11:13:23.652 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.152698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152698.log.gz 2024-02-18T11:13:23.652 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259690.log 2024-02-18T11:13:23.653 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263601.log.gz 2024-02-18T11:13:23.654 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179954.log 2024-02-18T11:13:23.654 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.259690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259690.log.gz 2024-02-18T11:13:23.655 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134929.log 2024-02-18T11:13:23.655 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179954.log.gz 2024-02-18T11:13:23.656 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179343.log 2024-02-18T11:13:23.657 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.134929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134929.log.gz 2024-02-18T11:13:23.657 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163539.log 2024-02-18T11:13:23.658 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179343.log.gz 2024-02-18T11:13:23.659 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179735.log 2024-02-18T11:13:23.659 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163539.log.gz 2024-02-18T11:13:23.660 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259607.log 2024-02-18T11:13:23.661 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179735.log.gz 2024-02-18T11:13:23.661 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165761.log 2024-02-18T11:13:23.662 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.259607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259607.log.gz 2024-02-18T11:13:23.663 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265741.log 2024-02-18T11:13:23.663 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.165761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165761.log.gz 2024-02-18T11:13:23.664 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162919.log 2024-02-18T11:13:23.664 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265741.log.gz 2024-02-18T11:13:23.665 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194748.log 2024-02-18T11:13:23.666 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.162919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188686.log 2024-02-18T11:13:23.666 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162919.log.gz 2024-02-18T11:13:23.667 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.194748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194748.log.gz 2024-02-18T11:13:23.667 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180405.log 2024-02-18T11:13:23.668 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188686.log.gz 2024-02-18T11:13:23.668 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186333.log 2024-02-18T11:13:23.669 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180405.log.gz 2024-02-18T11:13:23.669 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231990.log 2024-02-18T11:13:23.670 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186333.log.gz 2024-02-18T11:13:23.670 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227380.log 2024-02-18T11:13:23.671 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.231990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231990.log.gz 2024-02-18T11:13:23.672 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161089.log 2024-02-18T11:13:23.672 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.227380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227380.log.gz 2024-02-18T11:13:23.673 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255592.log 2024-02-18T11:13:23.674 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.161089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182064.log 2024-02-18T11:13:23.674 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161089.log.gz 2024-02-18T11:13:23.675 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.255592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255592.log.gz 2024-02-18T11:13:23.675 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149153.log 2024-02-18T11:13:23.676 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151219.log 2024-02-18T11:13:23.676 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182064.log.gz 2024-02-18T11:13:23.677 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.149153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149153.log.gz 2024-02-18T11:13:23.677 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181437.log 2024-02-18T11:13:23.678 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.151219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122677.log 2024-02-18T11:13:23.678 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151219.log.gz 2024-02-18T11:13:23.679 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181437.log.gz 2024-02-18T11:13:23.679 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226945.log 2024-02-18T11:13:23.680 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220011.log 2024-02-18T11:13:23.680 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122677.log.gz 2024-02-18T11:13:23.681 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.226945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226945.log.gz 2024-02-18T11:13:23.681 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202629.log 2024-02-18T11:13:23.682 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.220011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182734.log 2024-02-18T11:13:23.682 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220011.log.gz 2024-02-18T11:13:23.683 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202629.log.gz 2024-02-18T11:13:23.683 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232834.log 2024-02-18T11:13:23.684 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194734.log 2024-02-18T11:13:23.684 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182734.log.gz 2024-02-18T11:13:23.685 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232834.log.gz 2024-02-18T11:13:23.685 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135139.log 2024-02-18T11:13:23.686 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.194734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194734.log.gz 2024-02-18T11:13:23.687 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219998.log 2024-02-18T11:13:23.688 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.135139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135139.log.gz 2024-02-18T11:13:23.688 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183188.log 2024-02-18T11:13:23.688 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.219998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219998.log.gz 2024-02-18T11:13:23.689 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186613.log 2024-02-18T11:13:23.690 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.183188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166260.log 2024-02-18T11:13:23.690 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183188.log.gz 2024-02-18T11:13:23.691 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262330.log 2024-02-18T11:13:23.691 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186613.log.gz 2024-02-18T11:13:23.692 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166032.log 2024-02-18T11:13:23.692 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166260.log.gz 2024-02-18T11:13:23.693 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262330.log.gz 2024-02-18T11:13:23.693 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184917.log 2024-02-18T11:13:23.694 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166032.log.gz 2024-02-18T11:13:23.694 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155220.log 2024-02-18T11:13:23.695 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184917.log.gz 2024-02-18T11:13:23.695 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259904.log 2024-02-18T11:13:23.696 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.155220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155220.log.gz 2024-02-18T11:13:23.696 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180624.log 2024-02-18T11:13:23.697 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.259904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259904.log.gz 2024-02-18T11:13:23.697 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183175.log 2024-02-18T11:13:23.698 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180624.log.gz 2024-02-18T11:13:23.698 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169507.log 2024-02-18T11:13:23.699 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.183175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183175.log.gz 2024-02-18T11:13:23.700 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265326.log 2024-02-18T11:13:23.700 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.169507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169507.log.gz 2024-02-18T11:13:23.701 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156052.log 2024-02-18T11:13:23.701 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265326.log.gz 2024-02-18T11:13:23.702 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242529.log 2024-02-18T11:13:23.702 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.156052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156052.log.gz 2024-02-18T11:13:23.703 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195165.log 2024-02-18T11:13:23.704 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242529.log.gz 2024-02-18T11:13:23.704 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188673.log 2024-02-18T11:13:23.704 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.195165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195165.log.gz 2024-02-18T11:13:23.705 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266423.log 2024-02-18T11:13:23.706 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188673.log.gz 2024-02-18T11:13:23.706 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188453.log 2024-02-18T11:13:23.707 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.266423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266423.log.gz 2024-02-18T11:13:23.707 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262959.log 2024-02-18T11:13:23.709 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188453.log.gz 2024-02-18T11:13:23.709 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166902.log 2024-02-18T11:13:23.709 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262959.log.gz 2024-02-18T11:13:23.710 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271171.log 2024-02-18T11:13:23.711 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166902.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.166902.log.gz /var/log/ceph/ceph-client.admin.271184.log 2024-02-18T11:13:23.711 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-02-18T11:13:23.711 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.271171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271171.log.gz 2024-02-18T11:13:23.712 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192259.log 2024-02-18T11:13:23.713 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.271184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271184.log.gz 2024-02-18T11:13:23.713 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230574.log 2024-02-18T11:13:23.714 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.192259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192259.log.gz 2024-02-18T11:13:23.715 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264256.log 2024-02-18T11:13:23.715 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.230574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230574.log.gz 2024-02-18T11:13:23.716 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220311.log 2024-02-18T11:13:23.717 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264256.log.gz 2024-02-18T11:13:23.717 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227156.log 2024-02-18T11:13:23.718 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.220311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220311.log.gz 2024-02-18T11:13:23.719 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199913.log 2024-02-18T11:13:23.720 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.227156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168896.log 2024-02-18T11:13:23.720 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227156.log.gz 2024-02-18T11:13:23.721 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.199913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140006.log 2024-02-18T11:13:23.721 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199913.log.gz 2024-02-18T11:13:23.722 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.168896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168896.log.gz 2024-02-18T11:13:23.722 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261246.log 2024-02-18T11:13:23.723 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.140006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140006.log.gz 2024-02-18T11:13:23.724 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270660.log 2024-02-18T11:13:23.724 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.261246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261246.log.gz 2024-02-18T11:13:23.725 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186656.log 2024-02-18T11:13:23.726 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.270660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277267.log 2024-02-18T11:13:23.726 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270660.log.gz 2024-02-18T11:13:23.727 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186656.log.gz 2024-02-18T11:13:23.727 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219228.log 2024-02-18T11:13:23.728 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.277267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277267.log.gz 2024-02-18T11:13:23.728 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222780.log 2024-02-18T11:13:23.729 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.219228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179137.log 2024-02-18T11:13:23.729 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219228.log.gz 2024-02-18T11:13:23.730 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122617.log 2024-02-18T11:13:23.730 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222780.log.gz 2024-02-18T11:13:23.730 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179137.log.gz 2024-02-18T11:13:23.731 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178905.log 2024-02-18T11:13:23.732 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122617.log.gz 2024-02-18T11:13:23.732 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177379.log 2024-02-18T11:13:23.732 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178905.log.gz 2024-02-18T11:13:23.733 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160598.log 2024-02-18T11:13:23.733 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.177379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177379.log.gz 2024-02-18T11:13:23.734 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198270.log 2024-02-18T11:13:23.734 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176953.log 2024-02-18T11:13:23.734 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160598.log.gz 2024-02-18T11:13:23.735 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.198270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198270.log.gzgzip 2024-02-18T11:13:23.735 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.261914.log 2024-02-18T11:13:23.736 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.176953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176953.log.gz 2024-02-18T11:13:23.736 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176940.log 2024-02-18T11:13:23.737 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.261914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261914.log.gz 2024-02-18T11:13:23.737 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263828.log 2024-02-18T11:13:23.738 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.176940.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.264457.log -- replaced with /var/log/ceph/ceph-client.admin.176940.log.gz 2024-02-18T11:13:23.738 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-02-18T11:13:23.738 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.263828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263828.log.gz 2024-02-18T11:13:23.739 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202848.log 2024-02-18T11:13:23.739 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264457.log.gz 2024-02-18T11:13:23.740 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227367.log 2024-02-18T11:13:23.740 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202848.log.gz 2024-02-18T11:13:23.740 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192022.log 2024-02-18T11:13:23.741 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.227367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227367.log.gz 2024-02-18T11:13:23.741 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122695.log 2024-02-18T11:13:23.742 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.192022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192022.log.gz 2024-02-18T11:13:23.742 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180611.log 2024-02-18T11:13:23.743 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122695.log.gz 2024-02-18T11:13:23.743 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200152.log 2024-02-18T11:13:23.744 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.180611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177810.log 2024-02-18T11:13:23.744 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180611.log.gz 2024-02-18T11:13:23.745 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.200152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200152.log.gz 2024-02-18T11:13:23.745 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235104.log 2024-02-18T11:13:23.745 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.177810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177810.log.gz 2024-02-18T11:13:23.746 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264898.log 2024-02-18T11:13:23.746 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.235104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235104.log.gz 2024-02-18T11:13:23.747 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198248.log 2024-02-18T11:13:23.747 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264898.log.gz 2024-02-18T11:13:23.747 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252790.log 2024-02-18T11:13:23.748 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.198248.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.135126.log 2024-02-18T11:13:23.748 INFO:teuthology.orchestra.run.smithi204.stderr: -- replaced with /var/log/ceph/ceph-client.admin.198248.log.gz 2024-02-18T11:13:23.749 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.252790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252790.log.gz 2024-02-18T11:13:23.749 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177165.log 2024-02-18T11:13:23.750 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.135126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135126.log.gz 2024-02-18T11:13:23.750 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220352.log 2024-02-18T11:13:23.751 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.177165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162905.log 2024-02-18T11:13:23.751 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177165.log.gz 2024-02-18T11:13:23.752 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.220352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220352.log.gz 2024-02-18T11:13:23.752 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141113.log 2024-02-18T11:13:23.753 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.162905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162905.log.gz 2024-02-18T11:13:23.753 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179748.log 2024-02-18T11:13:23.754 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.141113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141113.log.gz 2024-02-18T11:13:23.755 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257072.log 2024-02-18T11:13:23.755 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179748.log.gz 2024-02-18T11:13:23.756 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/xfstests-dev-results/results/check.log 2024-02-18T11:13:23.756 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.257072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257072.log.gz 2024-02-18T11:13:23.756 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182710.log 2024-02-18T11:13:23.757 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186891.log 2024-02-18T11:13:23.758 INFO:teuthology.orchestra.run.smithi204.stderr: 86.1% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2024-02-18T11:13:23.758 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182710.log.gz 2024-02-18T11:13:23.759 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232300.log 2024-02-18T11:13:23.759 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186891.log.gz 2024-02-18T11:13:23.760 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175637.log 2024-02-18T11:13:23.760 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232300.log.gz 2024-02-18T11:13:23.761 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232215.log 2024-02-18T11:13:23.761 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.175637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175637.log.gz 2024-02-18T11:13:23.762 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260144.log 2024-02-18T11:13:23.762 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166474.log 2024-02-18T11:13:23.763 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232215.log.gz 2024-02-18T11:13:23.763 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.260144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260144.log.gz 2024-02-18T11:13:23.763 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182505.log 2024-02-18T11:13:23.764 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166474.log.gz 2024-02-18T11:13:23.764 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242328.log 2024-02-18T11:13:23.765 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182505.log.gz 2024-02-18T11:13:23.766 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122326.log 2024-02-18T11:13:23.766 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.242328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242328.log.gz 2024-02-18T11:13:23.767 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161305.log 2024-02-18T11:13:23.767 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122326.log.gz 2024-02-18T11:13:23.768 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179356.log 2024-02-18T11:13:23.769 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.161305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161305.log.gz 2024-02-18T11:13:23.769 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154022.log 2024-02-18T11:13:23.769 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.179356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179356.log.gz 2024-02-18T11:13:23.770 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256371.log 2024-02-18T11:13:23.771 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.154022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154022.log.gz 2024-02-18T11:13:23.771 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191824.log 2024-02-18T11:13:23.772 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.256371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256371.log.gz 2024-02-18T11:13:23.773 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160165.log 2024-02-18T11:13:23.773 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.191824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191824.log.gz 2024-02-18T11:13:23.773 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178449.log 2024-02-18T11:13:23.774 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160165.log.gz 2024-02-18T11:13:23.774 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166247.log 2024-02-18T11:13:23.775 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178449.log.gz 2024-02-18T11:13:23.775 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151449.log 2024-02-18T11:13:23.776 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166247.log.gz 2024-02-18T11:13:23.776 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189667.log 2024-02-18T11:13:23.777 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.151449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151449.log.gz 2024-02-18T11:13:23.777 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266436.log 2024-02-18T11:13:23.778 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.189667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189667.log.gz 2024-02-18T11:13:23.778 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160585.log 2024-02-18T11:13:23.779 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.266436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266436.log.gz 2024-02-18T11:13:23.779 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186347.log 2024-02-18T11:13:23.780 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160585.log.gz 2024-02-18T11:13:23.780 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228936.log 2024-02-18T11:13:23.781 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186347.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.186347.log.gz 2024-02-18T11:13:23.781 INFO:teuthology.orchestra.run.smithi204.stderr: --verbose -- /var/log/ceph/ceph-client.admin.186555.log 2024-02-18T11:13:23.782 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.228936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228936.log.gz 2024-02-18T11:13:23.782 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31429.log 2024-02-18T11:13:23.783 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186555.log.gz 2024-02-18T11:13:23.783 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266660.log 2024-02-18T11:13:23.784 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.0.31429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31429.log.gz 2024-02-18T11:13:23.784 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266210.log 2024-02-18T11:13:23.785 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.266660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266660.log.gz 2024-02-18T11:13:23.785 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165167.log 2024-02-18T11:13:23.786 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.266210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266210.log.gz 2024-02-18T11:13:23.787 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188037.log 2024-02-18T11:13:23.787 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.165167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165167.log.gz 2024-02-18T11:13:23.787 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195811.log 2024-02-18T11:13:23.788 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188037.log.gz 2024-02-18T11:13:23.788 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160873.log 2024-02-18T11:13:23.789 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.195811.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195811.log.gz 2024-02-18T11:13:23.789 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.183603.log 2024-02-18T11:13:23.790 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160873.log.gz 2024-02-18T11:13:23.790 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165824.log 2024-02-18T11:13:23.791 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.183603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183603.log.gz 2024-02-18T11:13:23.792 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174626.log 2024-02-18T11:13:23.792 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.165824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165824.log.gz 2024-02-18T11:13:23.793 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147772.log 2024-02-18T11:13:23.793 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.174626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174626.log.gz 2024-02-18T11:13:23.794 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233646.log 2024-02-18T11:13:23.795 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.147772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147772.log.gz 2024-02-18T11:13:23.795 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151233.log 2024-02-18T11:13:23.796 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.233646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233646.log.gz 2024-02-18T11:13:23.796 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152712.log 2024-02-18T11:13:23.797 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.151233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151233.log.gz 2024-02-18T11:13:23.797 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178699.log 2024-02-18T11:13:23.798 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.152712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152712.log.gz 2024-02-18T11:13:23.798 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230359.log 2024-02-18T11:13:23.799 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178699.log.gz 2024-02-18T11:13:23.799 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233633.log 2024-02-18T11:13:23.800 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.230359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230359.log.gz 2024-02-18T11:13:23.800 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233819.log 2024-02-18T11:13:23.801 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.233633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233633.log.gz 2024-02-18T11:13:23.801 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271924.log 2024-02-18T11:13:23.802 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.233819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233819.log.gz 2024-02-18T11:13:23.802 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170469.log 2024-02-18T11:13:23.803 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.271924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271924.log.gz 2024-02-18T11:13:23.803 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168695.log 2024-02-18T11:13:23.804 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.170469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170469.log.gz 2024-02-18T11:13:23.804 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230801.log 2024-02-18T11:13:23.805 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.168695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168695.log.gz 2024-02-18T11:13:23.805 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222797.log 2024-02-18T11:13:23.806 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.230801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230801.log.gz 2024-02-18T11:13:23.806 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163312.log 2024-02-18T11:13:23.807 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222797.log.gz 2024-02-18T11:13:23.807 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156039.log 2024-02-18T11:13:23.808 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.163312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163312.log.gz 2024-02-18T11:13:23.808 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155019.log 2024-02-18T11:13:23.809 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.156039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192473.log 2024-02-18T11:13:23.809 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156039.log.gz 2024-02-18T11:13:23.810 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.155019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155019.log.gz 2024-02-18T11:13:23.810 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181424.log 2024-02-18T11:13:23.811 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.192473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192473.log.gz 2024-02-18T11:13:23.811 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226958.log 2024-02-18T11:13:23.812 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181424.log.gz 2024-02-18T11:13:23.812 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184461.log 2024-02-18T11:13:23.813 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.226958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226958.log.gz 2024-02-18T11:13:23.813 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255579.log 2024-02-18T11:13:23.814 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184461.log.gz 2024-02-18T11:13:23.814 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222381.log 2024-02-18T11:13:23.815 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.255579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255579.log.gz 2024-02-18T11:13:23.815 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271510.log 2024-02-18T11:13:23.816 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.222381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221638.log 2024-02-18T11:13:23.816 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222381.log.gz 2024-02-18T11:13:23.817 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.271510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271510.log.gz 2024-02-18T11:13:23.817 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228172.log 2024-02-18T11:13:23.817 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.221638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221638.log.gz 2024-02-18T11:13:23.818 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254772.log 2024-02-18T11:13:23.819 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.228172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228172.log.gz 2024-02-18T11:13:23.819 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198466.log 2024-02-18T11:13:23.819 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.254772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254772.log.gz 2024-02-18T11:13:23.820 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189863.log 2024-02-18T11:13:23.821 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.198466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198466.log.gz 2024-02-18T11:13:23.821 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139016.log 2024-02-18T11:13:23.822 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.189863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188252.log 2024-02-18T11:13:23.822 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189863.log.gz 2024-02-18T11:13:23.822 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.139016.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.139016.log.gz --verbose 2024-02-18T11:13:23.823 INFO:teuthology.orchestra.run.smithi204.stderr: -- /var/log/ceph/ceph-client.admin.232228.log 2024-02-18T11:13:23.823 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188252.log.gz 2024-02-18T11:13:23.823 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164186.log 2024-02-18T11:13:23.824 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232228.log.gz 2024-02-18T11:13:23.825 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194949.log 2024-02-18T11:13:23.825 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.164186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164186.log.gz 2024-02-18T11:13:23.825 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154009.log 2024-02-18T11:13:23.826 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.194949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194949.log.gz 2024-02-18T11:13:23.826 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178479.log 2024-02-18T11:13:23.827 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.154009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154009.log.gz 2024-02-18T11:13:23.827 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123830.log 2024-02-18T11:13:23.828 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198226.log 2024-02-18T11:13:23.828 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178479.log.gz 2024-02-18T11:13:23.829 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.123830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169909.log 2024-02-18T11:13:23.829 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123830.log.gz 2024-02-18T11:13:23.830 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.198226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198226.log.gz 2024-02-18T11:13:23.830 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226733.log 2024-02-18T11:13:23.831 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.169909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169909.log.gz 2024-02-18T11:13:23.831 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265527.log 2024-02-18T11:13:23.832 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.226733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226733.log.gz 2024-02-18T11:13:23.832 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146850.log 2024-02-18T11:13:23.833 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.265527.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.265527.log.gz --verbose 2024-02-18T11:13:23.833 INFO:teuthology.orchestra.run.smithi204.stderr: -- /var/log/ceph/ceph-client.admin.250607.log 2024-02-18T11:13:23.834 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.146850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181226.log 2024-02-18T11:13:23.834 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146850.log.gz 2024-02-18T11:13:23.834 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.250607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184444.log 2024-02-18T11:13:23.834 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250607.log.gz 2024-02-18T11:13:23.835 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.181226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181226.log.gz 2024-02-18T11:13:23.835 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256180.log 2024-02-18T11:13:23.836 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184444.log.gz 2024-02-18T11:13:23.836 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259934.log 2024-02-18T11:13:23.837 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.256180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256180.log.gz 2024-02-18T11:13:23.837 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202835.log 2024-02-18T11:13:23.838 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.259934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259934.log.gz 2024-02-18T11:13:23.838 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232790.log 2024-02-18T11:13:23.839 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.202835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202835.log.gz 2024-02-18T11:13:23.839 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161292.log 2024-02-18T11:13:23.840 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232790.log.gz 2024-02-18T11:13:23.840 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165394.log 2024-02-18T11:13:23.841 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.161292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161292.log.gz 2024-02-18T11:13:23.841 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194962.log 2024-02-18T11:13:23.842 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.165394.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165394.log.gz 2024-02-18T11:13:23.842 INFO:teuthology.orchestra.run.smithi204.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.221624.log 2024-02-18T11:13:23.842 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.194962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194962.log.gz 2024-02-18T11:13:23.843 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184431.log 2024-02-18T11:13:23.843 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.221624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221624.log.gz 2024-02-18T11:13:23.843 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226747.log 2024-02-18T11:13:23.844 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184431.log.gz 2024-02-18T11:13:23.844 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256194.log 2024-02-18T11:13:23.845 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.226747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226747.log.gz 2024-02-18T11:13:23.845 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262544.log 2024-02-18T11:13:23.847 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.256194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256194.log.gz 2024-02-18T11:13:23.847 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139029.log 2024-02-18T11:13:23.849 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262544.log.gz 2024-02-18T11:13:23.849 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166688.log 2024-02-18T11:13:23.849 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.139029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187072.log 2024-02-18T11:13:23.849 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139029.log.gz 2024-02-18T11:13:23.850 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.166688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166688.log.gz 2024-02-18T11:13:23.850 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135361.log 2024-02-18T11:13:23.850 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.187072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187072.log.gz 2024-02-18T11:13:23.850 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232415.log 2024-02-18T11:13:23.851 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.135361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135361.log.gz 2024-02-18T11:13:23.852 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139236.log 2024-02-18T11:13:23.852 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232415.log.gz 2024-02-18T11:13:23.852 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191811.log 2024-02-18T11:13:23.852 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.139236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139236.log.gz 2024-02-18T11:13:23.852 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257746.log 2024-02-18T11:13:23.853 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.191811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191811.log.gz 2024-02-18T11:13:23.853 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245119.log 2024-02-18T11:13:23.853 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.257746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257746.log.gz 2024-02-18T11:13:23.854 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232508.log 2024-02-18T11:13:23.854 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.245119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245119.log.gz 2024-02-18T11:13:23.854 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225433.log 2024-02-18T11:13:23.855 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232508.log.gz 2024-02-18T11:13:23.855 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192035.log 2024-02-18T11:13:23.856 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.225433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225433.log.gz 2024-02-18T11:13:23.856 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164953.log 2024-02-18T11:13:23.857 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.192035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192035.log.gz 2024-02-18T11:13:23.857 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257085.log 2024-02-18T11:13:23.858 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.164953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164953.log.gz 2024-02-18T11:13:23.858 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184702.log 2024-02-18T11:13:23.859 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.257085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257085.log.gz 2024-02-18T11:13:23.859 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232531.log 2024-02-18T11:13:23.860 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184702.log.gz 2024-02-18T11:13:23.860 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184229.log 2024-02-18T11:13:23.861 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232531.log.gz 2024-02-18T11:13:23.861 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160396.log 2024-02-18T11:13:23.862 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.184229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.184229.log.gz 2024-02-18T11:13:23.862 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228923.log 2024-02-18T11:13:23.863 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160396.log.gz 2024-02-18T11:13:23.863 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182492.log 2024-02-18T11:13:23.864 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.228923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228923.log.gz 2024-02-18T11:13:23.864 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175422.log 2024-02-18T11:13:23.865 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182492.log.gz 2024-02-18T11:13:23.865 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220365.log 2024-02-18T11:13:23.866 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.175422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175422.log.gz 2024-02-18T11:13:23.866 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182077.log 2024-02-18T11:13:23.867 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.220365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220365.log.gz 2024-02-18T11:13:23.867 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230373.log 2024-02-18T11:13:23.868 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.182077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182077.log.gz 2024-02-18T11:13:23.868 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178686.log 2024-02-18T11:13:23.868 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.230373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230373.log.gz 2024-02-18T11:13:23.869 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232254.log 2024-02-18T11:13:23.869 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.178686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178686.log.gz 2024-02-18T11:13:23.870 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136802.log 2024-02-18T11:13:23.871 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.232254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232254.log.gz 2024-02-18T11:13:23.871 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264243.log 2024-02-18T11:13:23.872 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.136802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136802.log.gz 2024-02-18T11:13:23.872 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256868.log 2024-02-18T11:13:23.873 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264243.log.gz 2024-02-18T11:13:23.873 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271497.log 2024-02-18T11:13:23.874 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.256868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256868.log.gz 2024-02-18T11:13:23.874 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164739.log 2024-02-18T11:13:23.875 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.271497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271497.log.gz 2024-02-18T11:13:23.875 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186626.log 2024-02-18T11:13:23.875 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.164739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164739.log.gz 2024-02-18T11:13:23.876 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160615.log 2024-02-18T11:13:23.876 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.186626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122868.log 2024-02-18T11:13:23.877 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186626.log.gz 2024-02-18T11:13:23.877 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.160615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160615.log.gz 2024-02-18T11:13:23.878 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188887.log 2024-02-18T11:13:23.878 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.122868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122868.log.gz 2024-02-18T11:13:23.879 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264885.log 2024-02-18T11:13:23.879 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.188887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188887.log.gz 2024-02-18T11:13:23.879 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156227.log 2024-02-18T11:13:23.880 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.264885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264885.log.gz 2024-02-18T11:13:23.880 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262745.log 2024-02-18T11:13:23.881 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.156227.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156227.log.gz -5 2024-02-18T11:13:23.881 INFO:teuthology.orchestra.run.smithi204.stderr: --verbose -- /var/log/ceph/ceph-client.admin.231977.log 2024-02-18T11:13:23.882 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.262745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262745.log.gz 2024-02-18T11:13:23.882 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.231977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231977.log.gz 2024-02-18T11:13:23.887 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-02-18T11:13:23.887 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m0.595s 2024-02-18T11:13:23.887 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m0.114s 2024-02-18T11:13:23.887 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m1.066s 2024-02-18T11:13:25.493 INFO:teuthology.orchestra.run.smithi164.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-18T11:13:25.576 INFO:teuthology.orchestra.run.smithi164.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-18T11:13:29.327 INFO:teuthology.orchestra.run.smithi118.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-18T11:13:41.754 INFO:teuthology.orchestra.run.smithi164.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-18T11:13:42.282 INFO:teuthology.orchestra.run.smithi118.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-18T11:13:43.788 INFO:teuthology.orchestra.run.smithi164.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-18T11:13:43.962 INFO:teuthology.orchestra.run.smithi164.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-18T11:14:39.310 INFO:teuthology.orchestra.run.smithi164.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-18T11:14:39.312 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-02-18T11:14:39.312 INFO:teuthology.orchestra.run.smithi164.stderr:real 1m16.057s 2024-02-18T11:14:39.312 INFO:teuthology.orchestra.run.smithi164.stderr:user 2m2.995s 2024-02-18T11:14:39.312 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m4.833s 2024-02-18T11:16:45.120 INFO:teuthology.orchestra.run.smithi118.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-18T11:18:23.993 INFO:teuthology.orchestra.run.smithi118.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-18T11:21:45.011 INFO:teuthology.orchestra.run.smithi118.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-18T11:22:03.270 INFO:teuthology.orchestra.run.smithi118.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-18T11:22:03.272 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-02-18T11:22:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:real 8m40.025s 2024-02-18T11:22:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:user 4m0.135s 2024-02-18T11:22:03.272 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m11.732s 2024-02-18T11:22:03.273 INFO:tasks.ceph:Archiving logs... 2024-02-18T11:22:03.274 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi118/log 2024-02-18T11:22:03.275 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-18T11:24:54.111 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi164/log 2024-02-18T11:24:54.140 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-18T11:26:09.338 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi204/log 2024-02-18T11:26:09.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-18T11:26:10.423 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-18T11:26:10.437 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-18T11:26:10.438 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-18T11:26:10.441 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-18T11:26:10.443 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-18T11:26:10.616 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-18T11:26:10.626 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-18T11:26:10.626 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T11:26:10.629 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T11:26:10.631 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-18T11:26:10.643 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-02-18T11:26:10.645 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-02-18T11:26:10.687 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-02-18T11:26:10.710 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-18T11:26:10.710 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-02-18T11:26:10.710 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 +2817us[+2668us] +/- 78ms 2024-02-18T11:26:10.711 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -1258us[-1406us] +/- 53ms 2024-02-18T11:26:10.711 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 53 -847us[ -847us] +/- 80ms 2024-02-18T11:26:10.711 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T11:26:10.773 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-18T11:26:10.773 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-02-18T11:26:10.773 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 +2773us[+2773us] +/- 78ms 2024-02-18T11:26:10.774 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -1316us[-1480us] +/- 53ms 2024-02-18T11:26:10.774 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -928us[ -928us] +/- 80ms 2024-02-18T11:26:10.774 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T11:26:11.016 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-18T11:26:11.016 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-02-18T11:26:11.016 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 +2784us[+2783us] +/- 78ms 2024-02-18T11:26:11.016 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 -1305us[-1306us] +/- 53ms 2024-02-18T11:26:11.016 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -925us[ -926us] +/- 79ms 2024-02-18T11:26:11.016 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-18T11:26:11.017 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-18T11:26:11.027 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-18T11:26:11.028 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-18T11:26:11.039 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-18T11:26:11.161 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-18T11:26:11.257 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-18T11:26:11.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-18T11:26:11.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T11:26:11.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-18T11:26:11.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T11:26:11.597 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-18T11:26:11.695 INFO:teuthology.orchestra.run.smithi204.stdout:type=AVC msg=audit(1708249916.650:192): avc: denied { checkpoint_restore } for pid=1142 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-02-18T11:26:11.697 DEBUG:teuthology.task.selinux:ubuntu@smithi204.front.sepia.ceph.com has 1 denials 2024-02-18T11:26:11.697 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi204.front.sepia.ceph.com: ['type=AVC msg=audit(1708249916.650:192): avc: denied { checkpoint_restore } for pid=1142 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-02-18T11:26:11.705 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-18T11:26:11.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-18T11:26:11.724 INFO:teuthology.task.internal:Duration was 5656.699596 seconds 2024-02-18T11:26:11.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-18T11:26:11.734 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-18T11:26:11.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-18T11:26:11.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-18T11:26:11.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-18T11:26:11.830 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-18T11:26:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-18T11:26:11.988 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-18T11:26:12.226 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-18T11:26:12.226 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-02-18T11:26:12.226 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-18T11:26:12.250 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-02-18T11:26:12.250 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-18T11:26:12.280 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-02-18T11:26:12.280 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-18T11:26:12.356 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-18T11:26:12.357 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-18T11:26:12.359 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-18T11:26:12.362 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-18T11:26:12.449 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-18T11:26:12.449 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-18T11:26:12.452 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-18T11:26:12.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-18T11:26:12.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-18T11:26:12.758 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-18T11:26:12.759 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-18T11:26:12.790 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-18T11:26:12.829 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-18T11:26:12.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-18T11:26:12.965 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-18T11:26:12.967 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-18T11:26:12.970 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-18T11:26:13.006 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-02-18T11:26:13.008 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-02-18T11:26:13.103 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-02-18T11:26:13.176 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-18T11:26:13.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T11:26:13.191 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-18T11:26:13.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T11:26:13.206 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-18T11:26:13.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-18T11:26:13.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-18T11:26:13.392 INFO:teuthology.task.internal:Transferring archived files... 2024-02-18T11:26:13.457 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi118 2024-02-18T11:26:13.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-18T11:26:14.373 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi164 2024-02-18T11:26:14.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-18T11:26:14.572 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235/remote/smithi204 2024-02-18T11:26:14.573 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-18T11:26:14.694 INFO:teuthology.task.internal:Removing archive directory... 2024-02-18T11:26:14.695 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-18T11:26:14.698 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-18T11:26:14.701 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-18T11:26:14.756 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-18T11:26:14.769 INFO:teuthology.task.internal:Not uploading archives. 2024-02-18T11:26:14.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-18T11:26:14.780 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-18T11:26:14.780 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-18T11:26:14.784 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-18T11:26:14.786 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-18T11:26:14.798 INFO:teuthology.orchestra.run.smithi118.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 11:26 /home/ubuntu/cephtest 2024-02-18T11:26:14.801 INFO:teuthology.orchestra.run.smithi164.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 11:26 /home/ubuntu/cephtest 2024-02-18T11:26:14.839 INFO:teuthology.orchestra.run.smithi204.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 11:26 /home/ubuntu/cephtest 2024-02-18T11:26:14.842 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-18T11:26:14.853 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-18T11:26:14.863 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi204.front.sepia.ceph.com: ['type=AVC msg=audit(1708249916.650:192): avc: denied { checkpoint_restore } for pid=1142 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-02-18T11:26:14.864 INFO:teuthology.nuke:Checking targets against current locks 2024-02-18T11:26:14.890 DEBUG:teuthology.nuke:shortname: smithi118 2024-02-18T11:26:14.891 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-18T11:26:14.915 DEBUG:teuthology.nuke:shortname: smithi164 2024-02-18T11:26:14.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-18T11:26:14.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 09:42:35.259265', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZioc6pa4+oz0XCTQljlJUduSe+1jIjC5Fd/aVbJThzKIigAJ8tMAY97unjHomM/Kr+lPwT2ZnhoHDwzJeFf6Y='} 2024-02-18T11:26:14.938 DEBUG:teuthology.nuke:shortname: smithi204 2024-02-18T11:26:14.939 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-18T11:26:14.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 09:42:35.257767', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYQXOSdNYnapYj4jEuyCXlXEtYTzVQN5PHvDgwA3lbpsizkfA844XZUDsejkHpeA+WlFtFy6kA5uxDBmeYv/yo='} 2024-02-18T11:26:14.974 INFO:teuthology.orchestra.console.smithi118:Power off 2024-02-18T11:26:14.974 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T11:26:14.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-17_05:57:56-fs-wip-vshankar-testing-20240217.015652-testing-default-smithi/7564235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-18 09:42:35.256535', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEmMb6FqGoyWzX8eSx4hpHjQmEenwlCRh7eo4G9jaP2v6LNgIXfax8fJXUI5J2v+9KwXG0HYZrjXDpQLedOwY7w='} 2024-02-18T11:26:14.998 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2024-02-18T11:26:14.998 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:15.022 INFO:teuthology.orchestra.console.smithi164:Power off 2024-02-18T11:26:15.022 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T11:26:15.035 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-02-18T11:26:15.045 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-02-18T11:26:15.045 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:15.062 INFO:teuthology.orchestra.console.smithi204:Power off 2024-02-18T11:26:15.063 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-18T11:26:15.073 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-02-18T11:26:15.087 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-02-18T11:26:15.087 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:15.110 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-18T11:26:19.036 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:19.075 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:19.111 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:19.147 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-02-18T11:26:19.187 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-02-18T11:26:19.223 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-18T11:26:23.152 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:23.188 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:23.224 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-18T11:26:23.263 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-02-18T11:26:23.298 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-02-18T11:26:23.337 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-02-18T11:26:23.367 INFO:teuthology.orchestra.console.smithi118:Power off completed 2024-02-18T11:26:23.399 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-02-18T11:26:23.437 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-02-18T11:26:23.548 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8d59ab0bd93c806231018a6729893bf309624262 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn} tasks/{0-client 1-tests/fscrypt-common}} duration: 5656.699595928192 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fe1a25b6364d4f77915a6b0ec49446ab status: fail success: false 2024-02-18T11:26:23.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-18T11:26:23.637 INFO:teuthology.run:FAIL